-- Logs begin at Sun 2022-08-07 21:36:33 UTC, end at Sun 2022-08-07 22:51:48 UTC. -- Aug 07 22:18:39.709907 dv-cinder-850321-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 07 22:18:39.720108 dv-cinder-850321-3-smb devstack@keystone.service[80274]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 07 22:18:39.722096 dv-cinder-850321-3-smb devstack@keystone.service[80274]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 22:18:39 2022] *** Aug 07 22:18:39.722096 dv-cinder-850321-3-smb devstack@keystone.service[80274]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 22:18:39.722096 dv-cinder-850321-3-smb devstack@keystone.service[80274]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 22:18:39.722096 dv-cinder-850321-3-smb devstack@keystone.service[80274]: nodename: dv-cinder-850321-3-smb Aug 07 22:18:39.722096 dv-cinder-850321-3-smb devstack@keystone.service[80274]: machine: x86_64 Aug 07 22:18:39.722096 dv-cinder-850321-3-smb devstack@keystone.service[80274]: clock source: unix Aug 07 22:18:39.722096 dv-cinder-850321-3-smb devstack@keystone.service[80274]: pcre jit disabled Aug 07 22:18:39.722096 dv-cinder-850321-3-smb devstack@keystone.service[80274]: detected number of CPU cores: 4 Aug 07 22:18:39.722096 dv-cinder-850321-3-smb devstack@keystone.service[80274]: current working directory: / Aug 07 22:18:39.722096 dv-cinder-850321-3-smb devstack@keystone.service[80274]: detected binary path: /usr/bin/uwsgi-core Aug 07 22:18:39.722096 dv-cinder-850321-3-smb devstack@keystone.service[80274]: your processes number limit is 47680 Aug 07 22:18:39.722759 dv-cinder-850321-3-smb devstack@keystone.service[80274]: your memory page size is 4096 bytes Aug 07 22:18:39.722759 dv-cinder-850321-3-smb devstack@keystone.service[80274]: detected max file descriptor number: 2048 Aug 07 22:18:39.722759 dv-cinder-850321-3-smb devstack@keystone.service[80274]: lock engine: pthread robust mutexes Aug 07 22:18:39.722759 dv-cinder-850321-3-smb devstack@keystone.service[80274]: thunder lock: enabled Aug 07 22:18:39.722759 dv-cinder-850321-3-smb devstack@keystone.service[80274]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 07 22:18:39.722759 dv-cinder-850321-3-smb devstack@keystone.service[80274]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 22:18:39.762084 dv-cinder-850321-3-smb devstack@keystone.service[80274]: Python main interpreter initialized at 0x5585bd7cf9c0 Aug 07 22:18:39.762084 dv-cinder-850321-3-smb devstack@keystone.service[80274]: python threads support enabled Aug 07 22:18:39.762084 dv-cinder-850321-3-smb devstack@keystone.service[80274]: your server socket listen backlog is limited to 100 connections Aug 07 22:18:39.762084 dv-cinder-850321-3-smb devstack@keystone.service[80274]: your mercy for graceful operations on workers is 90 seconds Aug 07 22:18:39.762405 dv-cinder-850321-3-smb devstack@keystone.service[80274]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 22:18:39.762479 dv-cinder-850321-3-smb devstack@keystone.service[80274]: *** Operational MODE: preforking *** Aug 07 22:18:39.762738 dv-cinder-850321-3-smb devstack@keystone.service[80274]: *** uWSGI is running in multiple interpreter mode *** Aug 07 22:18:39.762738 dv-cinder-850321-3-smb devstack@keystone.service[80274]: spawned uWSGI master process (pid: 80274) Aug 07 22:18:39.762914 dv-cinder-850321-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 07 22:18:39.763457 dv-cinder-850321-3-smb devstack@keystone.service[80274]: spawned uWSGI worker 1 (pid: 80285, cores: 1) Aug 07 22:18:39.763786 dv-cinder-850321-3-smb devstack@keystone.service[80274]: spawned uWSGI worker 2 (pid: 80286, cores: 1) Aug 07 22:18:39.763948 dv-cinder-850321-3-smb devstack@keystone.service[80274]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 22:18:45.243910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 22:18:45.243910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: from cryptography.utils import int_from_bytes Aug 07 22:18:45.244659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 22:18:45.244659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: from cryptography.utils import int_from_bytes Aug 07 22:18:45.245101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 22:18:45.245101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: from cryptography.utils import int_from_bytes Aug 07 22:18:45.245222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 22:18:45.245222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: from cryptography.utils import int_from_bytes Aug 07 22:18:45.293910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 22:18:45.294105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 22:18:45.294287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] command line args: [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 22:18:45.294448 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 22:18:45.294537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 22:18:45.294639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 22:18:45.294724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ================================================================================ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 22:18:45.294835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] command line args: [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 22:18:45.294949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] admin_token = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.295108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 22:18:45.295224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] config_dir = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.295305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ================================================================================ {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 22:18:45.295409 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.295525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] admin_token = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.295607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] config_source = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.295748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] debug = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.295828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] config_dir = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.295934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.296022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] config_source = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] debug = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297681 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_config_append = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.297977 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298104 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_dir = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298167 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_config_append = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_file = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_dir = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_file = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298747 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.298873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.299010 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.299105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.299256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.299408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.299555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.299781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.299943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.300119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.300334 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.300523 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.300675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.300846 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.301019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.301192 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.301368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.301555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.301730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.301911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.302068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.302194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.302338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.302338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.302568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.302568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] publish_errors = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.302828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.302955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.303077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] publish_errors = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.303230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.303410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.303547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.303670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.303785 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.303906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.304042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.304166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.304291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] standard_threads = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.304413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.304528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.304648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] standard_threads = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.304852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.304976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.305097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.305214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.305330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_journal = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.305452 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.305577 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_json = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.305704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] use_journal = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.305822 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_stderr = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.305943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] use_json = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.306065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_syslog = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.306194 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] use_stderr = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.306321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.306443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] use_syslog = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.306560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.306675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:18:45.306790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.306911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.307036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.307199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.307325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.307473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.307589 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.307704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.307827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.307944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.308059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.308180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.308296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.308413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.308535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.308652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.308767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.308882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.308998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.309112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.309239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.309356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.309472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.309594 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.309718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.309835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.309961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.309961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.310193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.310309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.310424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.310541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.310732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.310851 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.310966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.311133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.311133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.311366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.311495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.311613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.311729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.311850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.311967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.311967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.312198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.312321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.312443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.312602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.312602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.312845 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.312969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.313085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.313201 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.313201 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.313416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.313539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.313657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.313657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.313872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.313993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.314109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.314236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.314358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.314481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.314481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.314698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.315327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.315460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.315583 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.315704 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.315827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.315942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.316063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.316063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.316289 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.316404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.316518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.316633 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.316747 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.316943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.317069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.317185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.317185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.317399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.317514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.317636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.317752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.317868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.317990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.317990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.318224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.318405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.318525 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.318641 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.318762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.318881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.318997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.319179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.319179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.319400 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.319516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.319637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.319753 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.319877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.319994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.319994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.320218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.320324 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.320453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.320563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.320663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.320760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.320760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.320940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.321038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.321143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.321242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.321349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.321463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.321585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.321703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.321703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.321941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.322060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.322184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.322297 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.322413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.322538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.322538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.322768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.322876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.322991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.323143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.323264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.323380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.323505 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.323629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.323629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.323843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.323959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.324083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.324202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.324318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.324434 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.324434 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.324650 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.324773 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.324890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.325006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.325121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.325238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.325354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.325478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.325478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.325708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.325827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.325943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.326059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.326185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.326303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.326303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.326519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.326634 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.326749 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.326874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.326991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.327154 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.327275 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.327391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.327391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.327623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.327741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.327857 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.327974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.328089 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.328211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.328211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.328507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.328624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.328739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.328861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.328978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.329101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.329101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.329341 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.329459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.329581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.329698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.329815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.329939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.330064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.330182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.330182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.330528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.330528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.331281 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.331281 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.external = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.331518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.331635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.331752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.331868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.331994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.332112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.332228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.332344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.password = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.332344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.token = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.332562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.332686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.332804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.332928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.333046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.333162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.333162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.333418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.333538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.333667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.333794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.333913 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.334030 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.334030 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.334249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.334373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.334492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.external = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.334610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.334728 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.334846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.334846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.335072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.335238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.335356 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.335472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.335589 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.password = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.335707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.335707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.335946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.token = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.336063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.336180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.336296 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.336419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.336546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.336665 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.336783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.336783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.337010 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.337134 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.337261 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.337380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.337380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.337598 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.337715 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.337833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.337958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.338076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.338193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.338310 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.338426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.338551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.338682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.338803 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.338920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.339037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.339171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.339289 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.339419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.339539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.339656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.339774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.339893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.340017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.340143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.340262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.340380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.340497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.340614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.340731 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.340861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.340981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.341107 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.341226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.341344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.341461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.341595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.341720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.341839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.341957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.342074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.342229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.342358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.342476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.342594 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.342710 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.342827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.342943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.343180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.343303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.343420 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.343537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.343654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.343780 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.343899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.344016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.344134 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.344251 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.344369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.344495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.344615 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.344732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.344850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.344967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.345084 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.345209 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.345328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.345445 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.345577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.345695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.345816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.345942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.346062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.346180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.346297 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.346413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.346531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.346656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.346780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.346898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.347016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.347169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.347289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.347420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.347540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.347657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.347774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.347891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.348008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.348132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.348253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.348380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.348499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.348617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.348734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.348859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.348984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.349103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.349220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.349338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.349456 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.349581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.349701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.349818 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.349935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.350052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.350169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.350294 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.350414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.350539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.350657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.350774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.350897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.351023 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.351180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.351300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.351419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.351536 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.351653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.351779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.351898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.352015 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.352132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.352248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.352373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.352500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.352618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.352736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.352858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.352976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.353093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.353218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.353337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.353454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.353572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.353689 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.353805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.353933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.354053 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.354170 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.354287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.354404 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.354530 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.354648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.354766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.354883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.354999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.355133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.355264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.355384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.355502 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.355620 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.355736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.355856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.355983 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.356101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.356219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.356335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.356453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.356570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.356697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.356815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.356939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.357057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.357175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.357291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.357417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.357535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.357652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.357770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.357887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.358004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.358136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.358255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.358372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.358372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.358596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.358596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.358826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.358944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.359062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.359234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.359362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.359481 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.359607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.359725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.359843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.359960 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.360077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.360193 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.360318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.360436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.360553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.360670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.360787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.360904 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.361030 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.361148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.361265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.361381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.361498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.361614 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.361739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.361859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.361976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.362093 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.362209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.362326 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.362451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.362569 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.362686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.362802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.362920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.363037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.363181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.363301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.363419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.363535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.363652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.363768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.363893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.363893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] role.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.364114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.364231 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] role.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.364347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.364464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.364589 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.364589 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.364809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.364926 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.365044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.365160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.365285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.365404 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.365520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.365637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.365754 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.365873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.366067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.366189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.366305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.366422 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.366539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.366655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.366779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.366898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.367014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.367145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.367264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.367396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.367516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.367634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.367751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.367868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.367984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.368108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.368228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.368345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.368462 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.368586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] role.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.368704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.368828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] role.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.368828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.369049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.369166 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.369284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.369400 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.369525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.369643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.369760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.369876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.369993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.370110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.370234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.370354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.370471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.370587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.370704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.370820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.370945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.371063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.371209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.371329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.371447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.371563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.371689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.371808 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.371925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.372041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.372158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.372158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.372385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.372510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.372628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.372745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.372863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.372980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.373104 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.373223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.373223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.373691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.373808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.373933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.374060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.374178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.374299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.374416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.374534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.374659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.374777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.374894 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.375011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.375152 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.375272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.375401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.375522 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.375640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.375757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.375877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.375994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.376119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.376237 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.376354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.376470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.376588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.376588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.376815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.376933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.377050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.connection = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.377175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.377779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.377901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.378019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.378136 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.378261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.378380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.378497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.378613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.378730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.378846 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.378971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.379112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.379232 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.379232 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.379451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.379568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.379704 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.379824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.379941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.380059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.380176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.380292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.380417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.380536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.380736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.380867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.380986 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.381104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.381229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.381348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.381464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.381582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.381699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.381825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.381945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.382062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 22:18:45.382180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.382180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.382180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.382180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.382180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.382180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.382180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.382180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.382180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.383203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.383203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.383203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.383203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.383203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.383203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.383203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.383203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.383203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.384164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:18:45.384164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 22:18:45.407839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.408064 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.408282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.408834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.409062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.409285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.417884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.418830 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.447043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.447297 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.447718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.447945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.499514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.499777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.549745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.549970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.550209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.550440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.613545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.613764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.613857 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.613981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.614067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.614202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.614289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.614416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.614503 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.614625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.614710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.614839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.638011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.638236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.638368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.638454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.638599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.638685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.638823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.638907 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.639032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.639146 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.639266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.639352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.639477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.639688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.650128 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.650385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.662638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.662880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.663023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.663138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.663280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.663365 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.663503 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.663585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.663709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.663801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.663913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.663997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.664117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.664324 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 22:18:45.681054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.681260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 22:18:45.681345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.681483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 22:18:45.681593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.681787 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 22:18:45.681886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.681999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 22:18:45.682081 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.682270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.682352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.682528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.682612 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.682775 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.682857 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.683025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.694615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.694846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.694932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.695147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.695234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.695416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.695512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.695694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.702296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.702537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.705412 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.705639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.705725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.705921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.706005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.706199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.706282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.706474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.706560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.706728 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.706810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.706990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.707111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.707279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.707361 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.707543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.707624 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.707808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.707894 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.708069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.708150 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.708327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.730850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.731102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.732349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.732582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.732666 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.732863 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.737740 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.738018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.738102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.738297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.738381 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.738646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.744897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.745180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.745264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.745488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.749575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.749815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.749902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.750094 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.750177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.750381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.750472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.750663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.750748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.750954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.751036 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.751249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.751346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.751515 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.751598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.751820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.768001 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.768246 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.768330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.768521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.772304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.772606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.775450 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.775745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.775828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.776037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.780127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.780404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.783307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.783581 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.786477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.786720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.786817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.787015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.787115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.787341 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.787430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.787614 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.787702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.787892 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.787974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.788168 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.804337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.804511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.804625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.804797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.804880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.805060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.805156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.805320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.811977 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.812286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.813534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.813809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.813894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.814109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.817205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.817486 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.817569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.817768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.817851 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.818052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.818135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.818339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.818433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.818614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.829727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.829970 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.830056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.830253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.830338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.830558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.830643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.830836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.830930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.831124 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.831210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.831401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.831485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.831674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.848508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.848634 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.851479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.851601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.854376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.854497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.855952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.856073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.857448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.857553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.857734 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.857816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.858031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.858117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.865312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.865712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.866914 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.867568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.869859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.870144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.870425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.870697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.871357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.871647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.871927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.872197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.879227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.879515 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.879791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.880490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.880777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.881056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.886610 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.886897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.887203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.887476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.887744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.887901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 22:18:45.888013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.888179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.888282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.888458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.888555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.888728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.888890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.888981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.889175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.889267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.889443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.889526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.889701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.889831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.889971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.890136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.890220 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.890423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.890694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.890961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.891250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.891510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 22:18:45.923692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585bd7cf9c0 pid: 80285 (default app) Aug 07 22:18:45.925550 dv-cinder-850321-3-smb devstack@keystone.service[80286]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585bd7cf9c0 pid: 80286 (default app) Aug 07 22:18:45.927585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72081833-4c21-4827-837d-ba1b9fef11a7 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:45.927867 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72081833-4c21-4827-837d-ba1b9fef11a7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:45.928135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72081833-4c21-4827-837d-ba1b9fef11a7 None None] PATH_INFO: `/v3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:45.932436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Sun Aug 7 22:18:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:18:53.490201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127acbab-f20d-48f6-b44b-734f28c7346a None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:53.490818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127acbab-f20d-48f6-b44b-734f28c7346a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:53.490818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127acbab-f20d-48f6-b44b-734f28c7346a None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:53.495129 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:18:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:18:53.500817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7071e90-2ae6-4ebb-ba94-2ff5038e046a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:53.501271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7071e90-2ae6-4ebb-ba94-2ff5038e046a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:53.501387 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7071e90-2ae6-4ebb-ba94-2ff5038e046a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:53.570958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: INFO dbcounter [None req-e7071e90-2ae6-4ebb-ba94-2ff5038e046a None None] Registered counter for database keystone Aug 07 22:18:53.590567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG oslo_db.sqlalchemy.engines [None req-e7071e90-2ae6-4ebb-ba94-2ff5038e046a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:18:53.597240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writer thread running {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:18:53.773017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG passlib.handlers.bcrypt [None req-e7071e90-2ae6-4ebb-ba94-2ff5038e046a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80285) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 22:18:53.773348 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG passlib.handlers.bcrypt [None req-e7071e90-2ae6-4ebb-ba94-2ff5038e046a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80285) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 22:18:53.826703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e7071e90-2ae6-4ebb-ba94-2ff5038e046a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:18:53.828291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e7071e90-2ae6-4ebb-ba94-2ff5038e046a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:18:53.961649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:18:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 07 22:18:54.112085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127acbab-f20d-48f6-b44b-734f28c7346a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:18:54.181041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: INFO dbcounter [None req-127acbab-f20d-48f6-b44b-734f28c7346a None None] Registered counter for database keystone Aug 07 22:18:54.202049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG oslo_db.sqlalchemy.engines [None req-127acbab-f20d-48f6-b44b-734f28c7346a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:18:54.208694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writer thread running {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:18:54.330246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127acbab-f20d-48f6-b44b-734f28c7346a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:18:54.335070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403afc27-54eb-4cac-8ff0-0dcb5b07ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:18:54.335720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403afc27-54eb-4cac-8ff0-0dcb5b07ecdd admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:54.335995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403afc27-54eb-4cac-8ff0-0dcb5b07ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:54.336261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403afc27-54eb-4cac-8ff0-0dcb5b07ecdd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:54.344219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403afc27-54eb-4cac-8ff0-0dcb5b07ecdd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:18:54.395653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: WARNING keystone.common.rbac_enforcer.enforcer [None req-403afc27-54eb-4cac-8ff0-0dcb5b07ecdd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 22:18:54.395937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403afc27-54eb-4cac-8ff0-0dcb5b07ecdd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:18:54.405251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Sun Aug 7 22:18:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:18:54.411237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7071e90-2ae6-4ebb-ba94-2ff5038e046a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:18:54.425996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7071e90-2ae6-4ebb-ba94-2ff5038e046a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:18:54.430361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5417f6-466b-4512-9938-bae188238ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:18:54.431473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5417f6-466b-4512-9938-bae188238ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:54.431751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5417f6-466b-4512-9938-bae188238ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:54.432031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5417f6-466b-4512-9938-bae188238ed4 admin admin] PATH_INFO: `/v3/projects/7053e2b8fbb347c68a456428438dcda4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:54.433456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5417f6-466b-4512-9938-bae188238ed4 admin admin] RBAC: Authorizing `identity:get_project(project_id=7053e2b8fbb347c68a456428438dcda4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:18:54.483225 dv-cinder-850321-3-smb devstack@keystone.service[80285]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8c5417f6-466b-4512-9938-bae188238ed4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 22:18:54.483567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5417f6-466b-4512-9938-bae188238ed4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:18:54.488589 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Sun Aug 7 22:18:54 2022] GET /identity/v3/projects/7053e2b8fbb347c68a456428438dcda4 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:18:56.437755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff8959-0313-4a11-a515-9964782f74cf None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:56.438302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff8959-0313-4a11-a515-9964782f74cf None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:56.438302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff8959-0313-4a11-a515-9964782f74cf None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:56.442576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:18:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:18:56.447824 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd60ad5-2e62-42ef-84f3-9f0f4df82358 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:56.448247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd60ad5-2e62-42ef-84f3-9f0f4df82358 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:56.448420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd60ad5-2e62-42ef-84f3-9f0f4df82358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:56.469283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2bd60ad5-2e62-42ef-84f3-9f0f4df82358 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:18:56.470806 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2bd60ad5-2e62-42ef-84f3-9f0f4df82358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:18:56.479163 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:18:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 07 22:18:56.501534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff8959-0313-4a11-a515-9964782f74cf None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:18:56.513483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff8959-0313-4a11-a515-9964782f74cf None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:18:56.517627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75104bc-41e2-495e-a2d7-00a23e3079af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:18:56.518202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75104bc-41e2-495e-a2d7-00a23e3079af admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:56.518553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75104bc-41e2-495e-a2d7-00a23e3079af admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:56.518819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75104bc-41e2-495e-a2d7-00a23e3079af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:56.526346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75104bc-41e2-495e-a2d7-00a23e3079af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:18:56.528107 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75104bc-41e2-495e-a2d7-00a23e3079af admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:18:56.537316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Sun Aug 7 22:18:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:18:56.542656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd60ad5-2e62-42ef-84f3-9f0f4df82358 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:18:56.552226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd60ad5-2e62-42ef-84f3-9f0f4df82358 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:18:56.557309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36891e2b-ffd0-4573-82b3-5511efcafa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:18:56.557984 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36891e2b-ffd0-4573-82b3-5511efcafa90 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:56.558272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36891e2b-ffd0-4573-82b3-5511efcafa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:56.558547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36891e2b-ffd0-4573-82b3-5511efcafa90 admin admin] PATH_INFO: `/v3/users/10ac18306f3645059eda74e33533cd06` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:56.559899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36891e2b-ffd0-4573-82b3-5511efcafa90 admin admin] RBAC: Authorizing `identity:get_user(user_id=10ac18306f3645059eda74e33533cd06)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:18:56.561720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36891e2b-ffd0-4573-82b3-5511efcafa90 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:18:56.563288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Sun Aug 7 22:18:56 2022] GET /identity/v3/users/10ac18306f3645059eda74e33533cd06 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:18:58.608127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034c4e-16e9-4091-a567-efa8c2903617 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:58.608672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034c4e-16e9-4091-a567-efa8c2903617 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:58.608672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034c4e-16e9-4091-a567-efa8c2903617 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:58.609979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:18:58.615803 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936aadf-c043-42ee-b134-cfb3baca2442 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:58.616185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936aadf-c043-42ee-b134-cfb3baca2442 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:58.616470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936aadf-c043-42ee-b134-cfb3baca2442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:58.618021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ab90-50e4-4b46-9047-63607eff8e74 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:58.618304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ab90-50e4-4b46-9047-63607eff8e74 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:58.618573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ab90-50e4-4b46-9047-63607eff8e74 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:58.619843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:18:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:18:58.625098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1270d-746a-48b2-a253-1b015b33e85f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:58.625448 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1270d-746a-48b2-a253-1b015b33e85f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:58.625723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1270d-746a-48b2-a253-1b015b33e85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:58.635361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0936aadf-c043-42ee-b134-cfb3baca2442 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:18:58.636524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0936aadf-c043-42ee-b134-cfb3baca2442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:18:58.668748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG passlib.handlers.bcrypt [None req-ecd1270d-746a-48b2-a253-1b015b33e85f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80286) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 22:18:58.669173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG passlib.handlers.bcrypt [None req-ecd1270d-746a-48b2-a253-1b015b33e85f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80286) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 22:18:58.714882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ecd1270d-746a-48b2-a253-1b015b33e85f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:18:58.716028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:18:58.716508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ecd1270d-746a-48b2-a253-1b015b33e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:18:58.739058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936aadf-c043-42ee-b134-cfb3baca2442 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:18:58.761993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:18:58.815330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:18:58.836533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1270d-746a-48b2-a253-1b015b33e85f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:18:58.841231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936aadf-c043-42ee-b134-cfb3baca2442 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:18:58.875115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df861a23-e28f-4c2b-9d79-c18a2aaa0396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:18:58.875685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df861a23-e28f-4c2b-9d79-c18a2aaa0396 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:58.875959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df861a23-e28f-4c2b-9d79-c18a2aaa0396 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:58.876226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df861a23-e28f-4c2b-9d79-c18a2aaa0396 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:58.886972 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df861a23-e28f-4c2b-9d79-c18a2aaa0396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-df861a23-e28f-4c2b-9d79-c18a2aaa0396 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:18:58.896063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:18:58.896945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:18:58.897961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:18:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:18:58.902822 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df861a23-e28f-4c2b-9d79-c18a2aaa0396 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:18:58.937711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1270d-746a-48b2-a253-1b015b33e85f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:18:58.940831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:18:58.976825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bdf1c-eaeb-44a5-a33a-12adb7fe507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:18:58.977798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bdf1c-eaeb-44a5-a33a-12adb7fe507f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:58.978075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bdf1c-eaeb-44a5-a33a-12adb7fe507f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:58.978340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bdf1c-eaeb-44a5-a33a-12adb7fe507f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:58.991206 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:18:59.010215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df861a23-e28f-4c2b-9d79-c18a2aaa0396 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:18:59.042758 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f5b65-ffc9-45d3-9fbd-482cf91cb67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:18:59.043384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f5b65-ffc9-45d3-9fbd-482cf91cb67c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:59.043657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f5b65-ffc9-45d3-9fbd-482cf91cb67c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:59.043924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f5b65-ffc9-45d3-9fbd-482cf91cb67c None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:59.044586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f5b65-ffc9-45d3-9fbd-482cf91cb67c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:18:59.044887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f5b65-ffc9-45d3-9fbd-482cf91cb67c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:18:59.046266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f5b65-ffc9-45d3-9fbd-482cf91cb67c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:18:59.048619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bdf1c-eaeb-44a5-a33a-12adb7fe507f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:18:59.050993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bdf1c-eaeb-44a5-a33a-12adb7fe507f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:18:59.058350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:18:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:18:59.063578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f5b65-ffc9-45d3-9fbd-482cf91cb67c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:18:59.146630 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 22:18:59.152485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bdf1c-eaeb-44a5-a33a-12adb7fe507f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:18:59.155720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:18:59.261629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bdf1c-eaeb-44a5-a33a-12adb7fe507f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:18:59.270815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f5b65-ffc9-45d3-9fbd-482cf91cb67c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:18:59.299184 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9554ba-0ead-490e-baa7-fb8469615540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:18:59.300675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9554ba-0ead-490e-baa7-fb8469615540 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:59.300951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9554ba-0ead-490e-baa7-fb8469615540 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:59.301215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9554ba-0ead-490e-baa7-fb8469615540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:59.305911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c85d2-f3c6-431b-966c-4afca274e72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:18:59.306534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c85d2-f3c6-431b-966c-4afca274e72e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:59.306810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c85d2-f3c6-431b-966c-4afca274e72e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:59.307093 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c85d2-f3c6-431b-966c-4afca274e72e None admin] PATH_INFO: `/v3/users/10ac18306f3645059eda74e33533cd06` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:59.308219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c85d2-f3c6-431b-966c-4afca274e72e None admin] RBAC: Authorizing `identity:get_user(user_id=10ac18306f3645059eda74e33533cd06)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:18:59.309658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c85d2-f3c6-431b-966c-4afca274e72e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:18:59.311260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:18:59 2022] GET /identity/v3/users/10ac18306f3645059eda74e33533cd06 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:18:59.316593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c85d2-f3c6-431b-966c-4afca274e72e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:18:59.319460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9554ba-0ead-490e-baa7-fb8469615540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:18:59.320911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9554ba-0ead-490e-baa7-fb8469615540 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:18:59.330944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-6a9554ba-0ead-490e-baa7-fb8469615540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:18:59.338541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:18:59.339600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:18:59.340510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:18:59.340510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:18:59.340510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:18:59.340510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:18:59.345393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9554ba-0ead-490e-baa7-fb8469615540 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:18:59.400098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:18:59.418429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c85d2-f3c6-431b-966c-4afca274e72e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:18:59.443744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9554ba-0ead-490e-baa7-fb8469615540 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:18:59.451272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df293a52-c4ca-440a-a5f7-d9a3e5d31ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:18:59.451896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df293a52-c4ca-440a-a5f7-d9a3e5d31ddf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:59.452175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df293a52-c4ca-440a-a5f7-d9a3e5d31ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:59.452449 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df293a52-c4ca-440a-a5f7-d9a3e5d31ddf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:59.453562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df293a52-c4ca-440a-a5f7-d9a3e5d31ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:18:59.454992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df293a52-c4ca-440a-a5f7-d9a3e5d31ddf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:18:59.456585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:18:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:18:59.462191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df293a52-c4ca-440a-a5f7-d9a3e5d31ddf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:18:59.476732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626f291-e13f-4760-a0e5-681356000505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:18:59.477333 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626f291-e13f-4760-a0e5-681356000505 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:59.477607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626f291-e13f-4760-a0e5-681356000505 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:59.477898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626f291-e13f-4760-a0e5-681356000505 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:59.478516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626f291-e13f-4760-a0e5-681356000505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:18:59.478818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626f291-e13f-4760-a0e5-681356000505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:18:59.480224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626f291-e13f-4760-a0e5-681356000505 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:18:59.497642 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:18:59.544990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:18:59.568028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df293a52-c4ca-440a-a5f7-d9a3e5d31ddf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:18:59.604953 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce030686-43c4-4425-9a3c-4014a8a17cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:18:59.605573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce030686-43c4-4425-9a3c-4014a8a17cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:18:59.605846 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce030686-43c4-4425-9a3c-4014a8a17cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:18:59.606114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce030686-43c4-4425-9a3c-4014a8a17cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:18:59.606852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce030686-43c4-4425-9a3c-4014a8a17cd1 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.domain.id=default, user.id=10ac18306f3645059eda74e33533cd06) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:18:59.607190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce030686-43c4-4425-9a3c-4014a8a17cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:18:59.608652 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce030686-43c4-4425-9a3c-4014a8a17cd1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:18:59.616836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1322 bytes} [Sun Aug 7 22:18:59 2022] GET /identity/v3/role_assignments?user.id=10ac18306f3645059eda74e33533cd06&scope.domain.id=default&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:01.936974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f0b6-9914-4cb2-ad3d-20a9e6a0aa31 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:01.937486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f0b6-9914-4cb2-ad3d-20a9e6a0aa31 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:01.937486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f0b6-9914-4cb2-ad3d-20a9e6a0aa31 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:01.938851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:01.945262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbed193-3d05-4fb4-a1e7-329b870dcfb6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:01.946350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbed193-3d05-4fb4-a1e7-329b870dcfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:01.946983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbed193-3d05-4fb4-a1e7-329b870dcfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:01.969764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-efbed193-3d05-4fb4-a1e7-329b870dcfb6 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:01.971388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-efbed193-3d05-4fb4-a1e7-329b870dcfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:02.079297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:02.107768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c876d-d2f5-4f1f-a1ba-7ff7eeaae808 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:02.108399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c876d-d2f5-4f1f-a1ba-7ff7eeaae808 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:02.108931 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c876d-d2f5-4f1f-a1ba-7ff7eeaae808 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:02.110461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:02.113064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbed193-3d05-4fb4-a1e7-329b870dcfb6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:02.119539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc9f5e-1734-48d2-97c9-534f181fd859 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:02.120068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc9f5e-1734-48d2-97c9-534f181fd859 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:02.120567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc9f5e-1734-48d2-97c9-534f181fd859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:02.151430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f3fc9f5e-1734-48d2-97c9-534f181fd859 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:02.153144 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f3fc9f5e-1734-48d2-97c9-534f181fd859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:02.291539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:02.308339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:02.311492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba44f2-76b8-42a4-858b-49d7e31c4748 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:02.312127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba44f2-76b8-42a4-858b-49d7e31c4748 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:02.312874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba44f2-76b8-42a4-858b-49d7e31c4748 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:02.314348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 14/26] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:02.323137 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78091c-24ed-463c-81c7-66027c053ff2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:02.323137 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78091c-24ed-463c-81c7-66027c053ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:02.323137 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78091c-24ed-463c-81c7-66027c053ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:02.341995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbed193-3d05-4fb4-a1e7-329b870dcfb6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:02.368124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5f78091c-24ed-463c-81c7-66027c053ff2 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:02.369338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5f78091c-24ed-463c-81c7-66027c053ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:02.388120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c01b7-262f-4836-8808-4cadf510eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:02.388760 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c01b7-262f-4836-8808-4cadf510eab9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:02.389037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c01b7-262f-4836-8808-4cadf510eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:02.389313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c01b7-262f-4836-8808-4cadf510eab9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:02.409826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c01b7-262f-4836-8808-4cadf510eab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-041c01b7-262f-4836-8808-4cadf510eab9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:02.414597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:02.415488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:02.416214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:02.416214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:02.416214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:02.416214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:02.416214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:02.416214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:02.416214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:02.416214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:02.416214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:02.416214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:02.416214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:02.416214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:02.416851 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 13/27] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:19:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:02.422137 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c01b7-262f-4836-8808-4cadf510eab9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:02.448508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:02.483166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 15/28] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:02.488099 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78091c-24ed-463c-81c7-66027c053ff2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:02.574821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c01b7-262f-4836-8808-4cadf510eab9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:02.621839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5b1bd-5f89-4214-bcd9-14ebc6a7fb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:02.623288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5b1bd-5f89-4214-bcd9-14ebc6a7fb5d None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:02.623992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5b1bd-5f89-4214-bcd9-14ebc6a7fb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:02.624403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5b1bd-5f89-4214-bcd9-14ebc6a7fb5d None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:02.625621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5b1bd-5f89-4214-bcd9-14ebc6a7fb5d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:02.627541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5b1bd-5f89-4214-bcd9-14ebc6a7fb5d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:02.628307 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78091c-24ed-463c-81c7-66027c053ff2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:02.632360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:02.669884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc0c5f-fad2-450f-9edd-d47e8c860690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:02.670576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc0c5f-fad2-450f-9edd-d47e8c860690 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:02.670854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc0c5f-fad2-450f-9edd-d47e8c860690 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:02.671160 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc0c5f-fad2-450f-9edd-d47e8c860690 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:02.671919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc0c5f-fad2-450f-9edd-d47e8c860690 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:02.672227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc0c5f-fad2-450f-9edd-d47e8c860690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:02.673886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc0c5f-fad2-450f-9edd-d47e8c860690 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:02.687244 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 16/29] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:02.692606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca16e30-9e75-451f-9746-2d74f17a58eb None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:02.692897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca16e30-9e75-451f-9746-2d74f17a58eb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:02.693172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca16e30-9e75-451f-9746-2d74f17a58eb None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:02.694541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 17/30] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:02.700053 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca16e30-9e75-451f-9746-2d74f17a58eb None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:02.770856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 14/31] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Aug 7 22:19:02 2022] POST /identity/v3/roles => generated 219 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:19:02.772844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af251ba-3652-4d72-a0e9-18b8e7bd2b03 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:02.773338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af251ba-3652-4d72-a0e9-18b8e7bd2b03 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:02.773815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af251ba-3652-4d72-a0e9-18b8e7bd2b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:02.795659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2af251ba-3652-4d72-a0e9-18b8e7bd2b03 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:02.797613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2af251ba-3652-4d72-a0e9-18b8e7bd2b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:02.857153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:02.891791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 15/32] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:02.893634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af251ba-3652-4d72-a0e9-18b8e7bd2b03 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:03.000670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca16e30-9e75-451f-9746-2d74f17a58eb None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:03.021783 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af251ba-3652-4d72-a0e9-18b8e7bd2b03 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:03.040183 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0ee6c-3ae8-477d-aa81-981732800fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:03.040825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0ee6c-3ae8-477d-aa81-981732800fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.041104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0ee6c-3ae8-477d-aa81-981732800fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.041372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0ee6c-3ae8-477d-aa81-981732800fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:03.054267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0ee6c-3ae8-477d-aa81-981732800fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:03.055762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0ee6c-3ae8-477d-aa81-981732800fb6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:03.056264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:03.070327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f14eaf-e4bd-4ece-92ec-f8f934ced418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:03.071361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f14eaf-e4bd-4ece-92ec-f8f934ced418 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.071894 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f14eaf-e4bd-4ece-92ec-f8f934ced418 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-c1d0ee6c-3ae8-477d-aa81-981732800fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:19:03.072086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:03.072934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:19:03.073701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:19:03.073701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:19:03.073701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:03.073701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 18/33] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:03.074291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0ee6c-3ae8-477d-aa81-981732800fb6 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:03.074918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f14eaf-e4bd-4ece-92ec-f8f934ced418 None admin] PATH_INFO: `/v3/users/10ac18306f3645059eda74e33533cd06` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:03.076466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f14eaf-e4bd-4ece-92ec-f8f934ced418 None admin] RBAC: Authorizing `identity:get_user(user_id=10ac18306f3645059eda74e33533cd06)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:03.079534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f14eaf-e4bd-4ece-92ec-f8f934ced418 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:03.082496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 16/34] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:02 2022] GET /identity/v3/users/10ac18306f3645059eda74e33533cd06 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:03.084162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1369-19e5-4373-ae34-c3430235ac07 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.084444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1369-19e5-4373-ae34-c3430235ac07 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.084719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1369-19e5-4373-ae34-c3430235ac07 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:03.086086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 17/35] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:03.087475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf1369-19e5-4373-ae34-c3430235ac07 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:03.189911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:03.201200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0ee6c-3ae8-477d-aa81-981732800fb6 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:03.211503 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf1369-19e5-4373-ae34-c3430235ac07 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:03.237249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a610f-b464-4a3f-8892-53f8fa66cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:03.237614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a610f-b464-4a3f-8892-53f8fa66cd00 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.237891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a610f-b464-4a3f-8892-53f8fa66cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.238157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a610f-b464-4a3f-8892-53f8fa66cd00 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:03.238817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a610f-b464-4a3f-8892-53f8fa66cd00 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:03.240258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a610f-b464-4a3f-8892-53f8fa66cd00 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:03.249415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7b467-89eb-42e1-a0bf-29c299fa7b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:03.249992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7b467-89eb-42e1-a0bf-29c299fa7b34 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.250277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7b467-89eb-42e1-a0bf-29c299fa7b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.250781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7b467-89eb-42e1-a0bf-29c299fa7b34 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:03.251511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7b467-89eb-42e1-a0bf-29c299fa7b34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:03.251864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7b467-89eb-42e1-a0bf-29c299fa7b34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:03.255002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7b467-89eb-42e1-a0bf-29c299fa7b34 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:03.274180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 18/36] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:03.275019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7b467-89eb-42e1-a0bf-29c299fa7b34 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:03.339146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:03.370030 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 19/37] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Aug 7 22:19:03 2022] POST /identity/v3/roles => generated 225 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:19:03.371934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ff05-875a-42b3-8431-affe546e00c5 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.372228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ff05-875a-42b3-8431-affe546e00c5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.372509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ff05-875a-42b3-8431-affe546e00c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:03.396750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7b467-89eb-42e1-a0bf-29c299fa7b34 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:03.397270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b777ff05-875a-42b3-8431-affe546e00c5 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:03.398966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b777ff05-875a-42b3-8431-affe546e00c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:03.449560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4a6cc-b795-4e6d-b37e-12a081376463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:03.450150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4a6cc-b795-4e6d-b37e-12a081376463 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.450430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4a6cc-b795-4e6d-b37e-12a081376463 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.450701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4a6cc-b795-4e6d-b37e-12a081376463 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:03.452079 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4a6cc-b795-4e6d-b37e-12a081376463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:03.453584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4a6cc-b795-4e6d-b37e-12a081376463 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:03.460231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 19/38] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:03.461178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4a6cc-b795-4e6d-b37e-12a081376463 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:03.486717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 20/39] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:03.488323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777ff05-875a-42b3-8431-affe546e00c5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:03.584027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4a6cc-b795-4e6d-b37e-12a081376463 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:03.595235 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:03.606445 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:03.616666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777ff05-875a-42b3-8431-affe546e00c5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:03.621556 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aefee-5ca9-49ad-bfa2-4ea2cb99866b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:03.622161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aefee-5ca9-49ad-bfa2-4ea2cb99866b None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.622441 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aefee-5ca9-49ad-bfa2-4ea2cb99866b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.622714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aefee-5ca9-49ad-bfa2-4ea2cb99866b None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:03.623388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80aefee-5ca9-49ad-bfa2-4ea2cb99866b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:03.625087 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80aefee-5ca9-49ad-bfa2-4ea2cb99866b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:03.651128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0a78b-c0a3-495e-9d62-d011b261417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:03.651788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0a78b-c0a3-495e-9d62-d011b261417e None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.652070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0a78b-c0a3-495e-9d62-d011b261417e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.652346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0a78b-c0a3-495e-9d62-d011b261417e None admin] PATH_INFO: `/v3/domains/default/users/10ac18306f3645059eda74e33533cd06/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:03.658025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 20/40] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:19:03 2022] POST /identity/v3/projects => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:19:03.658025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aefee-5ca9-49ad-bfa2-4ea2cb99866b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:03.659268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0a78b-c0a3-495e-9d62-d011b261417e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=10ac18306f3645059eda74e33533cd06, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:03.660920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0a78b-c0a3-495e-9d62-d011b261417e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:03.678881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 21/41] 10.222.0.15 () {58 vars in 1361 bytes} [Sun Aug 7 22:19:03 2022] PUT /identity/v3/domains/default/users/10ac18306f3645059eda74e33533cd06/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:03.679995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715a743-1b3e-435e-8a9d-2954e276a5f3 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.680283 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715a743-1b3e-435e-8a9d-2954e276a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.680553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715a743-1b3e-435e-8a9d-2954e276a5f3 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:03.682073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 22/42] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:03.688525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733476-84e9-4c17-aed3-35be912668b7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.688955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733476-84e9-4c17-aed3-35be912668b7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.689199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733476-84e9-4c17-aed3-35be912668b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:03.710240 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-65733476-84e9-4c17-aed3-35be912668b7 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:03.711482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-65733476-84e9-4c17-aed3-35be912668b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:03.803115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 23/43] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:03.829012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733476-84e9-4c17-aed3-35be912668b7 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:03.829193 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aefee-5ca9-49ad-bfa2-4ea2cb99866b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:03.872727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42a10d-2860-4828-abd8-12c6029f52c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:03.873316 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42a10d-2860-4828-abd8-12c6029f52c1 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.873847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42a10d-2860-4828-abd8-12c6029f52c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.874121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42a10d-2860-4828-abd8-12c6029f52c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:03.874784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42a10d-2860-4828-abd8-12c6029f52c1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:03.876332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42a10d-2860-4828-abd8-12c6029f52c1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:03.894405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 21/44] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Aug 7 22:19:03 2022] POST /identity/v3/roles => generated 223 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:19:03.918848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:03.955308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733476-84e9-4c17-aed3-35be912668b7 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:03.997502 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37375529-5e51-407c-98a2-8e0d491d36c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:03.998256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37375529-5e51-407c-98a2-8e0d491d36c1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:03.998852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37375529-5e51-407c-98a2-8e0d491d36c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:03.999220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37375529-5e51-407c-98a2-8e0d491d36c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:04.000460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37375529-5e51-407c-98a2-8e0d491d36c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:04.001995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37375529-5e51-407c-98a2-8e0d491d36c1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:04.004433 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 24/45] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:04.010495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42a10d-2860-4828-abd8-12c6029f52c1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:04.047514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:04.124072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42a10d-2860-4828-abd8-12c6029f52c1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:04.158107 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c1690-f627-4544-9b40-77795eacce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:04.158738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c1690-f627-4544-9b40-77795eacce72 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:04.159017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c1690-f627-4544-9b40-77795eacce72 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:04.159325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c1690-f627-4544-9b40-77795eacce72 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:04.159963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c1690-f627-4544-9b40-77795eacce72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:04.161408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c1690-f627-4544-9b40-77795eacce72 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:04.187779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 22/46] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:19:04 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:19:05.702343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf04b49-8bce-40b7-8113-21ad898d3fd1 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:05.702887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf04b49-8bce-40b7-8113-21ad898d3fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:05.702887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf04b49-8bce-40b7-8113-21ad898d3fd1 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:05.704246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 25/47] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:05.709983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebff7ef-6db3-4acd-8bc7-8a486f7a2933 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:05.710390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebff7ef-6db3-4acd-8bc7-8a486f7a2933 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:05.710598 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebff7ef-6db3-4acd-8bc7-8a486f7a2933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:05.728761 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2ebff7ef-6db3-4acd-8bc7-8a486f7a2933 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:05.729948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2ebff7ef-6db3-4acd-8bc7-8a486f7a2933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:05.795971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 23/48] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:05.818168 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf04b49-8bce-40b7-8113-21ad898d3fd1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:05.917930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf04b49-8bce-40b7-8113-21ad898d3fd1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:05.950997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7671a-2a1c-4ade-8efb-47e86e7a4ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:05.951647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7671a-2a1c-4ade-8efb-47e86e7a4ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:05.951922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7671a-2a1c-4ade-8efb-47e86e7a4ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:05.952197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7671a-2a1c-4ade-8efb-47e86e7a4ba0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:05.959751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:05.963752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7671a-2a1c-4ade-8efb-47e86e7a4ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-06f7671a-2a1c-4ade-8efb-47e86e7a4ba0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:05.970906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:05.971919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:05.972839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 26/49] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:19:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:05.978579 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebff7ef-6db3-4acd-8bc7-8a486f7a2933 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:05.995705 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:06.079160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebff7ef-6db3-4acd-8bc7-8a486f7a2933 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:06.112740 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f45ab6-ffcc-4574-9426-dfc6ea40c028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:06.113337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f45ab6-ffcc-4574-9426-dfc6ea40c028 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:06.113607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f45ab6-ffcc-4574-9426-dfc6ea40c028 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:06.113868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f45ab6-ffcc-4574-9426-dfc6ea40c028 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:06.114522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f45ab6-ffcc-4574-9426-dfc6ea40c028 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:06.114821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f45ab6-ffcc-4574-9426-dfc6ea40c028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:06.116226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f45ab6-ffcc-4574-9426-dfc6ea40c028 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:06.124318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 24/50] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:06.129829 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7671a-2a1c-4ade-8efb-47e86e7a4ba0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:06.176233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c1406-7511-4908-8db1-873efaef239e None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:06.176522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c1406-7511-4908-8db1-873efaef239e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:06.176803 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c1406-7511-4908-8db1-873efaef239e None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:06.178128 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 25/51] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:19:06.182999 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf42af4-f410-4a8e-9d49-a3be813ddf2b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:06.183370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf42af4-f410-4a8e-9d49-a3be813ddf2b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:06.183733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf42af4-f410-4a8e-9d49-a3be813ddf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:06.201349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-daf42af4-f410-4a8e-9d49-a3be813ddf2b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:06.202539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-daf42af4-f410-4a8e-9d49-a3be813ddf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:06.231427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7671a-2a1c-4ade-8efb-47e86e7a4ba0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:06.264391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899e9c9-1190-4b4e-aa4f-02180da745b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:06.265214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899e9c9-1190-4b4e-aa4f-02180da745b2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:06.265500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899e9c9-1190-4b4e-aa4f-02180da745b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:06.265797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899e9c9-1190-4b4e-aa4f-02180da745b2 None admin] PATH_INFO: `/v3/users/10ac18306f3645059eda74e33533cd06` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:06.266908 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899e9c9-1190-4b4e-aa4f-02180da745b2 None admin] RBAC: Authorizing `identity:get_user(user_id=10ac18306f3645059eda74e33533cd06)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:06.267328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 26/52] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:06.268489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899e9c9-1190-4b4e-aa4f-02180da745b2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:06.274409 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 27/53] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:06 2022] GET /identity/v3/users/10ac18306f3645059eda74e33533cd06 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:06.275648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf42af4-f410-4a8e-9d49-a3be813ddf2b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:06.283583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:06.290404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899e9c9-1190-4b4e-aa4f-02180da745b2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:06.353584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:06.375101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf42af4-f410-4a8e-9d49-a3be813ddf2b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:06.387025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899e9c9-1190-4b4e-aa4f-02180da745b2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:06.409634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788552-a5bb-410b-9f43-e5f901487523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:06.410251 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788552-a5bb-410b-9f43-e5f901487523 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:06.410527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788552-a5bb-410b-9f43-e5f901487523 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:06.410799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788552-a5bb-410b-9f43-e5f901487523 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:06.411958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17788552-a5bb-410b-9f43-e5f901487523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:06.413390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17788552-a5bb-410b-9f43-e5f901487523 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:06.414937 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 27/54] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:06.420695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788552-a5bb-410b-9f43-e5f901487523 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:06.420942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a566563-448e-4434-92cb-a2b8b77dedba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:06.421563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566563-448e-4434-92cb-a2b8b77dedba None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:06.421840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566563-448e-4434-92cb-a2b8b77dedba None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:06.422112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566563-448e-4434-92cb-a2b8b77dedba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:06.423227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a566563-448e-4434-92cb-a2b8b77dedba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:06.424678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a566563-448e-4434-92cb-a2b8b77dedba None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:06.426215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:06.431588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a566563-448e-4434-92cb-a2b8b77dedba None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:06.494063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:06.519538 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788552-a5bb-410b-9f43-e5f901487523 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:06.528396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a566563-448e-4434-92cb-a2b8b77dedba None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:06.552252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c120d5-9592-44f6-b631-79381d090eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:06.552842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c120d5-9592-44f6-b631-79381d090eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:06.553115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c120d5-9592-44f6-b631-79381d090eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:06.553386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c120d5-9592-44f6-b631-79381d090eb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:06.554105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c120d5-9592-44f6-b631-79381d090eb3 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.domain.id=default, user.id=10ac18306f3645059eda74e33533cd06) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:06.554408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c120d5-9592-44f6-b631-79381d090eb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:06.555855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c120d5-9592-44f6-b631-79381d090eb3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:06.560876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48ec2e-7ebd-4829-ba6d-aff3bb351931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:06.561436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 28/56] 10.222.0.15 () {56 vars in 1322 bytes} [Sun Aug 7 22:19:06 2022] GET /identity/v3/role_assignments?user.id=10ac18306f3645059eda74e33533cd06&scope.domain.id=default&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:06.561570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ec2e-7ebd-4829-ba6d-aff3bb351931 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:06.561735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ec2e-7ebd-4829-ba6d-aff3bb351931 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:06.562002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ec2e-7ebd-4829-ba6d-aff3bb351931 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:06.562642 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48ec2e-7ebd-4829-ba6d-aff3bb351931 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:06.564085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48ec2e-7ebd-4829-ba6d-aff3bb351931 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:06.569387 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:06.595541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 29/57] 10.222.0.15 () {60 vars in 1140 bytes} [Sun Aug 7 22:19:06 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:19:08.595957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78138eee-9bff-45a3-bbf1-1dd569a9260e None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:08.596965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78138eee-9bff-45a3-bbf1-1dd569a9260e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:08.597053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78138eee-9bff-45a3-bbf1-1dd569a9260e None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:08.598331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 29/58] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:08.603448 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23208-8777-4c47-8d2a-89b6765828d1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:08.603835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23208-8777-4c47-8d2a-89b6765828d1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:08.603993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23208-8777-4c47-8d2a-89b6765828d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:08.621930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a5a23208-8777-4c47-8d2a-89b6765828d1 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:08.623114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a5a23208-8777-4c47-8d2a-89b6765828d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:08.686190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:08.709681 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78138eee-9bff-45a3-bbf1-1dd569a9260e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:08.807128 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78138eee-9bff-45a3-bbf1-1dd569a9260e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:08.839713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391a03c-4c84-470e-8168-37e207b9ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:08.840319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391a03c-4c84-470e-8168-37e207b9ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:08.840596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391a03c-4c84-470e-8168-37e207b9ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:08.840865 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391a03c-4c84-470e-8168-37e207b9ccc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:08.841959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391a03c-4c84-470e-8168-37e207b9ccc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:08.843403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391a03c-4c84-470e-8168-37e207b9ccc6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:08.844925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 30/60] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:08.851071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a23208-8777-4c47-8d2a-89b6765828d1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:08.946499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a23208-8777-4c47-8d2a-89b6765828d1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:08.962777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:08.981045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98e42b-1c48-4e2a-9212-2555870e2b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:08.981645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98e42b-1c48-4e2a-9212-2555870e2b80 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:08.981921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98e42b-1c48-4e2a-9212-2555870e2b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:08.982187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98e42b-1c48-4e2a-9212-2555870e2b80 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:08.982823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98e42b-1c48-4e2a-9212-2555870e2b80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:08.984353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98e42b-1c48-4e2a-9212-2555870e2b80 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:09.011265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 31/61] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:19:08 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:19:12.110045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db198870-ebe9-4280-b074-6e5ba09f5013 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.111037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db198870-ebe9-4280-b074-6e5ba09f5013 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.111547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db198870-ebe9-4280-b074-6e5ba09f5013 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.113657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 31/62] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:12.119077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c47d4e-ca03-446e-8504-4f77b8d3b769 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.119905 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c47d4e-ca03-446e-8504-4f77b8d3b769 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.120373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c47d4e-ca03-446e-8504-4f77b8d3b769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.142091 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b018f5-d70e-4cc0-9d3b-16f01a6a06d6 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.142698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b018f5-d70e-4cc0-9d3b-16f01a6a06d6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.143218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b018f5-d70e-4cc0-9d3b-16f01a6a06d6 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.144760 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 32/63] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:19:12.147304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a0c47d4e-ca03-446e-8504-4f77b8d3b769 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:12.149787 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63347f8-2a7c-4319-8d57-529b0aa47d29 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.150287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63347f8-2a7c-4319-8d57-529b0aa47d29 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.150747 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63347f8-2a7c-4319-8d57-529b0aa47d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.155647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a0c47d4e-ca03-446e-8504-4f77b8d3b769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:12.167511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:12.179928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f63347f8-2a7c-4319-8d57-529b0aa47d29 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:12.181119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f63347f8-2a7c-4319-8d57-529b0aa47d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:12.285663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 33/64] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:12.293038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 32/65] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:12.313886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacf5ea-c30d-4a5c-a9d4-2b65cfd43036 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.314165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacf5ea-c30d-4a5c-a9d4-2b65cfd43036 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.314603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacf5ea-c30d-4a5c-a9d4-2b65cfd43036 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.316646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 34/66] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:12.321865 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749dbd8-6d98-4efa-9b70-413bfba0ad43 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.322143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749dbd8-6d98-4efa-9b70-413bfba0ad43 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.322552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749dbd8-6d98-4efa-9b70-413bfba0ad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.323165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacf5ea-c30d-4a5c-a9d4-2b65cfd43036 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:12.350616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0749dbd8-6d98-4efa-9b70-413bfba0ad43 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:12.352273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0749dbd8-6d98-4efa-9b70-413bfba0ad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:12.431125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 33/67] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:12.431125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749dbd8-6d98-4efa-9b70-413bfba0ad43 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:12.461648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:12.475558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacf5ea-c30d-4a5c-a9d4-2b65cfd43036 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:12.514253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641fd43-46a3-4254-9ab9-e9d5348677a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:12.515324 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641fd43-46a3-4254-9ab9-e9d5348677a2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.515888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641fd43-46a3-4254-9ab9-e9d5348677a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.516347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641fd43-46a3-4254-9ab9-e9d5348677a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.519435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:12.528148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641fd43-46a3-4254-9ab9-e9d5348677a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f641fd43-46a3-4254-9ab9-e9d5348677a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:12.533642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:12.534462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:12.535239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:12.535239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:12.535239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:12.535239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:12.535239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:12.535239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:12.535239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:12.535239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:12.535239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:12.535239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:12.535239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:12.535239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:12.537587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 35/68] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:19:12.539136 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641fd43-46a3-4254-9ab9-e9d5348677a2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:12.539241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749dbd8-6d98-4efa-9b70-413bfba0ad43 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:12.575041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708ab5b-f043-4087-b271-f39cfeb971d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:12.575711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708ab5b-f043-4087-b271-f39cfeb971d4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.575993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708ab5b-f043-4087-b271-f39cfeb971d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.576267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708ab5b-f043-4087-b271-f39cfeb971d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.586832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708ab5b-f043-4087-b271-f39cfeb971d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d708ab5b-f043-4087-b271-f39cfeb971d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:12.591579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:12.592388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:12.593153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:19:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:12.593757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708ab5b-f043-4087-b271-f39cfeb971d4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:12.657440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641fd43-46a3-4254-9ab9-e9d5348677a2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:12.694239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca57593-6f3a-4350-a1a8-343d03f99683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:12.694873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57593-6f3a-4350-a1a8-343d03f99683 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.695174 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57593-6f3a-4350-a1a8-343d03f99683 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.695452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57593-6f3a-4350-a1a8-343d03f99683 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.698868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:12.706633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca57593-6f3a-4350-a1a8-343d03f99683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:12.708009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708ab5b-f043-4087-b271-f39cfeb971d4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-dca57593-6f3a-4350-a1a8-343d03f99683 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:12.711368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:12.712218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:12.712966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 36/70] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:19:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:12.713656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca57593-6f3a-4350-a1a8-343d03f99683 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:12.749092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c27a5-b908-4c99-9739-d0187c41fb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:12.749692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c27a5-b908-4c99-9739-d0187c41fb1a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.750581 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c27a5-b908-4c99-9739-d0187c41fb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.750581 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c27a5-b908-4c99-9739-d0187c41fb1a None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.750877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c27a5-b908-4c99-9739-d0187c41fb1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:12.751215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c27a5-b908-4c99-9739-d0187c41fb1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:12.753111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c27a5-b908-4c99-9739-d0187c41fb1a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:12.765940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:12.765940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84ac95-0359-407e-b749-22dd9f44cdcf None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.765940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84ac95-0359-407e-b749-22dd9f44cdcf None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.765940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84ac95-0359-407e-b749-22dd9f44cdcf None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.765940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 36/72] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:12.765940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84ac95-0359-407e-b749-22dd9f44cdcf None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:12.781657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:12.827357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca57593-6f3a-4350-a1a8-343d03f99683 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:12.860497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f63b6-7c7c-41c0-9bc2-a13843ed209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:12.861099 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f63b6-7c7c-41c0-9bc2-a13843ed209d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.861376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f63b6-7c7c-41c0-9bc2-a13843ed209d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.861699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f63b6-7c7c-41c0-9bc2-a13843ed209d None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.862874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f63b6-7c7c-41c0-9bc2-a13843ed209d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:12.863212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f63b6-7c7c-41c0-9bc2-a13843ed209d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:12.864601 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f63b6-7c7c-41c0-9bc2-a13843ed209d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:12.869313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84ac95-0359-407e-b749-22dd9f44cdcf None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:12.877326 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 37/73] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:12.877326 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f63b6-7c7c-41c0-9bc2-a13843ed209d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:12.902371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15927c2-4bf8-48f4-862a-238324bd6a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:12.907122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15927c2-4bf8-48f4-862a-238324bd6a87 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.907122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15927c2-4bf8-48f4-862a-238324bd6a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.907122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15927c2-4bf8-48f4-862a-238324bd6a87 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.907122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15927c2-4bf8-48f4-862a-238324bd6a87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:12.907122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15927c2-4bf8-48f4-862a-238324bd6a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:12.907122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15927c2-4bf8-48f4-862a-238324bd6a87 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:12.915708 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 37/74] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:19:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:12.916873 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f26a4-c58a-49a7-adc8-eefe111b707b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:12.917155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f26a4-c58a-49a7-adc8-eefe111b707b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:12.917429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f26a4-c58a-49a7-adc8-eefe111b707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:12.935535 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-222f26a4-c58a-49a7-adc8-eefe111b707b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:12.936722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-222f26a4-c58a-49a7-adc8-eefe111b707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:12.947126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:12.975927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f63b6-7c7c-41c0-9bc2-a13843ed209d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:12.994198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:13.004492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 38/75] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:13.016930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f9301-d965-440e-9f2b-619caf2b36d8 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:13.016930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f9301-d965-440e-9f2b-619caf2b36d8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:13.016930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f9301-d965-440e-9f2b-619caf2b36d8 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:13.016930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 39/76] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:13.016930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f9301-d965-440e-9f2b-619caf2b36d8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:13.017270 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6ac02-20b5-4067-91e7-a05f4fd23369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:13.017270 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6ac02-20b5-4067-91e7-a05f4fd23369 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:13.017270 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6ac02-20b5-4067-91e7-a05f4fd23369 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:13.017270 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6ac02-20b5-4067-91e7-a05f4fd23369 None admin] PATH_INFO: `/v3/users/304b0ae1b9db410cb161ec2c8982cfba` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:13.025991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6ac02-20b5-4067-91e7-a05f4fd23369 None admin] RBAC: Authorizing `identity:get_user(user_id=304b0ae1b9db410cb161ec2c8982cfba)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:13.027498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6ac02-20b5-4067-91e7-a05f4fd23369 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:13.029301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 38/77] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:12 2022] GET /identity/v3/users/304b0ae1b9db410cb161ec2c8982cfba => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:13.029902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6ac02-20b5-4067-91e7-a05f4fd23369 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:13.120016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f9301-d965-440e-9f2b-619caf2b36d8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:13.128462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6ac02-20b5-4067-91e7-a05f4fd23369 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:13.153006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeee6b-e21a-4b0d-a13b-db48ce2544ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:13.153662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeee6b-e21a-4b0d-a13b-db48ce2544ed None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:13.153942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeee6b-e21a-4b0d-a13b-db48ce2544ed None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:13.154217 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeee6b-e21a-4b0d-a13b-db48ce2544ed None admin] PATH_INFO: `/v3/users/10ac18306f3645059eda74e33533cd06` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:13.155373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbeee6b-e21a-4b0d-a13b-db48ce2544ed None admin] RBAC: Authorizing `identity:get_user(user_id=10ac18306f3645059eda74e33533cd06)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:13.156808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbeee6b-e21a-4b0d-a13b-db48ce2544ed None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:13.158389 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 40/78] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:13 2022] GET /identity/v3/users/10ac18306f3645059eda74e33533cd06 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:13.160080 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b31eb-2c5d-4abc-aac6-ea876c955f3d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:13.160359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b31eb-2c5d-4abc-aac6-ea876c955f3d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:13.160629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b31eb-2c5d-4abc-aac6-ea876c955f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:13.163221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021fe2e-1748-48b9-b4ec-16f19a60d78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:13.164029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021fe2e-1748-48b9-b4ec-16f19a60d78d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:13.164312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021fe2e-1748-48b9-b4ec-16f19a60d78d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:13.164585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021fe2e-1748-48b9-b4ec-16f19a60d78d None admin] PATH_INFO: `/v3/users/304b0ae1b9db410cb161ec2c8982cfba` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:13.165713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021fe2e-1748-48b9-b4ec-16f19a60d78d None admin] RBAC: Authorizing `identity:get_user(user_id=304b0ae1b9db410cb161ec2c8982cfba)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:13.167173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021fe2e-1748-48b9-b4ec-16f19a60d78d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:13.168729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 39/79] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:13 2022] GET /identity/v3/users/304b0ae1b9db410cb161ec2c8982cfba => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:13.169483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021fe2e-1748-48b9-b4ec-16f19a60d78d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:13.179635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-aa8b31eb-2c5d-4abc-aac6-ea876c955f3d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:13.180810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-aa8b31eb-2c5d-4abc-aac6-ea876c955f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:13.191005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:13.216980 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:13.249562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 41/80] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:13.250469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b31eb-2c5d-4abc-aac6-ea876c955f3d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:13.278340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021fe2e-1748-48b9-b4ec-16f19a60d78d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:13.312169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c49897-3215-4d04-86d9-3b61fcf752d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:13.312790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c49897-3215-4d04-86d9-3b61fcf752d9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:13.313064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c49897-3215-4d04-86d9-3b61fcf752d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:13.313330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c49897-3215-4d04-86d9-3b61fcf752d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:13.322972 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c49897-3215-4d04-86d9-3b61fcf752d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e1c49897-3215-4d04-86d9-3b61fcf752d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:13.327608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:13.328497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:13.329267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 40/81] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:13.330114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c49897-3215-4d04-86d9-3b61fcf752d9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:13.357967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b31eb-2c5d-4abc-aac6-ea876c955f3d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:13.392704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfe81e-fcb0-46af-8769-9468ee0d1049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:13.393793 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe81e-fcb0-46af-8769-9468ee0d1049 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:13.394127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe81e-fcb0-46af-8769-9468ee0d1049 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:13.394429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe81e-fcb0-46af-8769-9468ee0d1049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:13.408261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:13.427108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c49897-3215-4d04-86d9-3b61fcf752d9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:13.429810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:13.460199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfe81e-fcb0-46af-8769-9468ee0d1049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:13.461633 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfe81e-fcb0-46af-8769-9468ee0d1049 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:13.461889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dfb1f-b4d6-49be-bcf8-36247d75adc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:13.462492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dfb1f-b4d6-49be-bcf8-36247d75adc1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:13.462768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dfb1f-b4d6-49be-bcf8-36247d75adc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:13.463036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dfb1f-b4d6-49be-bcf8-36247d75adc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:13.529356 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dfb1f-b4d6-49be-bcf8-36247d75adc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:13.530820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dfb1f-b4d6-49be-bcf8-36247d75adc1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:13.557121 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 42/82] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:13.557941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfe81e-fcb0-46af-8769-9468ee0d1049 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:13.602664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:13.628572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 41/83] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:13.632354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dfb1f-b4d6-49be-bcf8-36247d75adc1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:13.635457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:13.655627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfe81e-fcb0-46af-8769-9468ee0d1049 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:13.689279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741f08a-0e97-427b-9a59-1c43951a7c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:13.690280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741f08a-0e97-427b-9a59-1c43951a7c24 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:13.690554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741f08a-0e97-427b-9a59-1c43951a7c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:13.690823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741f08a-0e97-427b-9a59-1c43951a7c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:13.728343 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dfb1f-b4d6-49be-bcf8-36247d75adc1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:13.755975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741f08a-0e97-427b-9a59-1c43951a7c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:13.757416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741f08a-0e97-427b-9a59-1c43951a7c24 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:13.761885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666dffc-4f3d-4aab-9cdb-e9ba50bc3761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:13.762503 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666dffc-4f3d-4aab-9cdb-e9ba50bc3761 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:13.762780 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666dffc-4f3d-4aab-9cdb-e9ba50bc3761 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:13.763051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666dffc-4f3d-4aab-9cdb-e9ba50bc3761 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:13.764194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666dffc-4f3d-4aab-9cdb-e9ba50bc3761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:13.765622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666dffc-4f3d-4aab-9cdb-e9ba50bc3761 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:13.767203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 42/84] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:13.767988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666dffc-4f3d-4aab-9cdb-e9ba50bc3761 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:13.804206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:13.835833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:13.857405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 43/85] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:13.858290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741f08a-0e97-427b-9a59-1c43951a7c24 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:13.868093 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666dffc-4f3d-4aab-9cdb-e9ba50bc3761 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:13.903508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ca9a2-2f25-414f-80ad-833f0e8ad1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:13.904103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ca9a2-2f25-414f-80ad-833f0e8ad1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:13.904377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ca9a2-2f25-414f-80ad-833f0e8ad1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:13.904649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ca9a2-2f25-414f-80ad-833f0e8ad1b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:13.905307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ca9a2-2f25-414f-80ad-833f0e8ad1b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:13.905614 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ca9a2-2f25-414f-80ad-833f0e8ad1b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:13.907041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ca9a2-2f25-414f-80ad-833f0e8ad1b3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:13.915375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 43/86] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:13.916148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ca9a2-2f25-414f-80ad-833f0e8ad1b3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:13.956305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741f08a-0e97-427b-9a59-1c43951a7c24 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:13.997568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b12e-63dc-4ee0-bb26-cf563ee021d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:13.998209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b12e-63dc-4ee0-bb26-cf563ee021d8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:13.998488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b12e-63dc-4ee0-bb26-cf563ee021d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:13.999115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b12e-63dc-4ee0-bb26-cf563ee021d8 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:14.000303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b12e-63dc-4ee0-bb26-cf563ee021d8 None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:14.001774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b12e-63dc-4ee0-bb26-cf563ee021d8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:14.004024 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 44/87] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:13 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:14.004768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b12e-63dc-4ee0-bb26-cf563ee021d8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:14.019269 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:14.024685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ca9a2-2f25-414f-80ad-833f0e8ad1b3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:14.057905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eed6de-73da-400d-b036-249b0bf3e1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:14.058524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eed6de-73da-400d-b036-249b0bf3e1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:14.058805 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eed6de-73da-400d-b036-249b0bf3e1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:14.059078 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eed6de-73da-400d-b036-249b0bf3e1d5 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:14.060242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eed6de-73da-400d-b036-249b0bf3e1d5 None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:14.061674 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eed6de-73da-400d-b036-249b0bf3e1d5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:14.063322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 44/88] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:13 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:14.064086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eed6de-73da-400d-b036-249b0bf3e1d5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:14.067418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:14.104888 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b12e-63dc-4ee0-bb26-cf563ee021d8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:14.138346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f0c95-125d-433a-a113-a314509e6a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:14.138952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f0c95-125d-433a-a113-a314509e6a18 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:14.139238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f0c95-125d-433a-a113-a314509e6a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:14.139510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f0c95-125d-433a-a113-a314509e6a18 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:14.140138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f0c95-125d-433a-a113-a314509e6a18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:14.141552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f0c95-125d-433a-a113-a314509e6a18 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:14.161315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 45/89] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:19:14 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:19:14.161439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eed6de-73da-400d-b036-249b0bf3e1d5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:14.162674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f0c95-125d-433a-a113-a314509e6a18 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:14.201814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a93e1-9468-4323-8449-c351ca6f1f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:14.202458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a93e1-9468-4323-8449-c351ca6f1f3b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:14.202737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a93e1-9468-4323-8449-c351ca6f1f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:14.203029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a93e1-9468-4323-8449-c351ca6f1f3b None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:14.204215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a93e1-9468-4323-8449-c351ca6f1f3b None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:14.205706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a93e1-9468-4323-8449-c351ca6f1f3b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:14.207610 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 45/90] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:14 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:14.213330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a93e1-9468-4323-8449-c351ca6f1f3b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:14.244322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:14.284659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f0c95-125d-433a-a113-a314509e6a18 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:14.295044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:14.326993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc39d7-dbff-45f7-b383-1ba34ac2bf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:14.327694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc39d7-dbff-45f7-b383-1ba34ac2bf19 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:14.327984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc39d7-dbff-45f7-b383-1ba34ac2bf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:14.328195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc39d7-dbff-45f7-b383-1ba34ac2bf19 None admin] PATH_INFO: `/v3/users/304b0ae1b9db410cb161ec2c8982cfba` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:14.330917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc39d7-dbff-45f7-b383-1ba34ac2bf19 None admin] RBAC: Authorizing `identity:get_user(user_id=304b0ae1b9db410cb161ec2c8982cfba)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:14.332369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc39d7-dbff-45f7-b383-1ba34ac2bf19 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:14.333997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 46/91] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:14 2022] GET /identity/v3/users/304b0ae1b9db410cb161ec2c8982cfba => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:14.334125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a93e1-9468-4323-8449-c351ca6f1f3b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:14.334774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc39d7-dbff-45f7-b383-1ba34ac2bf19 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:14.374145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9d27d-5ed5-4ba3-a3bd-a55f9ebae846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:14.375309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9d27d-5ed5-4ba3-a3bd-a55f9ebae846 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:14.375309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9d27d-5ed5-4ba3-a3bd-a55f9ebae846 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:14.375500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9d27d-5ed5-4ba3-a3bd-a55f9ebae846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:14.377673 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9d27d-5ed5-4ba3-a3bd-a55f9ebae846 None admin] RBAC: Adding query filter params (role.id=8823542b01ef4a6ca68c563ef700d59d, scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2, user.id=304b0ae1b9db410cb161ec2c8982cfba) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:14.377673 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9d27d-5ed5-4ba3-a3bd-a55f9ebae846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:14.377831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9d27d-5ed5-4ba3-a3bd-a55f9ebae846 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:14.384752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 46/92] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:14 2022] GET /identity/v3/role_assignments?user.id=304b0ae1b9db410cb161ec2c8982cfba&scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2&role.id=8823542b01ef4a6ca68c563ef700d59d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:14.385337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9d27d-5ed5-4ba3-a3bd-a55f9ebae846 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:14.461651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc39d7-dbff-45f7-b383-1ba34ac2bf19 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:14.512171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98615c7f-d0ec-46e4-ab35-80319771ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:14.513034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98615c7f-d0ec-46e4-ab35-80319771ab9b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:14.513318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98615c7f-d0ec-46e4-ab35-80319771ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:14.514028 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98615c7f-d0ec-46e4-ab35-80319771ab9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:14.515051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98615c7f-d0ec-46e4-ab35-80319771ab9b None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2, user.id=10ac18306f3645059eda74e33533cd06) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:14.515408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98615c7f-d0ec-46e4-ab35-80319771ab9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:14.517605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98615c7f-d0ec-46e4-ab35-80319771ab9b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:14.520225 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9d27d-5ed5-4ba3-a3bd-a55f9ebae846 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:14.524369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:14.531881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 47/93] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:14 2022] GET /identity/v3/role_assignments?user.id=10ac18306f3645059eda74e33533cd06&scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:14.532764 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98615c7f-d0ec-46e4-ab35-80319771ab9b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:14.591027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c6bd9-09e7-4c80-aa69-5d7b1cca251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:14.591675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c6bd9-09e7-4c80-aa69-5d7b1cca251d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:14.591956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c6bd9-09e7-4c80-aa69-5d7b1cca251d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:14.592228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c6bd9-09e7-4c80-aa69-5d7b1cca251d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:14.592968 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c6bd9-09e7-4c80-aa69-5d7b1cca251d None admin] RBAC: Adding query filter params (role.id=74caf7e4c7474d40b5657d5e42da5546, scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2, user.id=304b0ae1b9db410cb161ec2c8982cfba) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:14.593274 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c6bd9-09e7-4c80-aa69-5d7b1cca251d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:14.594751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c6bd9-09e7-4c80-aa69-5d7b1cca251d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:14.599939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:14.601898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 47/94] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:14 2022] GET /identity/v3/role_assignments?user.id=304b0ae1b9db410cb161ec2c8982cfba&scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2&role.id=74caf7e4c7474d40b5657d5e42da5546 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:14.686834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98615c7f-d0ec-46e4-ab35-80319771ab9b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:14.746063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e68919-a5c5-4fdb-9a08-ae8bd6e72ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:14.746596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e68919-a5c5-4fdb-9a08-ae8bd6e72ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:14.746883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e68919-a5c5-4fdb-9a08-ae8bd6e72ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:14.747170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e68919-a5c5-4fdb-9a08-ae8bd6e72ee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:14.825744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e68919-a5c5-4fdb-9a08-ae8bd6e72ee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:14.832887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:14.833999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e68919-a5c5-4fdb-9a08-ae8bd6e72ee2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:14.961006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 48/95] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:14.962405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c6bd9-09e7-4c80-aa69-5d7b1cca251d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:15.094496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c6bd9-09e7-4c80-aa69-5d7b1cca251d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:15.132547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b38bd-67e1-4fbb-9308-7dd7e9d51712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:15.133174 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b38bd-67e1-4fbb-9308-7dd7e9d51712 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:15.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b38bd-67e1-4fbb-9308-7dd7e9d51712 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:15.133722 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b38bd-67e1-4fbb-9308-7dd7e9d51712 None admin] PATH_INFO: `/v3/projects/0f395bcedb6043ddb12b6bbf4862189e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:15.134843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b38bd-67e1-4fbb-9308-7dd7e9d51712 None admin] RBAC: Authorizing `identity:get_project(project_id=0f395bcedb6043ddb12b6bbf4862189e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:15.136338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b38bd-67e1-4fbb-9308-7dd7e9d51712 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:15.138066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 48/96] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:14 2022] GET /identity/v3/projects/0f395bcedb6043ddb12b6bbf4862189e => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:15.143939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e68919-a5c5-4fdb-9a08-ae8bd6e72ee2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:15.276065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:15.280300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e68919-a5c5-4fdb-9a08-ae8bd6e72ee2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:15.329697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec7482-b3fc-42de-bd8c-c16f45bcd896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:15.330307 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec7482-b3fc-42de-bd8c-c16f45bcd896 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:15.331142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec7482-b3fc-42de-bd8c-c16f45bcd896 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:15.331418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec7482-b3fc-42de-bd8c-c16f45bcd896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:15.332149 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec7482-b3fc-42de-bd8c-c16f45bcd896 None admin] RBAC: Adding query filter params (role.id=8823542b01ef4a6ca68c563ef700d59d, scope.project.id=0f395bcedb6043ddb12b6bbf4862189e, user.id=304b0ae1b9db410cb161ec2c8982cfba) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:15.332453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec7482-b3fc-42de-bd8c-c16f45bcd896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:15.333945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec7482-b3fc-42de-bd8c-c16f45bcd896 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:15.343071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 49/97] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:15 2022] GET /identity/v3/role_assignments?user.id=304b0ae1b9db410cb161ec2c8982cfba&scope.project.id=0f395bcedb6043ddb12b6bbf4862189e&role.id=8823542b01ef4a6ca68c563ef700d59d => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:16.943548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3149-07c7-496d-84df-89a1da811fca None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:16.944064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3149-07c7-496d-84df-89a1da811fca None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:16.944167 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3149-07c7-496d-84df-89a1da811fca None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:16.945438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 49/98] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:16.950920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9873be-067d-4d74-86ec-97a226f4c3bc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:16.951358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9873be-067d-4d74-86ec-97a226f4c3bc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:16.951540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9873be-067d-4d74-86ec-97a226f4c3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:16.979155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2f9873be-067d-4d74-86ec-97a226f4c3bc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:16.980359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2f9873be-067d-4d74-86ec-97a226f4c3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:17.072711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 50/99] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:17.115395 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3149-07c7-496d-84df-89a1da811fca None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:17.195462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:17.213114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5dec9-5254-41bd-a352-95679f06b851 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:17.213390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5dec9-5254-41bd-a352-95679f06b851 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:17.213666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5dec9-5254-41bd-a352-95679f06b851 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:17.215097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 51/100] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:19:17.220182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6360bb8-29d5-4096-9f95-9cdcbddddf85 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:17.220466 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6360bb8-29d5-4096-9f95-9cdcbddddf85 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:17.220739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6360bb8-29d5-4096-9f95-9cdcbddddf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:17.257733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a6360bb8-29d5-4096-9f95-9cdcbddddf85 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:17.258925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a6360bb8-29d5-4096-9f95-9cdcbddddf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:17.278496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3149-07c7-496d-84df-89a1da811fca None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:17.333335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8625999-2b84-42bb-b645-a46aadc620e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:17.339352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8625999-2b84-42bb-b645-a46aadc620e5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:17.339677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8625999-2b84-42bb-b645-a46aadc620e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:17.339966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8625999-2b84-42bb-b645-a46aadc620e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:17.341211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8625999-2b84-42bb-b645-a46aadc620e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:17.342884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8625999-2b84-42bb-b645-a46aadc620e5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:17.344841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 50/101] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:17.350982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8625999-2b84-42bb-b645-a46aadc620e5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:17.371424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 52/102] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:17.410019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6360bb8-29d5-4096-9f95-9cdcbddddf85 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:17.453820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:17.467659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8625999-2b84-42bb-b645-a46aadc620e5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:17.514310 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e2500-f289-4272-9cd0-e6059b5ee5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:17.514925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e2500-f289-4272-9cd0-e6059b5ee5ed None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:17.515248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e2500-f289-4272-9cd0-e6059b5ee5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:17.515524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e2500-f289-4272-9cd0-e6059b5ee5ed None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:17.516175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e2500-f289-4272-9cd0-e6059b5ee5ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:17.517751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e2500-f289-4272-9cd0-e6059b5ee5ed None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:17.528506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:17.569184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 51/103] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:19:17 2022] POST /identity/v3/projects => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:19:17.581770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6360bb8-29d5-4096-9f95-9cdcbddddf85 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:17.639968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa604d1-da0e-4235-929f-0e66f196650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:17.640644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa604d1-da0e-4235-929f-0e66f196650a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:17.640927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa604d1-da0e-4235-929f-0e66f196650a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:17.641202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa604d1-da0e-4235-929f-0e66f196650a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:17.655698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa604d1-da0e-4235-929f-0e66f196650a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:17.656547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6fa1f-ee89-49d3-8cd9-84d0a120800d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:17.656842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6fa1f-ee89-49d3-8cd9-84d0a120800d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:17.657121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6fa1f-ee89-49d3-8cd9-84d0a120800d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:17.658623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 52/104] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-6fa604d1-da0e-4235-929f-0e66f196650a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:17.660489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:17.662804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:17.664739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 53/105] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:19:17.672632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa604d1-da0e-4235-929f-0e66f196650a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:17.673174 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2934f-5035-45ae-bedf-4f42764a8046 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:17.673468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2934f-5035-45ae-bedf-4f42764a8046 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:17.673749 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2934f-5035-45ae-bedf-4f42764a8046 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:17.675649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 53/106] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:19:17.683759 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f667c6-b6e9-4d03-80cd-d22153f5d4ae None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:17.684051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f667c6-b6e9-4d03-80cd-d22153f5d4ae None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:17.684312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f667c6-b6e9-4d03-80cd-d22153f5d4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:17.720339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e4f667c6-b6e9-4d03-80cd-d22153f5d4ae None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:17.721565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e4f667c6-b6e9-4d03-80cd-d22153f5d4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:17.787453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:17.820370 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa604d1-da0e-4235-929f-0e66f196650a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:17.851133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 54/107] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:17.851133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd26cd-8391-4546-8f0a-1b88f4881f3a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:17.851133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd26cd-8391-4546-8f0a-1b88f4881f3a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:17.851133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd26cd-8391-4546-8f0a-1b88f4881f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:17.861277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e4552-3b45-4166-a1df-f6388bc9868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:17.862413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e4552-3b45-4166-a1df-f6388bc9868a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:17.863182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e4552-3b45-4166-a1df-f6388bc9868a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:17.863506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e4552-3b45-4166-a1df-f6388bc9868a None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:17.864197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e4552-3b45-4166-a1df-f6388bc9868a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:17.867314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e4552-3b45-4166-a1df-f6388bc9868a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:17.868438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fddd26cd-8391-4546-8f0a-1b88f4881f3a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:17.868719 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e4552-3b45-4166-a1df-f6388bc9868a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:17.870263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fddd26cd-8391-4546-8f0a-1b88f4881f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:17.879025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 54/108] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:17.880984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47f6cb-a891-405e-b99a-55c2dd2f033b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:17.881278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47f6cb-a891-405e-b99a-55c2dd2f033b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:17.881556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47f6cb-a891-405e-b99a-55c2dd2f033b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:17.882779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 55/109] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:17.883633 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47f6cb-a891-405e-b99a-55c2dd2f033b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:17.957821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 55/110] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:17.958494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd26cd-8391-4546-8f0a-1b88f4881f3a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:18.017624 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:18.042706 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47f6cb-a891-405e-b99a-55c2dd2f033b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:18.084735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd26cd-8391-4546-8f0a-1b88f4881f3a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:18.089684 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b0ebf-c7e5-4b3a-b9ba-85eeedbc5520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:18.090467 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b0ebf-c7e5-4b3a-b9ba-85eeedbc5520 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:18.090847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b0ebf-c7e5-4b3a-b9ba-85eeedbc5520 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:18.091279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b0ebf-c7e5-4b3a-b9ba-85eeedbc5520 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:18.102557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b0ebf-c7e5-4b3a-b9ba-85eeedbc5520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-855b0ebf-c7e5-4b3a-b9ba-85eeedbc5520 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:18.108533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:18.109585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:18.110601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:18.110601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:18.110601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:18.110601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:18.110601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:18.110601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:18.110601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:18.110601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:18.110601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:18.110601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:18.110601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:18.110601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:18.112422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 56/111] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:19:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:18.117127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dd6e8-1da7-42ce-b24a-02787f1d9f59 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:18.117127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dd6e8-1da7-42ce-b24a-02787f1d9f59 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:18.117127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dd6e8-1da7-42ce-b24a-02787f1d9f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:18.129128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:18.134999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7e8dd6e8-1da7-42ce-b24a-02787f1d9f59 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:18.136350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79352bc2-bdc8-4855-9121-a2afaa1021fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:18.136578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7e8dd6e8-1da7-42ce-b24a-02787f1d9f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:18.137300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79352bc2-bdc8-4855-9121-a2afaa1021fa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:18.137718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79352bc2-bdc8-4855-9121-a2afaa1021fa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:18.138147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79352bc2-bdc8-4855-9121-a2afaa1021fa None admin] PATH_INFO: `/v3/users/c783aeba4da7401996314854c8e709d8` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:18.158109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79352bc2-bdc8-4855-9121-a2afaa1021fa None admin] RBAC: Authorizing `identity:get_user(user_id=c783aeba4da7401996314854c8e709d8)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:18.159855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79352bc2-bdc8-4855-9121-a2afaa1021fa None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:18.162227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 56/112] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:17 2022] GET /identity/v3/users/c783aeba4da7401996314854c8e709d8 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:18.163435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79352bc2-bdc8-4855-9121-a2afaa1021fa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:18.216069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 57/113] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:18.217153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dd6e8-1da7-42ce-b24a-02787f1d9f59 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:18.300525 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79352bc2-bdc8-4855-9121-a2afaa1021fa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:18.303976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:18.341557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff780fb-a526-453b-bc13-7af7262647a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:18.342233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff780fb-a526-453b-bc13-7af7262647a5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:18.342526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff780fb-a526-453b-bc13-7af7262647a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:18.342967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff780fb-a526-453b-bc13-7af7262647a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:18.350728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dd6e8-1da7-42ce-b24a-02787f1d9f59 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:18.354522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff780fb-a526-453b-bc13-7af7262647a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-7ff780fb-a526-453b-bc13-7af7262647a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:18.358828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:18.359686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:18.360429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 57/114] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:19:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:18.361059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff780fb-a526-453b-bc13-7af7262647a5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:18.402173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155b3f8-9c9c-43a8-b310-b902ded3bb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:18.403179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155b3f8-9c9c-43a8-b310-b902ded3bb38 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:18.403682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155b3f8-9c9c-43a8-b310-b902ded3bb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:18.404199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155b3f8-9c9c-43a8-b310-b902ded3bb38 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:18.405113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155b3f8-9c9c-43a8-b310-b902ded3bb38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:18.406177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155b3f8-9c9c-43a8-b310-b902ded3bb38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:18.407825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155b3f8-9c9c-43a8-b310-b902ded3bb38 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:18.412288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:18.421104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 58/115] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:19:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:18.426665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155b3f8-9c9c-43a8-b310-b902ded3bb38 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:18.477156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff780fb-a526-453b-bc13-7af7262647a5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:18.516323 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2fd8-8ea7-4af9-aef6-2e142ea857bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:18.516994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2fd8-8ea7-4af9-aef6-2e142ea857bb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:18.517279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2fd8-8ea7-4af9-aef6-2e142ea857bb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:18.517554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2fd8-8ea7-4af9-aef6-2e142ea857bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:18.555147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155b3f8-9c9c-43a8-b310-b902ded3bb38 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:18.556795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:18.589982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66885788-2f58-4659-a827-e93858d41ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:18.590608 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66885788-2f58-4659-a827-e93858d41ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:18.590890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66885788-2f58-4659-a827-e93858d41ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:18.591192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66885788-2f58-4659-a827-e93858d41ee5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:18.594891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b2fd8-8ea7-4af9-aef6-2e142ea857bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:18.596417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b2fd8-8ea7-4af9-aef6-2e142ea857bb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:18.601349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66885788-2f58-4659-a827-e93858d41ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-66885788-2f58-4659-a827-e93858d41ee5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:18.606490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:18.607385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:18.608130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 59/116] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:18.609335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66885788-2f58-4659-a827-e93858d41ee5 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:18.670868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:18.704441 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 58/117] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:18.709331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2fd8-8ea7-4af9-aef6-2e142ea857bb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:18.721044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66885788-2f58-4659-a827-e93858d41ee5 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:18.759951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c15bb6-5735-4b50-824d-bd61b4b43790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:18.761264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c15bb6-5735-4b50-824d-bd61b4b43790 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:18.761738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c15bb6-5735-4b50-824d-bd61b4b43790 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:18.762201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c15bb6-5735-4b50-824d-bd61b4b43790 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:18.763119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c15bb6-5735-4b50-824d-bd61b4b43790 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:18.764127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c15bb6-5735-4b50-824d-bd61b4b43790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:18.765958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c15bb6-5735-4b50-824d-bd61b4b43790 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:18.773632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:18.776623 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 60/118] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:18.777801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab12b46-ffb5-4e54-a19c-4499cfc45159 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:18.778032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab12b46-ffb5-4e54-a19c-4499cfc45159 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:18.778314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab12b46-ffb5-4e54-a19c-4499cfc45159 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:18.782145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 61/119] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:18.782145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab12b46-ffb5-4e54-a19c-4499cfc45159 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:18.819514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2fd8-8ea7-4af9-aef6-2e142ea857bb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:18.854779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4e07d-c496-4ea1-846d-75651e89ac97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:18.855429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4e07d-c496-4ea1-846d-75651e89ac97 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:18.855703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4e07d-c496-4ea1-846d-75651e89ac97 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:18.855970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4e07d-c496-4ea1-846d-75651e89ac97 None admin] PATH_INFO: `/v3/users/304b0ae1b9db410cb161ec2c8982cfba` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:18.857092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4e07d-c496-4ea1-846d-75651e89ac97 None admin] RBAC: Authorizing `identity:get_user(user_id=304b0ae1b9db410cb161ec2c8982cfba)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:18.858513 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4e07d-c496-4ea1-846d-75651e89ac97 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:18.860118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 59/120] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:18 2022] GET /identity/v3/users/304b0ae1b9db410cb161ec2c8982cfba => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:18.860928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4e07d-c496-4ea1-846d-75651e89ac97 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:18.895630 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab12b46-ffb5-4e54-a19c-4499cfc45159 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:18.919052 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:18.936705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a504a3-0083-4333-b68b-ff38c1bfcadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:18.937318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a504a3-0083-4333-b68b-ff38c1bfcadc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:18.937598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a504a3-0083-4333-b68b-ff38c1bfcadc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:18.937869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a504a3-0083-4333-b68b-ff38c1bfcadc None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:18.938659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a504a3-0083-4333-b68b-ff38c1bfcadc None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:18.939099 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a504a3-0083-4333-b68b-ff38c1bfcadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:18.940511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a504a3-0083-4333-b68b-ff38c1bfcadc None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:18.950356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 62/121] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:18.951129 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a504a3-0083-4333-b68b-ff38c1bfcadc None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:18.968578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4e07d-c496-4ea1-846d-75651e89ac97 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:19.005696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:19.012798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd37b4-1d87-45e6-9fdf-7555e527a301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:19.013458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd37b4-1d87-45e6-9fdf-7555e527a301 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.013731 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd37b4-1d87-45e6-9fdf-7555e527a301 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.013996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd37b4-1d87-45e6-9fdf-7555e527a301 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.015614 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd37b4-1d87-45e6-9fdf-7555e527a301 None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:19.017002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd37b4-1d87-45e6-9fdf-7555e527a301 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:19.019033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 60/122] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:18 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:19.025003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614bc86-23d1-4135-b776-d01e1b4172cb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.025287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614bc86-23d1-4135-b776-d01e1b4172cb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.025559 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614bc86-23d1-4135-b776-d01e1b4172cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.043285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e614bc86-23d1-4135-b776-d01e1b4172cb None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:19.044445 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e614bc86-23d1-4135-b776-d01e1b4172cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:19.064219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a504a3-0083-4333-b68b-ff38c1bfcadc None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:19.100506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac69d7-103b-4ec3-bc22-2d3a16161b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:19.101063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac69d7-103b-4ec3-bc22-2d3a16161b80 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.101337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac69d7-103b-4ec3-bc22-2d3a16161b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.101606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac69d7-103b-4ec3-bc22-2d3a16161b80 None admin] PATH_INFO: `/v3/users/10ac18306f3645059eda74e33533cd06` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.102994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac69d7-103b-4ec3-bc22-2d3a16161b80 None admin] RBAC: Authorizing `identity:get_user(user_id=10ac18306f3645059eda74e33533cd06)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:19.104498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac69d7-103b-4ec3-bc22-2d3a16161b80 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:19.106473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 63/123] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:18 2022] GET /identity/v3/users/10ac18306f3645059eda74e33533cd06 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:19.107259 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac69d7-103b-4ec3-bc22-2d3a16161b80 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:19.125499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 61/124] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:19.125499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614bc86-23d1-4135-b776-d01e1b4172cb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:19.171407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:19.223388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac69d7-103b-4ec3-bc22-2d3a16161b80 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:19.229776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614bc86-23d1-4135-b776-d01e1b4172cb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:19.258831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f378ed-793e-4a1e-911b-31d0b88c6a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:19.259476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f378ed-793e-4a1e-911b-31d0b88c6a40 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.259753 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f378ed-793e-4a1e-911b-31d0b88c6a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.260020 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f378ed-793e-4a1e-911b-31d0b88c6a40 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.260962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:19.261171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f378ed-793e-4a1e-911b-31d0b88c6a40 None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:19.262612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f378ed-793e-4a1e-911b-31d0b88c6a40 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:19.264223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 64/125] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:19 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:19.265073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f378ed-793e-4a1e-911b-31d0b88c6a40 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:19.272337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caae2f6-2582-4c16-94f0-74b53eb5bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:19.272983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caae2f6-2582-4c16-94f0-74b53eb5bb50 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.273257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caae2f6-2582-4c16-94f0-74b53eb5bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.273525 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caae2f6-2582-4c16-94f0-74b53eb5bb50 None admin] PATH_INFO: `/v3/users/304b0ae1b9db410cb161ec2c8982cfba` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.274653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caae2f6-2582-4c16-94f0-74b53eb5bb50 None admin] RBAC: Authorizing `identity:get_user(user_id=304b0ae1b9db410cb161ec2c8982cfba)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:19.276116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caae2f6-2582-4c16-94f0-74b53eb5bb50 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:19.277737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 62/126] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:19 2022] GET /identity/v3/users/304b0ae1b9db410cb161ec2c8982cfba => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:19.278497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caae2f6-2582-4c16-94f0-74b53eb5bb50 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:19.372574 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f378ed-793e-4a1e-911b-31d0b88c6a40 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:19.379663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caae2f6-2582-4c16-94f0-74b53eb5bb50 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:19.391702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:19.410654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759561d7-519c-4c29-9284-74b37737ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:19.411299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759561d7-519c-4c29-9284-74b37737ccb2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.411582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759561d7-519c-4c29-9284-74b37737ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.412028 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759561d7-519c-4c29-9284-74b37737ccb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.412580 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759561d7-519c-4c29-9284-74b37737ccb2 None admin] RBAC: Adding query filter params (role.id=14ade4f163274596811571bcb806cb12, scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2, user.id=c783aeba4da7401996314854c8e709d8) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:19.412893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759561d7-519c-4c29-9284-74b37737ccb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:19.414480 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759561d7-519c-4c29-9284-74b37737ccb2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:19.416968 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f365b9-2627-4c49-85bc-efc11e8c40dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:19.417987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f365b9-2627-4c49-85bc-efc11e8c40dc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.418359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f365b9-2627-4c49-85bc-efc11e8c40dc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.418517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f365b9-2627-4c49-85bc-efc11e8c40dc None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.419652 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f365b9-2627-4c49-85bc-efc11e8c40dc None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:19.430041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 65/127] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:19 2022] GET /identity/v3/role_assignments?user.id=c783aeba4da7401996314854c8e709d8&scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2&role.id=14ade4f163274596811571bcb806cb12 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:19.430231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f365b9-2627-4c49-85bc-efc11e8c40dc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:19.430321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759561d7-519c-4c29-9284-74b37737ccb2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:19.430440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 63/128] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:19 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:19.430440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f365b9-2627-4c49-85bc-efc11e8c40dc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:19.503694 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:19.544247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f365b9-2627-4c49-85bc-efc11e8c40dc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:19.579610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759561d7-519c-4c29-9284-74b37737ccb2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:19.589668 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e46755-7395-4bce-aa0e-c821fce44892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:19.589668 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e46755-7395-4bce-aa0e-c821fce44892 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.590190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e46755-7395-4bce-aa0e-c821fce44892 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.590558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e46755-7395-4bce-aa0e-c821fce44892 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2/users/304b0ae1b9db410cb161ec2c8982cfba/roles/74caf7e4c7474d40b5657d5e42da5546` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.592851 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e46755-7395-4bce-aa0e-c821fce44892 None admin] RBAC: Authorizing `identity:create_grant(project_id=70e6e6919b9d48dd86e5410efb71c4d2, user_id=304b0ae1b9db410cb161ec2c8982cfba, role_id=74caf7e4c7474d40b5657d5e42da5546)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:19.594306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e46755-7395-4bce-aa0e-c821fce44892 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:19.613388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 64/129] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:19:19 2022] PUT /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2/users/304b0ae1b9db410cb161ec2c8982cfba/roles/74caf7e4c7474d40b5657d5e42da5546 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:19.614330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e46755-7395-4bce-aa0e-c821fce44892 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:19.640424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2717410-fea8-49bb-9f29-894e57629438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:19.641049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2717410-fea8-49bb-9f29-894e57629438 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.641333 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2717410-fea8-49bb-9f29-894e57629438 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.641599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2717410-fea8-49bb-9f29-894e57629438 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.662704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2717410-fea8-49bb-9f29-894e57629438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-b2717410-fea8-49bb-9f29-894e57629438 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:19.669533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:19.670465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:19.671253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 66/130] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:19.676014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2717410-fea8-49bb-9f29-894e57629438 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:19.732091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:19.803849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2717410-fea8-49bb-9f29-894e57629438 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:19.844178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e46755-7395-4bce-aa0e-c821fce44892 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:19.850836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c9925-fa7a-4fa0-968a-a79a4f707c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:19.851553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c9925-fa7a-4fa0-968a-a79a4f707c1d None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.851835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c9925-fa7a-4fa0-968a-a79a4f707c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.852205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c9925-fa7a-4fa0-968a-a79a4f707c1d None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2/users/10ac18306f3645059eda74e33533cd06/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.854846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c9925-fa7a-4fa0-968a-a79a4f707c1d None admin] RBAC: Authorizing `identity:create_grant(project_id=70e6e6919b9d48dd86e5410efb71c4d2, user_id=10ac18306f3645059eda74e33533cd06, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:19.856801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c9925-fa7a-4fa0-968a-a79a4f707c1d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:19.873340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 67/131] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:19:19 2022] PUT /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2/users/10ac18306f3645059eda74e33533cd06/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:19.874410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c9925-fa7a-4fa0-968a-a79a4f707c1d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:19.881188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:19.893621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264581c1-4d7e-4405-b35c-760a91fbad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:19.894175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264581c1-4d7e-4405-b35c-760a91fbad50 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.894712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264581c1-4d7e-4405-b35c-760a91fbad50 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.894995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264581c1-4d7e-4405-b35c-760a91fbad50 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.897607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264581c1-4d7e-4405-b35c-760a91fbad50 None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:19.899229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264581c1-4d7e-4405-b35c-760a91fbad50 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:19.903697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 65/132] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:19 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:19.903697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a251f7-07d3-4f2c-a567-92c0f4edc928 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.903697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a251f7-07d3-4f2c-a567-92c0f4edc928 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.903697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a251f7-07d3-4f2c-a567-92c0f4edc928 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.904191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 66/133] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:19.910100 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47687133-f9be-4e81-aad8-7ca5c02cc56b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:19.910387 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47687133-f9be-4e81-aad8-7ca5c02cc56b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:19.910658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47687133-f9be-4e81-aad8-7ca5c02cc56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:19.930632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-47687133-f9be-4e81-aad8-7ca5c02cc56b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:19.932057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-47687133-f9be-4e81-aad8-7ca5c02cc56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:20.016202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 67/134] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:20.017946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47687133-f9be-4e81-aad8-7ca5c02cc56b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:20.059366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c9925-fa7a-4fa0-968a-a79a4f707c1d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:20.067067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:20.129817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05637251-5fb1-41d8-a984-dd3a7e182a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:20.131191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05637251-5fb1-41d8-a984-dd3a7e182a7e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:20.131675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05637251-5fb1-41d8-a984-dd3a7e182a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:20.132135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05637251-5fb1-41d8-a984-dd3a7e182a7e None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:20.133019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05637251-5fb1-41d8-a984-dd3a7e182a7e None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:20.134065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05637251-5fb1-41d8-a984-dd3a7e182a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:20.135699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05637251-5fb1-41d8-a984-dd3a7e182a7e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:20.145925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 68/135] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:20.148258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05637251-5fb1-41d8-a984-dd3a7e182a7e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:20.200347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47687133-f9be-4e81-aad8-7ca5c02cc56b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:20.225799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:20.238697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda11466-87fd-49df-9e50-2e1322f1084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:20.239686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda11466-87fd-49df-9e50-2e1322f1084b None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:20.240156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda11466-87fd-49df-9e50-2e1322f1084b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:20.240633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda11466-87fd-49df-9e50-2e1322f1084b None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2/users/304b0ae1b9db410cb161ec2c8982cfba/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:20.242751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda11466-87fd-49df-9e50-2e1322f1084b None admin] RBAC: Authorizing `identity:create_grant(project_id=70e6e6919b9d48dd86e5410efb71c4d2, user_id=304b0ae1b9db410cb161ec2c8982cfba, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:20.244501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda11466-87fd-49df-9e50-2e1322f1084b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:20.261121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 68/136] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:19:20 2022] PUT /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2/users/304b0ae1b9db410cb161ec2c8982cfba/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:20.268766 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda11466-87fd-49df-9e50-2e1322f1084b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:20.281469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05637251-5fb1-41d8-a984-dd3a7e182a7e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:20.325924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26476e00-3fcf-4fd4-a5d1-bea49fce9751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:20.326990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26476e00-3fcf-4fd4-a5d1-bea49fce9751 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:20.327494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26476e00-3fcf-4fd4-a5d1-bea49fce9751 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:20.327830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26476e00-3fcf-4fd4-a5d1-bea49fce9751 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:20.329047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26476e00-3fcf-4fd4-a5d1-bea49fce9751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:20.331275 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26476e00-3fcf-4fd4-a5d1-bea49fce9751 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:20.333558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 69/137] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:20.340039 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26476e00-3fcf-4fd4-a5d1-bea49fce9751 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:20.379471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:20.466768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26476e00-3fcf-4fd4-a5d1-bea49fce9751 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:20.502003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda11466-87fd-49df-9e50-2e1322f1084b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:20.516050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe8500-a32a-4507-b40a-f116c4ad1d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:20.516673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe8500-a32a-4507-b40a-f116c4ad1d46 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:20.517229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe8500-a32a-4507-b40a-f116c4ad1d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:20.517507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe8500-a32a-4507-b40a-f116c4ad1d46 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:20.518779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe8500-a32a-4507-b40a-f116c4ad1d46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:20.521034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe8500-a32a-4507-b40a-f116c4ad1d46 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:20.544045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cb45a-445e-4403-aadb-cc996b045060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:20.545002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb45a-445e-4403-aadb-cc996b045060 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:20.545440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb45a-445e-4403-aadb-cc996b045060 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:20.545716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb45a-445e-4403-aadb-cc996b045060 None admin] PATH_INFO: `/v3/users/304b0ae1b9db410cb161ec2c8982cfba` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:20.546943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cb45a-445e-4403-aadb-cc996b045060 None admin] RBAC: Authorizing `identity:get_user(user_id=304b0ae1b9db410cb161ec2c8982cfba)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:20.548569 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cb45a-445e-4403-aadb-cc996b045060 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:20.549080 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 70/138] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:19:20 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:19:20.550204 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 69/139] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:20 2022] GET /identity/v3/users/304b0ae1b9db410cb161ec2c8982cfba => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:20.556174 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe8500-a32a-4507-b40a-f116c4ad1d46 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:20.685310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:20.701305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe8500-a32a-4507-b40a-f116c4ad1d46 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:20.753305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec0753-368d-466c-bb31-b35158d6e6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:20.753896 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec0753-368d-466c-bb31-b35158d6e6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:20.754177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec0753-368d-466c-bb31-b35158d6e6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:20.754449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec0753-368d-466c-bb31-b35158d6e6a0 None admin] PATH_INFO: `/v3/projects/0f395bcedb6043ddb12b6bbf4862189e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:20.755756 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec0753-368d-466c-bb31-b35158d6e6a0 None admin] RBAC: Authorizing `identity:get_project(project_id=0f395bcedb6043ddb12b6bbf4862189e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:20.757206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec0753-368d-466c-bb31-b35158d6e6a0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:20.758863 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 71/140] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:20 2022] GET /identity/v3/projects/0f395bcedb6043ddb12b6bbf4862189e => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:20.768739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cb45a-445e-4403-aadb-cc996b045060 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:20.853544 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:20.920803 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cb45a-445e-4403-aadb-cc996b045060 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:20.958432 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea48d38-76d8-4c7a-bc36-d93f59261a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:20.959116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48d38-76d8-4c7a-bc36-d93f59261a32 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:20.959398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48d38-76d8-4c7a-bc36-d93f59261a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:20.959670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48d38-76d8-4c7a-bc36-d93f59261a32 None admin] PATH_INFO: `/v3/projects/0f395bcedb6043ddb12b6bbf4862189e/users/304b0ae1b9db410cb161ec2c8982cfba/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:20.961663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea48d38-76d8-4c7a-bc36-d93f59261a32 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f395bcedb6043ddb12b6bbf4862189e, user_id=304b0ae1b9db410cb161ec2c8982cfba, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:20.963230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea48d38-76d8-4c7a-bc36-d93f59261a32 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:20.978440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 70/141] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:19:20 2022] PUT /identity/v3/projects/0f395bcedb6043ddb12b6bbf4862189e/users/304b0ae1b9db410cb161ec2c8982cfba/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:21.815902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74261f-75a3-497a-abeb-3ee9ccac00dc None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:21.816424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74261f-75a3-497a-abeb-3ee9ccac00dc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:21.816424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74261f-75a3-497a-abeb-3ee9ccac00dc None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:21.817982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 72/142] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:21.823716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7ce8-fa24-4e66-979b-ba7eaa6b864a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:21.824158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7ce8-fa24-4e66-979b-ba7eaa6b864a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:21.824342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7ce8-fa24-4e66-979b-ba7eaa6b864a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:21.848194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-23cf7ce8-fa24-4e66-979b-ba7eaa6b864a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:21.849489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-23cf7ce8-fa24-4e66-979b-ba7eaa6b864a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:21.937574 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 71/143] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:21.960645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74261f-75a3-497a-abeb-3ee9ccac00dc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:22.091425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74261f-75a3-497a-abeb-3ee9ccac00dc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:22.128454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543be3-eebe-4aaf-8a5f-c65428dbd901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:22.129375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543be3-eebe-4aaf-8a5f-c65428dbd901 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:22.129824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543be3-eebe-4aaf-8a5f-c65428dbd901 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:22.130230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543be3-eebe-4aaf-8a5f-c65428dbd901 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:22.143694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543be3-eebe-4aaf-8a5f-c65428dbd901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-1f543be3-eebe-4aaf-8a5f-c65428dbd901 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:22.148925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:22.149969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:22.150895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:22.150895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:22.150895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:22.150895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:22.150895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:22.150895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:22.150895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:22.150895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:22.150895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:22.150895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:22.150895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:22.150895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:22.152834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 73/144] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:22.158677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7ce8-fa24-4e66-979b-ba7eaa6b864a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:22.206403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:22.268762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7ce8-fa24-4e66-979b-ba7eaa6b864a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:22.306483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9180ca-ddbb-4171-b596-cbb9dd638a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:22.307388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9180ca-ddbb-4171-b596-cbb9dd638a38 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:22.307800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9180ca-ddbb-4171-b596-cbb9dd638a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:22.308205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9180ca-ddbb-4171-b596-cbb9dd638a38 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:22.309012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9180ca-ddbb-4171-b596-cbb9dd638a38 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:22.309468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9180ca-ddbb-4171-b596-cbb9dd638a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:22.311025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9180ca-ddbb-4171-b596-cbb9dd638a38 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:22.321381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 72/145] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:22.327057 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543be3-eebe-4aaf-8a5f-c65428dbd901 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:22.347201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:22.432533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543be3-eebe-4aaf-8a5f-c65428dbd901 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:22.466789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b197a-d520-4e26-aecc-aa3e16f6f211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:22.467454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b197a-d520-4e26-aecc-aa3e16f6f211 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:22.467727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b197a-d520-4e26-aecc-aa3e16f6f211 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:22.467995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b197a-d520-4e26-aecc-aa3e16f6f211 None admin] PATH_INFO: `/v3/users/c783aeba4da7401996314854c8e709d8` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:22.469117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b197a-d520-4e26-aecc-aa3e16f6f211 None admin] RBAC: Authorizing `identity:get_user(user_id=c783aeba4da7401996314854c8e709d8)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:22.470540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b197a-d520-4e26-aecc-aa3e16f6f211 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:22.472679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 74/146] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:22 2022] GET /identity/v3/users/c783aeba4da7401996314854c8e709d8 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:22.478343 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9180ca-ddbb-4171-b596-cbb9dd638a38 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:22.583380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9180ca-ddbb-4171-b596-cbb9dd638a38 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:22.585898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:22.618853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cd913-6645-44a2-aea2-f7a66fbf8972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:22.619435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cd913-6645-44a2-aea2-f7a66fbf8972 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:22.619890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cd913-6645-44a2-aea2-f7a66fbf8972 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:22.620158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cd913-6645-44a2-aea2-f7a66fbf8972 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:22.621326 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cd913-6645-44a2-aea2-f7a66fbf8972 None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:22.622816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cd913-6645-44a2-aea2-f7a66fbf8972 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:22.624729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 73/147] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:22 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:22.630988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b197a-d520-4e26-aecc-aa3e16f6f211 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:22.720220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:22.736803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b197a-d520-4e26-aecc-aa3e16f6f211 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:22.773085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc362b-34ae-4b47-a1de-6f1c9d0721fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:22.773738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc362b-34ae-4b47-a1de-6f1c9d0721fa None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:22.774011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc362b-34ae-4b47-a1de-6f1c9d0721fa None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:22.774323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc362b-34ae-4b47-a1de-6f1c9d0721fa None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2/users/c783aeba4da7401996314854c8e709d8/roles/14ade4f163274596811571bcb806cb12` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:22.776316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc362b-34ae-4b47-a1de-6f1c9d0721fa None admin] RBAC: Authorizing `identity:create_grant(project_id=70e6e6919b9d48dd86e5410efb71c4d2, user_id=c783aeba4da7401996314854c8e709d8, role_id=14ade4f163274596811571bcb806cb12)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:22.777752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc362b-34ae-4b47-a1de-6f1c9d0721fa None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:22.802416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 75/148] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:19:22 2022] PUT /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2/users/c783aeba4da7401996314854c8e709d8/roles/14ade4f163274596811571bcb806cb12 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:23.314684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da809a-3353-48dc-86b9-66bc1c1f9c2d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:23.315230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da809a-3353-48dc-86b9-66bc1c1f9c2d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:23.315335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da809a-3353-48dc-86b9-66bc1c1f9c2d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:23.316596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 74/149] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:23.329355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79751e-477d-42a4-aa0f-ee4331fb3632 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:23.329807 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79751e-477d-42a4-aa0f-ee4331fb3632 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:23.329878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79751e-477d-42a4-aa0f-ee4331fb3632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:23.353377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0d79751e-477d-42a4-aa0f-ee4331fb3632 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:23.354651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0d79751e-477d-42a4-aa0f-ee4331fb3632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:23.439589 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 76/150] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:23.474334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da809a-3353-48dc-86b9-66bc1c1f9c2d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:23.582937 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da809a-3353-48dc-86b9-66bc1c1f9c2d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:23.620127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fec75-9354-45bf-9585-ee4ba9bbad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:23.620761 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fec75-9354-45bf-9585-ee4ba9bbad32 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:23.621032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fec75-9354-45bf-9585-ee4ba9bbad32 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:23.621294 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fec75-9354-45bf-9585-ee4ba9bbad32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:23.632579 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fec75-9354-45bf-9585-ee4ba9bbad32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f93fec75-9354-45bf-9585-ee4ba9bbad32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:23.637825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:23.638638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:23.639428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 75/151] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:19:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:23.645389 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79751e-477d-42a4-aa0f-ee4331fb3632 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:23.722272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:23.746980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79751e-477d-42a4-aa0f-ee4331fb3632 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:23.783194 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abccb14-fd75-409e-9f13-63064b622d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:23.784402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abccb14-fd75-409e-9f13-63064b622d41 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:23.784680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abccb14-fd75-409e-9f13-63064b622d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:23.784945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abccb14-fd75-409e-9f13-63064b622d41 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:23.785615 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abccb14-fd75-409e-9f13-63064b622d41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:23.785913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abccb14-fd75-409e-9f13-63064b622d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:23.787323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abccb14-fd75-409e-9f13-63064b622d41 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:23.796095 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 77/152] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:19:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:23.801649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fec75-9354-45bf-9585-ee4ba9bbad32 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:23.839533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:23.881349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c26e1a-6e6d-4817-b3f6-e0a3fbe21d65 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:23.881622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c26e1a-6e6d-4817-b3f6-e0a3fbe21d65 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:23.881885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c26e1a-6e6d-4817-b3f6-e0a3fbe21d65 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:23.883347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 78/153] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:23.888563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e5e3-38d6-4b5b-bfd2-3649116207f6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:23.888838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e5e3-38d6-4b5b-bfd2-3649116207f6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:23.889108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e5e3-38d6-4b5b-bfd2-3649116207f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:23.920044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a5d8e5e3-38d6-4b5b-bfd2-3649116207f6 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:23.923315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a5d8e5e3-38d6-4b5b-bfd2-3649116207f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:23.947123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fec75-9354-45bf-9585-ee4ba9bbad32 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:24.013302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 79/154] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:24.014597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551516e-6318-47c6-8b8f-6d0904452303 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:24.014879 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551516e-6318-47c6-8b8f-6d0904452303 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:24.015173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551516e-6318-47c6-8b8f-6d0904452303 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:24.016402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 80/155] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:24.023334 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc26c8-ab5e-4452-8364-c5a4722328b3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:24.023605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc26c8-ab5e-4452-8364-c5a4722328b3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:24.023868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc26c8-ab5e-4452-8364-c5a4722328b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:24.025716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b6ff1-ad35-4b9d-ba4f-7b9c88f64975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:24.026742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b6ff1-ad35-4b9d-ba4f-7b9c88f64975 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:24.027276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b6ff1-ad35-4b9d-ba4f-7b9c88f64975 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:24.027773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b6ff1-ad35-4b9d-ba4f-7b9c88f64975 None admin] PATH_INFO: `/v3/users/304b0ae1b9db410cb161ec2c8982cfba` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:24.031819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b6ff1-ad35-4b9d-ba4f-7b9c88f64975 None admin] RBAC: Authorizing `identity:get_user(user_id=304b0ae1b9db410cb161ec2c8982cfba)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:24.034121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b6ff1-ad35-4b9d-ba4f-7b9c88f64975 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:24.036179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 76/156] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:23 2022] GET /identity/v3/users/304b0ae1b9db410cb161ec2c8982cfba => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:24.048794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-13cc26c8-ab5e-4452-8364-c5a4722328b3 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:24.049787 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b6ff1-ad35-4b9d-ba4f-7b9c88f64975 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:24.050851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-13cc26c8-ab5e-4452-8364-c5a4722328b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:24.119403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:24.127406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 81/157] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:24.128272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc26c8-ab5e-4452-8364-c5a4722328b3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:24.261295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc26c8-ab5e-4452-8364-c5a4722328b3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:24.262541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:24.268881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b6ff1-ad35-4b9d-ba4f-7b9c88f64975 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:24.299494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170f07d-52dd-45bc-96ff-8e05d1f45943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:24.300170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170f07d-52dd-45bc-96ff-8e05d1f45943 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:24.300459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170f07d-52dd-45bc-96ff-8e05d1f45943 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:24.300970 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170f07d-52dd-45bc-96ff-8e05d1f45943 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:24.312343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170f07d-52dd-45bc-96ff-8e05d1f45943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-0170f07d-52dd-45bc-96ff-8e05d1f45943 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:24.317854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:24.318912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:24.319839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 82/158] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:24.320493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170f07d-52dd-45bc-96ff-8e05d1f45943 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:24.342474 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899559e-8e2f-4227-8795-ef352d6c4869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:24.343855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899559e-8e2f-4227-8795-ef352d6c4869 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:24.344399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899559e-8e2f-4227-8795-ef352d6c4869 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:24.344981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899559e-8e2f-4227-8795-ef352d6c4869 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:24.387369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:24.473303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899559e-8e2f-4227-8795-ef352d6c4869 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:24.474780 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899559e-8e2f-4227-8795-ef352d6c4869 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:24.480647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170f07d-52dd-45bc-96ff-8e05d1f45943 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:24.520488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d6757-fe38-4be2-ba7c-ebaa9820fa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:24.521221 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d6757-fe38-4be2-ba7c-ebaa9820fa49 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:24.521496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d6757-fe38-4be2-ba7c-ebaa9820fa49 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:24.521759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d6757-fe38-4be2-ba7c-ebaa9820fa49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:24.534095 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d6757-fe38-4be2-ba7c-ebaa9820fa49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a29d6757-fe38-4be2-ba7c-ebaa9820fa49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:24.538996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:24.539886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:24.540710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 83/159] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:19:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:24.541342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d6757-fe38-4be2-ba7c-ebaa9820fa49 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:24.652264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d6757-fe38-4be2-ba7c-ebaa9820fa49 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:24.690082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ea898-71ef-431f-b330-b2365ea87075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:24.690695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ea898-71ef-431f-b330-b2365ea87075 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:24.690969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ea898-71ef-431f-b330-b2365ea87075 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:24.695463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ea898-71ef-431f-b330-b2365ea87075 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:24.696604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:24.697471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:24.698284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ea898-71ef-431f-b330-b2365ea87075 None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:24.698612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ea898-71ef-431f-b330-b2365ea87075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:24.700378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ea898-71ef-431f-b330-b2365ea87075 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:24.710636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 77/160] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 22:19:24.711540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899559e-8e2f-4227-8795-ef352d6c4869 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:24.717724 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 84/161] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:24.718827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8194b3-7971-4aae-8a30-8b6662889833 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:24.719127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8194b3-7971-4aae-8a30-8b6662889833 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:24.719402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8194b3-7971-4aae-8a30-8b6662889833 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:24.728813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 85/162] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:24.729652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8194b3-7971-4aae-8a30-8b6662889833 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:24.898638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8194b3-7971-4aae-8a30-8b6662889833 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:24.945388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a727b-0cca-4117-a166-aa7932eddc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:24.946379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a727b-0cca-4117-a166-aa7932eddc0d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:24.946853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a727b-0cca-4117-a166-aa7932eddc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:24.947347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a727b-0cca-4117-a166-aa7932eddc0d None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:24.948822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a727b-0cca-4117-a166-aa7932eddc0d None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:24.950577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a727b-0cca-4117-a166-aa7932eddc0d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:24.952730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 86/163] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:24 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:24.953701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a727b-0cca-4117-a166-aa7932eddc0d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:24.963961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899559e-8e2f-4227-8795-ef352d6c4869 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:25.034917 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844f587-56b8-4aa3-9188-786c2a4eb1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:25.035551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844f587-56b8-4aa3-9188-786c2a4eb1eb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:25.035821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844f587-56b8-4aa3-9188-786c2a4eb1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:25.036086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844f587-56b8-4aa3-9188-786c2a4eb1eb None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:25.036760 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844f587-56b8-4aa3-9188-786c2a4eb1eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:25.037054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844f587-56b8-4aa3-9188-786c2a4eb1eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:25.038451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844f587-56b8-4aa3-9188-786c2a4eb1eb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:25.043273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:25.060059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 78/164] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:25.061487 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ce339-c290-4ae3-87d6-b1e906cd3d1d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:25.061765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ce339-c290-4ae3-87d6-b1e906cd3d1d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:25.062033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ce339-c290-4ae3-87d6-b1e906cd3d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:25.099413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-985ce339-c290-4ae3-87d6-b1e906cd3d1d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:25.100609 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-985ce339-c290-4ae3-87d6-b1e906cd3d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:25.149423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a727b-0cca-4117-a166-aa7932eddc0d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:25.207979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac163bb-84ab-4662-94ac-2159d21c71eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:25.208600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac163bb-84ab-4662-94ac-2159d21c71eb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:25.208872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac163bb-84ab-4662-94ac-2159d21c71eb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:25.209135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac163bb-84ab-4662-94ac-2159d21c71eb None admin] PATH_INFO: `/v3/users/304b0ae1b9db410cb161ec2c8982cfba` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:25.215883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac163bb-84ab-4662-94ac-2159d21c71eb None admin] RBAC: Authorizing `identity:get_user(user_id=304b0ae1b9db410cb161ec2c8982cfba)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:25.217342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac163bb-84ab-4662-94ac-2159d21c71eb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:25.219368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 87/165] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:24 2022] GET /identity/v3/users/304b0ae1b9db410cb161ec2c8982cfba => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:25.219932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac163bb-84ab-4662-94ac-2159d21c71eb None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:25.228150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:25.257336 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 79/166] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:25.258200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ce339-c290-4ae3-87d6-b1e906cd3d1d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:25.412598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac163bb-84ab-4662-94ac-2159d21c71eb None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:25.437060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:25.468633 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b78bfa-1537-46f9-bd21-a712c4cc4c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:25.469164 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b78bfa-1537-46f9-bd21-a712c4cc4c75 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:25.469441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b78bfa-1537-46f9-bd21-a712c4cc4c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:25.469707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b78bfa-1537-46f9-bd21-a712c4cc4c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:25.470435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b78bfa-1537-46f9-bd21-a712c4cc4c75 None admin] RBAC: Adding query filter params (role.id=74caf7e4c7474d40b5657d5e42da5546, scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2, user.id=304b0ae1b9db410cb161ec2c8982cfba) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:25.470916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b78bfa-1537-46f9-bd21-a712c4cc4c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:25.472870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b78bfa-1537-46f9-bd21-a712c4cc4c75 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:25.485289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 88/167] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:25 2022] GET /identity/v3/role_assignments?user.id=304b0ae1b9db410cb161ec2c8982cfba&scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2&role.id=74caf7e4c7474d40b5657d5e42da5546 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:25.488332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b78bfa-1537-46f9-bd21-a712c4cc4c75 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:25.491869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ce339-c290-4ae3-87d6-b1e906cd3d1d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:25.592863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be70fb-082d-4369-9510-809775573f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:25.593528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be70fb-082d-4369-9510-809775573f80 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:25.593800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be70fb-082d-4369-9510-809775573f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:25.594068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be70fb-082d-4369-9510-809775573f80 None admin] PATH_INFO: `/v3/users/10ac18306f3645059eda74e33533cd06` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:25.595338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be70fb-082d-4369-9510-809775573f80 None admin] RBAC: Authorizing `identity:get_user(user_id=10ac18306f3645059eda74e33533cd06)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:25.597629 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be70fb-082d-4369-9510-809775573f80 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:25.599691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 80/168] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:25 2022] GET /identity/v3/users/10ac18306f3645059eda74e33533cd06 => generated 247 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:25.600491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be70fb-082d-4369-9510-809775573f80 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:25.715437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b78bfa-1537-46f9-bd21-a712c4cc4c75 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:25.767572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:25.811877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63e4f6-1729-43fc-945b-3ca5c5674487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:25.812510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63e4f6-1729-43fc-945b-3ca5c5674487 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:25.812787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63e4f6-1729-43fc-945b-3ca5c5674487 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:25.813052 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63e4f6-1729-43fc-945b-3ca5c5674487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:25.820862 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be70fb-082d-4369-9510-809775573f80 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:25.859851 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2c626-19fd-4703-b30e-fbab5a778600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:25.860475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2c626-19fd-4703-b30e-fbab5a778600 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:25.860748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2c626-19fd-4703-b30e-fbab5a778600 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:25.861018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2c626-19fd-4703-b30e-fbab5a778600 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:25.873288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2c626-19fd-4703-b30e-fbab5a778600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:25.873573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-75a2c626-19fd-4703-b30e-fbab5a778600 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:25.878672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:25.879634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:25.880492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 81/169] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:25.881130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fb435-0f9d-4c4b-b881-33540f4b3c40 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:25.881253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fb435-0f9d-4c4b-b881-33540f4b3c40 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:25.881520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fb435-0f9d-4c4b-b881-33540f4b3c40 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:25.882888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 82/170] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:25.883463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fb435-0f9d-4c4b-b881-33540f4b3c40 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:25.903721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63e4f6-1729-43fc-945b-3ca5c5674487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:25.905808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63e4f6-1729-43fc-945b-3ca5c5674487 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:26.013753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fb435-0f9d-4c4b-b881-33540f4b3c40 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:26.030180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 89/171] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:26.030180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a0216-7928-420c-9e5e-8aaa8e425aee None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.030180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a0216-7928-420c-9e5e-8aaa8e425aee None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.030180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a0216-7928-420c-9e5e-8aaa8e425aee None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.030180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 90/172] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:26.030180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad631b6d-4612-448f-9ef1-51f6caf08863 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.030180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad631b6d-4612-448f-9ef1-51f6caf08863 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.030685 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad631b6d-4612-448f-9ef1-51f6caf08863 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.031380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 91/173] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:26.032511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f85651-5203-489a-a819-9bae35c8b605 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.034318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f85651-5203-489a-a819-9bae35c8b605 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.034318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f85651-5203-489a-a819-9bae35c8b605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.048262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:26.051633 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-33f85651-5203-489a-a819-9bae35c8b605 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:26.052998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-33f85651-5203-489a-a819-9bae35c8b605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:26.063839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6927c5-bbbe-4037-bb21-96928ec3f9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:26.064647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6927c5-bbbe-4037-bb21-96928ec3f9af None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.065472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6927c5-bbbe-4037-bb21-96928ec3f9af None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.065803 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6927c5-bbbe-4037-bb21-96928ec3f9af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.132366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 92/174] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:26.133317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f85651-5203-489a-a819-9bae35c8b605 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:26.144754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6927c5-bbbe-4037-bb21-96928ec3f9af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:26.144754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6927c5-bbbe-4037-bb21-96928ec3f9af None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:26.148427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:26.240963 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f85651-5203-489a-a819-9bae35c8b605 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:26.249344 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 83/175] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:26.254757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6927c5-bbbe-4037-bb21-96928ec3f9af None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:26.275801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cbcbc-75fe-4247-88b1-c844d29bf4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:26.275991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:26.276648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cbcbc-75fe-4247-88b1-c844d29bf4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.276648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cbcbc-75fe-4247-88b1-c844d29bf4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.276917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cbcbc-75fe-4247-88b1-c844d29bf4b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.277635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cbcbc-75fe-4247-88b1-c844d29bf4b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:26.277875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cbcbc-75fe-4247-88b1-c844d29bf4b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:26.279266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cbcbc-75fe-4247-88b1-c844d29bf4b5 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:26.288077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 93/176] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:26.289225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322e61a-cfa7-4375-93b7-1a9bcfbbd36c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.290166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322e61a-cfa7-4375-93b7-1a9bcfbbd36c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.290166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322e61a-cfa7-4375-93b7-1a9bcfbbd36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.306795 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5322e61a-cfa7-4375-93b7-1a9bcfbbd36c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:26.307993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5322e61a-cfa7-4375-93b7-1a9bcfbbd36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:26.360146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6927c5-bbbe-4037-bb21-96928ec3f9af None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:26.369756 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:26.374641 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 94/177] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:26.377655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb658e2-0810-4ebe-9710-5f02b957af8b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.377655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb658e2-0810-4ebe-9710-5f02b957af8b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.377655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb658e2-0810-4ebe-9710-5f02b957af8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.394514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5eb658e2-0810-4ebe-9710-5f02b957af8b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:26.395703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5eb658e2-0810-4ebe-9710-5f02b957af8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:26.405662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8494dd-46a8-49aa-b7c5-206dc97a21df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:26.406296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8494dd-46a8-49aa-b7c5-206dc97a21df None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.406568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8494dd-46a8-49aa-b7c5-206dc97a21df None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.406833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8494dd-46a8-49aa-b7c5-206dc97a21df None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.408032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8494dd-46a8-49aa-b7c5-206dc97a21df None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:26.409471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8494dd-46a8-49aa-b7c5-206dc97a21df None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:26.411096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 84/178] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:26 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:26.411853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8494dd-46a8-49aa-b7c5-206dc97a21df None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:26.464609 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 95/179] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:26.466528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d6812-48b3-4bd0-94cf-28d3fd74d170 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.466811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d6812-48b3-4bd0-94cf-28d3fd74d170 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.467078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d6812-48b3-4bd0-94cf-28d3fd74d170 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.468485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 96/180] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:26.469061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d6812-48b3-4bd0-94cf-28d3fd74d170 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:26.497912 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:26.510629 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8494dd-46a8-49aa-b7c5-206dc97a21df None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:26.543658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53364c0f-90ba-4ac2-9fa1-6e25c56220ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:26.544303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364c0f-90ba-4ac2-9fa1-6e25c56220ee None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.544582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364c0f-90ba-4ac2-9fa1-6e25c56220ee None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.544845 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364c0f-90ba-4ac2-9fa1-6e25c56220ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.554679 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53364c0f-90ba-4ac2-9fa1-6e25c56220ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-53364c0f-90ba-4ac2-9fa1-6e25c56220ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:26.559368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:26.560331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:26.561103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 85/181] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:26.561742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53364c0f-90ba-4ac2-9fa1-6e25c56220ee None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:26.576023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d6812-48b3-4bd0-94cf-28d3fd74d170 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:26.604139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:26.610141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c8a52-b41f-4688-91a4-40b3712800f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:26.610828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c8a52-b41f-4688-91a4-40b3712800f4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.611270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c8a52-b41f-4688-91a4-40b3712800f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.611639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c8a52-b41f-4688-91a4-40b3712800f4 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.612823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c8a52-b41f-4688-91a4-40b3712800f4 None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:26.614236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c8a52-b41f-4688-91a4-40b3712800f4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:26.615863 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 97/182] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:26 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:26.616608 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c8a52-b41f-4688-91a4-40b3712800f4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:26.664202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53364c0f-90ba-4ac2-9fa1-6e25c56220ee None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:26.701359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350601d-8dea-455b-8beb-6671ed966f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:26.701979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350601d-8dea-455b-8beb-6671ed966f4b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.702252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350601d-8dea-455b-8beb-6671ed966f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.702522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350601d-8dea-455b-8beb-6671ed966f4b None admin] PATH_INFO: `/v3/users/304b0ae1b9db410cb161ec2c8982cfba` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.703673 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350601d-8dea-455b-8beb-6671ed966f4b None admin] RBAC: Authorizing `identity:get_user(user_id=304b0ae1b9db410cb161ec2c8982cfba)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:26.705117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350601d-8dea-455b-8beb-6671ed966f4b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:26.706700 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 86/183] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:26 2022] GET /identity/v3/users/304b0ae1b9db410cb161ec2c8982cfba => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:26.707549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350601d-8dea-455b-8beb-6671ed966f4b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:26.724730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:26.726915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c8a52-b41f-4688-91a4-40b3712800f4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:26.760814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55246d73-f142-4fad-ba83-b238635a7078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:26.761453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55246d73-f142-4fad-ba83-b238635a7078 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.761710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55246d73-f142-4fad-ba83-b238635a7078 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.761977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55246d73-f142-4fad-ba83-b238635a7078 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.771676 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55246d73-f142-4fad-ba83-b238635a7078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-55246d73-f142-4fad-ba83-b238635a7078 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:26.776350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:26.777285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:26.778065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 98/184] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:19:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:26.778713 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41cbdc-630a-4681-9548-39580dcee009 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.778940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41cbdc-630a-4681-9548-39580dcee009 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.779234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41cbdc-630a-4681-9548-39580dcee009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.796576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6b41cbdc-630a-4681-9548-39580dcee009 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:26.797659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6b41cbdc-630a-4681-9548-39580dcee009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:26.811222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350601d-8dea-455b-8beb-6671ed966f4b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:26.844087 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7ac24-dfeb-4cfc-939e-75cb3828150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:26.844679 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7ac24-dfeb-4cfc-939e-75cb3828150c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:26.844950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7ac24-dfeb-4cfc-939e-75cb3828150c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:26.845215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7ac24-dfeb-4cfc-939e-75cb3828150c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:26.845975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7ac24-dfeb-4cfc-939e-75cb3828150c None admin] RBAC: Adding query filter params (role.id=8823542b01ef4a6ca68c563ef700d59d, scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2, user.id=304b0ae1b9db410cb161ec2c8982cfba) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:26.846373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7ac24-dfeb-4cfc-939e-75cb3828150c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:26.847819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7ac24-dfeb-4cfc-939e-75cb3828150c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:26.849179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:26.853550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 87/185] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:26 2022] GET /identity/v3/role_assignments?user.id=304b0ae1b9db410cb161ec2c8982cfba&scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2&role.id=8823542b01ef4a6ca68c563ef700d59d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:26.854322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7ac24-dfeb-4cfc-939e-75cb3828150c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:26.864327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 99/186] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:26.865208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41cbdc-630a-4681-9548-39580dcee009 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:26.962491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:26.986278 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7ac24-dfeb-4cfc-939e-75cb3828150c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:27.004486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41cbdc-630a-4681-9548-39580dcee009 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:27.026634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb6c51-7968-4124-b62c-80034625bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:27.027308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb6c51-7968-4124-b62c-80034625bf0c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:27.027590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb6c51-7968-4124-b62c-80034625bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:27.027857 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb6c51-7968-4124-b62c-80034625bf0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:27.029077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb6c51-7968-4124-b62c-80034625bf0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:27.030546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb6c51-7968-4124-b62c-80034625bf0c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:27.032376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 88/187] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:27.032991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb6c51-7968-4124-b62c-80034625bf0c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:27.048432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd2a17-b346-430a-802b-696f59b55e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:27.050097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd2a17-b346-430a-802b-696f59b55e5d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:27.050613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd2a17-b346-430a-802b-696f59b55e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:27.051407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd2a17-b346-430a-802b-696f59b55e5d None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:27.053036 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd2a17-b346-430a-802b-696f59b55e5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:27.053608 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd2a17-b346-430a-802b-696f59b55e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:27.055433 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd2a17-b346-430a-802b-696f59b55e5d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:27.065851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 100/188] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:27.066769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd2a17-b346-430a-802b-696f59b55e5d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:27.121172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:27.146901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb6c51-7968-4124-b62c-80034625bf0c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:27.169336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd2a17-b346-430a-802b-696f59b55e5d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:27.179431 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711c244-5167-4409-9e5d-c76ae511c4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:27.180018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711c244-5167-4409-9e5d-c76ae511c4de None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:27.180291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711c244-5167-4409-9e5d-c76ae511c4de None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:27.180554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711c244-5167-4409-9e5d-c76ae511c4de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:27.181264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711c244-5167-4409-9e5d-c76ae511c4de None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2, user.id=10ac18306f3645059eda74e33533cd06) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:27.181565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711c244-5167-4409-9e5d-c76ae511c4de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:27.182990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711c244-5167-4409-9e5d-c76ae511c4de None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:27.188496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 89/189] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:27 2022] GET /identity/v3/role_assignments?user.id=10ac18306f3645059eda74e33533cd06&scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:27.199293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711c244-5167-4409-9e5d-c76ae511c4de None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:27.203547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fd572-2633-496c-9fd3-bb35847185d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:27.204173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fd572-2633-496c-9fd3-bb35847185d0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:27.204449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fd572-2633-496c-9fd3-bb35847185d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:27.204720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fd572-2633-496c-9fd3-bb35847185d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:27.222926 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:27.284128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fd572-2633-496c-9fd3-bb35847185d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:27.285605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fd572-2633-496c-9fd3-bb35847185d0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:27.328255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711c244-5167-4409-9e5d-c76ae511c4de None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:27.342374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:27.367859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cc98a-0cef-4c45-ae1a-2ed01bff7ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:27.369390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cc98a-0cef-4c45-ae1a-2ed01bff7ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:27.369390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cc98a-0cef-4c45-ae1a-2ed01bff7ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:27.369390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cc98a-0cef-4c45-ae1a-2ed01bff7ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:27.369627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cc98a-0cef-4c45-ae1a-2ed01bff7ad0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:27.369936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cc98a-0cef-4c45-ae1a-2ed01bff7ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:27.371888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cc98a-0cef-4c45-ae1a-2ed01bff7ad0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:27.383583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 90/190] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:19:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:27.383583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cc98a-0cef-4c45-ae1a-2ed01bff7ad0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:27.410501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 101/191] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:27.411913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fd572-2633-496c-9fd3-bb35847185d0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:27.464838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:27.490496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cc98a-0cef-4c45-ae1a-2ed01bff7ad0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:27.511239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fd572-2633-496c-9fd3-bb35847185d0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:27.523413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e337a1-9f43-4cc6-b639-bf96af7f9707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:27.524031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e337a1-9f43-4cc6-b639-bf96af7f9707 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:27.524304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e337a1-9f43-4cc6-b639-bf96af7f9707 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:27.524572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e337a1-9f43-4cc6-b639-bf96af7f9707 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:27.535202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e337a1-9f43-4cc6-b639-bf96af7f9707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-c7e337a1-9f43-4cc6-b639-bf96af7f9707 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:27.540415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:27.541433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 91/192] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:27.542240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e337a1-9f43-4cc6-b639-bf96af7f9707 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:27.549273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56639bd-5df5-4af2-8135-390026e0355c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:27.549870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56639bd-5df5-4af2-8135-390026e0355c None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:27.550140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56639bd-5df5-4af2-8135-390026e0355c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:27.550403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56639bd-5df5-4af2-8135-390026e0355c None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:27.551023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56639bd-5df5-4af2-8135-390026e0355c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:27.552465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56639bd-5df5-4af2-8135-390026e0355c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:27.572573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 102/193] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:19:27 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:19:27.573381 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56639bd-5df5-4af2-8135-390026e0355c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:27.584074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:27.657017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e337a1-9f43-4cc6-b639-bf96af7f9707 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:27.688636 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56639bd-5df5-4af2-8135-390026e0355c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:27.695791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7638b-6fd0-4c8f-a06d-f6547f165cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:27.696430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7638b-6fd0-4c8f-a06d-f6547f165cdd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:27.696703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7638b-6fd0-4c8f-a06d-f6547f165cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:27.696975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7638b-6fd0-4c8f-a06d-f6547f165cdd None admin] PATH_INFO: `/v3/users/0fd971d09a9846d68e9b8616413cdde9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:27.699143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:27.715066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7638b-6fd0-4c8f-a06d-f6547f165cdd None admin] RBAC: Authorizing `identity:get_user(user_id=0fd971d09a9846d68e9b8616413cdde9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:27.716584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7638b-6fd0-4c8f-a06d-f6547f165cdd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:27.718428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 92/194] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:27 2022] GET /identity/v3/users/0fd971d09a9846d68e9b8616413cdde9 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:27.724467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7638b-6fd0-4c8f-a06d-f6547f165cdd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:27.735032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84cda-1559-43a6-9c23-6b49b58fd087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:27.735751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84cda-1559-43a6-9c23-6b49b58fd087 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:27.736022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84cda-1559-43a6-9c23-6b49b58fd087 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:27.736288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84cda-1559-43a6-9c23-6b49b58fd087 None admin] PATH_INFO: `/v3/users/0fd971d09a9846d68e9b8616413cdde9` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:27.737434 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a84cda-1559-43a6-9c23-6b49b58fd087 None admin] RBAC: Authorizing `identity:get_user(user_id=0fd971d09a9846d68e9b8616413cdde9)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:27.738871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a84cda-1559-43a6-9c23-6b49b58fd087 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:27.740617 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 103/195] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:27 2022] GET /identity/v3/users/0fd971d09a9846d68e9b8616413cdde9 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:27.746679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84cda-1559-43a6-9c23-6b49b58fd087 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:27.838118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:27.851388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7638b-6fd0-4c8f-a06d-f6547f165cdd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:27.867557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84cda-1559-43a6-9c23-6b49b58fd087 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:27.889841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8731993-007a-4c8e-a626-b575977b720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:27.890494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8731993-007a-4c8e-a626-b575977b720b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:27.890855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8731993-007a-4c8e-a626-b575977b720b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:27.891151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8731993-007a-4c8e-a626-b575977b720b None admin] PATH_INFO: `/v3/projects/0f395bcedb6043ddb12b6bbf4862189e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:27.892300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8731993-007a-4c8e-a626-b575977b720b None admin] RBAC: Authorizing `identity:get_project(project_id=0f395bcedb6043ddb12b6bbf4862189e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:27.894466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8731993-007a-4c8e-a626-b575977b720b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:27.901731 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 93/196] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:27 2022] GET /identity/v3/projects/0f395bcedb6043ddb12b6bbf4862189e => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:27.902578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8731993-007a-4c8e-a626-b575977b720b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:27.906229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3f97-d0c9-4737-907c-b5ee05b2f2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:27.906840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3f97-d0c9-4737-907c-b5ee05b2f2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:27.907146 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3f97-d0c9-4737-907c-b5ee05b2f2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:27.907421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3f97-d0c9-4737-907c-b5ee05b2f2d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:27.908088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb3f97-d0c9-4737-907c-b5ee05b2f2d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:27.908388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb3f97-d0c9-4737-907c-b5ee05b2f2d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:27.909752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb3f97-d0c9-4737-907c-b5ee05b2f2d8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:27.919146 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 104/197] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:27.924228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3f97-d0c9-4737-907c-b5ee05b2f2d8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:27.971928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:28.024403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8731993-007a-4c8e-a626-b575977b720b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:28.048046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3f97-d0c9-4737-907c-b5ee05b2f2d8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:28.063062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acb5e9-bdd0-433d-879e-dfe55bd64dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:28.063778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acb5e9-bdd0-433d-879e-dfe55bd64dcb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:28.064123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acb5e9-bdd0-433d-879e-dfe55bd64dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:28.064964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acb5e9-bdd0-433d-879e-dfe55bd64dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:28.099911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f4527-50f1-438d-b2ce-dc16f601716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:28.100792 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f4527-50f1-438d-b2ce-dc16f601716b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:28.101193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f4527-50f1-438d-b2ce-dc16f601716b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:28.101916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f4527-50f1-438d-b2ce-dc16f601716b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:28.107440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:28.146031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acb5e9-bdd0-433d-879e-dfe55bd64dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:28.147633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acb5e9-bdd0-433d-879e-dfe55bd64dcb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:28.199130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f4527-50f1-438d-b2ce-dc16f601716b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:28.200792 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f4527-50f1-438d-b2ce-dc16f601716b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:28.208914 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:28.252558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 94/198] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:28.253623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acb5e9-bdd0-433d-879e-dfe55bd64dcb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:28.310420 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 105/199] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:28.311646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f4527-50f1-438d-b2ce-dc16f601716b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:28.356881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acb5e9-bdd0-433d-879e-dfe55bd64dcb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:28.357308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:28.393995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957edb3-746e-49b5-9b70-e60f9d02ed10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:28.394923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957edb3-746e-49b5-9b70-e60f9d02ed10 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:28.395306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957edb3-746e-49b5-9b70-e60f9d02ed10 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:28.395646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957edb3-746e-49b5-9b70-e60f9d02ed10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:28.396451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957edb3-746e-49b5-9b70-e60f9d02ed10 None admin] RBAC: Adding query filter params (role.id=8823542b01ef4a6ca68c563ef700d59d, scope.project.id=0f395bcedb6043ddb12b6bbf4862189e, user.id=304b0ae1b9db410cb161ec2c8982cfba) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:28.396982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957edb3-746e-49b5-9b70-e60f9d02ed10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:28.399122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957edb3-746e-49b5-9b70-e60f9d02ed10 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:28.410141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 95/200] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:28 2022] GET /identity/v3/role_assignments?user.id=304b0ae1b9db410cb161ec2c8982cfba&scope.project.id=0f395bcedb6043ddb12b6bbf4862189e&role.id=8823542b01ef4a6ca68c563ef700d59d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:28.411901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957edb3-746e-49b5-9b70-e60f9d02ed10 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:28.473564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f4527-50f1-438d-b2ce-dc16f601716b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:28.475467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:28.551884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428731d-628f-409b-a319-667e80ea37b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:28.552610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428731d-628f-409b-a319-667e80ea37b4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:28.552847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428731d-628f-409b-a319-667e80ea37b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:28.553117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428731d-628f-409b-a319-667e80ea37b4 None admin] PATH_INFO: `/v3/users/c783aeba4da7401996314854c8e709d8` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:28.556831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428731d-628f-409b-a319-667e80ea37b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c783aeba4da7401996314854c8e709d8)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:28.562113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428731d-628f-409b-a319-667e80ea37b4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:28.564153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 106/201] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:28 2022] GET /identity/v3/users/c783aeba4da7401996314854c8e709d8 => generated 289 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:28.565324 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428731d-628f-409b-a319-667e80ea37b4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:28.615421 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957edb3-746e-49b5-9b70-e60f9d02ed10 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:28.655282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e0fd0-b6e7-4718-bcec-3c6efec76c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:28.656014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e0fd0-b6e7-4718-bcec-3c6efec76c89 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:28.656290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e0fd0-b6e7-4718-bcec-3c6efec76c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:28.656558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e0fd0-b6e7-4718-bcec-3c6efec76c89 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:28.657743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e0fd0-b6e7-4718-bcec-3c6efec76c89 None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:28.659781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e0fd0-b6e7-4718-bcec-3c6efec76c89 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:28.661838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 96/202] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:28 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:28.662430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e0fd0-b6e7-4718-bcec-3c6efec76c89 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:28.681652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428731d-628f-409b-a319-667e80ea37b4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:28.686865 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:28.723045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfddf5-918d-4c1c-b5b7-e3da1edddabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:28.723721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfddf5-918d-4c1c-b5b7-e3da1edddabe None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:28.724043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfddf5-918d-4c1c-b5b7-e3da1edddabe None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:28.724317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfddf5-918d-4c1c-b5b7-e3da1edddabe None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:28.725583 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfddf5-918d-4c1c-b5b7-e3da1edddabe None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:28.727068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfddf5-918d-4c1c-b5b7-e3da1edddabe None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:28.729008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 107/203] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:28 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:28.729851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfddf5-918d-4c1c-b5b7-e3da1edddabe None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:28.767901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:28.776952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e0fd0-b6e7-4718-bcec-3c6efec76c89 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:28.817151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194f104-6ae9-45f6-a831-a3dde90476ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:28.817821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194f104-6ae9-45f6-a831-a3dde90476ce None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:28.818107 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194f104-6ae9-45f6-a831-a3dde90476ce None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:28.818479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194f104-6ae9-45f6-a831-a3dde90476ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:28.842843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfddf5-918d-4c1c-b5b7-e3da1edddabe None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:28.882741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b51ad2-f18b-43fe-be9c-40dac7febd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:28.883398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b51ad2-f18b-43fe-be9c-40dac7febd41 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:28.883678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b51ad2-f18b-43fe-be9c-40dac7febd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:28.883949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b51ad2-f18b-43fe-be9c-40dac7febd41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:28.884699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b51ad2-f18b-43fe-be9c-40dac7febd41 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=032c8fa1940c4117b584aca3ab1e4b80, user.id=0fd971d09a9846d68e9b8616413cdde9) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:28.885009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b51ad2-f18b-43fe-be9c-40dac7febd41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:28.887759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b51ad2-f18b-43fe-be9c-40dac7febd41 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:28.896474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 108/204] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:28 2022] GET /identity/v3/role_assignments?user.id=0fd971d09a9846d68e9b8616413cdde9&scope.project.id=032c8fa1940c4117b584aca3ab1e4b80&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:28.897368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b51ad2-f18b-43fe-be9c-40dac7febd41 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:28.897548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194f104-6ae9-45f6-a831-a3dde90476ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:28.899169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194f104-6ae9-45f6-a831-a3dde90476ce None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:28.942090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:29.016054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:29.026159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 97/205] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:29.032030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194f104-6ae9-45f6-a831-a3dde90476ce None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:29.061234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b51ad2-f18b-43fe-be9c-40dac7febd41 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:29.119828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcac8d-fd8d-468b-a206-44099c4d3470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:29.120826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcac8d-fd8d-468b-a206-44099c4d3470 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:29.121316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcac8d-fd8d-468b-a206-44099c4d3470 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:29.121783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcac8d-fd8d-468b-a206-44099c4d3470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:29.122787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcac8d-fd8d-468b-a206-44099c4d3470 None admin] RBAC: Adding query filter params (role.id=74caf7e4c7474d40b5657d5e42da5546, scope.project.id=032c8fa1940c4117b584aca3ab1e4b80, user.id=0fd971d09a9846d68e9b8616413cdde9) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:29.124964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcac8d-fd8d-468b-a206-44099c4d3470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:29.127632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcac8d-fd8d-468b-a206-44099c4d3470 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:29.137890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 109/206] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:28 2022] GET /identity/v3/role_assignments?user.id=0fd971d09a9846d68e9b8616413cdde9&scope.project.id=032c8fa1940c4117b584aca3ab1e4b80&role.id=74caf7e4c7474d40b5657d5e42da5546 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:29.180464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194f104-6ae9-45f6-a831-a3dde90476ce None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:29.219257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138fa7e-5ed7-4f33-bb70-3a00d53992b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:29.220247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138fa7e-5ed7-4f33-bb70-3a00d53992b5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:29.220804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138fa7e-5ed7-4f33-bb70-3a00d53992b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:29.221780 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138fa7e-5ed7-4f33-bb70-3a00d53992b5 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:29.223249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138fa7e-5ed7-4f33-bb70-3a00d53992b5 None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:29.224932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138fa7e-5ed7-4f33-bb70-3a00d53992b5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:29.227442 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 98/207] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:29 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:29.236236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcac8d-fd8d-468b-a206-44099c4d3470 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:29.363917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:29.367836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcac8d-fd8d-468b-a206-44099c4d3470 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:29.404020 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6c8c7-ec54-43e9-bd95-3b0f8fc82754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:29.404991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6c8c7-ec54-43e9-bd95-3b0f8fc82754 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:29.405542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6c8c7-ec54-43e9-bd95-3b0f8fc82754 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:29.406007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6c8c7-ec54-43e9-bd95-3b0f8fc82754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:29.406925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6c8c7-ec54-43e9-bd95-3b0f8fc82754 None admin] RBAC: Adding query filter params (role.id=14ade4f163274596811571bcb806cb12, scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2, user.id=c783aeba4da7401996314854c8e709d8) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:29.407459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6c8c7-ec54-43e9-bd95-3b0f8fc82754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:29.409634 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6c8c7-ec54-43e9-bd95-3b0f8fc82754 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:29.416548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 110/208] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:29 2022] GET /identity/v3/role_assignments?user.id=c783aeba4da7401996314854c8e709d8&scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2&role.id=14ade4f163274596811571bcb806cb12 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:29.941256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc61534-086c-452a-8c80-326cd7914551 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:29.942314 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc61534-086c-452a-8c80-326cd7914551 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:29.942792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc61534-086c-452a-8c80-326cd7914551 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:29.944364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 99/209] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:29.949755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707e0f1-9307-45a6-af72-9cebeead3119 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:29.950183 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707e0f1-9307-45a6-af72-9cebeead3119 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:29.950354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707e0f1-9307-45a6-af72-9cebeead3119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:29.976245 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0707e0f1-9307-45a6-af72-9cebeead3119 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:29.977040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0707e0f1-9307-45a6-af72-9cebeead3119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:30.073350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 111/210] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:30.115599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc61534-086c-452a-8c80-326cd7914551 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:30.186978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:30.225958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b42d1-f344-437f-8d89-b38f30574381 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:30.226237 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b42d1-f344-437f-8d89-b38f30574381 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:30.226428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b42d1-f344-437f-8d89-b38f30574381 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:30.228070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 112/211] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:30.237418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc61534-086c-452a-8c80-326cd7914551 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:30.240472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b5aad-22c9-441d-8b21-ff9aa251098c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:30.240758 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b5aad-22c9-441d-8b21-ff9aa251098c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:30.242454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b5aad-22c9-441d-8b21-ff9aa251098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:30.274988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38be219-323c-4e20-a44f-742f491db21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:30.275686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38be219-323c-4e20-a44f-742f491db21a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:30.275988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38be219-323c-4e20-a44f-742f491db21a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:30.276258 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38be219-323c-4e20-a44f-742f491db21a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:30.277434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38be219-323c-4e20-a44f-742f491db21a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:30.279134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38be219-323c-4e20-a44f-742f491db21a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:30.281364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 100/212] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:30.287639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38be219-323c-4e20-a44f-742f491db21a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:30.287837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-be5b5aad-22c9-441d-8b21-ff9aa251098c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:30.289045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-be5b5aad-22c9-441d-8b21-ff9aa251098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:30.375408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 113/213] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:30.410493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b5aad-22c9-441d-8b21-ff9aa251098c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:30.451114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:30.463105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38be219-323c-4e20-a44f-742f491db21a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:30.489823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:30.498238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c392b-e8f9-4d6c-8c86-59daedc65f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:30.503102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c392b-e8f9-4d6c-8c86-59daedc65f67 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:30.503102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c392b-e8f9-4d6c-8c86-59daedc65f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:30.503102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c392b-e8f9-4d6c-8c86-59daedc65f67 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:30.503102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c392b-e8f9-4d6c-8c86-59daedc65f67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:30.503102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c392b-e8f9-4d6c-8c86-59daedc65f67 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:30.538554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 101/214] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:19:30 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:19:30.599777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b5aad-22c9-441d-8b21-ff9aa251098c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:30.638908 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c2ce7-38f7-4e31-8a93-d6d36920907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:30.639641 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c2ce7-38f7-4e31-8a93-d6d36920907c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:30.639920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c2ce7-38f7-4e31-8a93-d6d36920907c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:30.640188 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c2ce7-38f7-4e31-8a93-d6d36920907c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:30.652576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c2ce7-38f7-4e31-8a93-d6d36920907c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-6f0c2ce7-38f7-4e31-8a93-d6d36920907c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:30.657859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:30.658811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:30.660049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 114/215] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:19:30.665741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c392b-e8f9-4d6c-8c86-59daedc65f67 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:30.780644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c392b-e8f9-4d6c-8c86-59daedc65f67 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:30.817922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d6046-ed73-4691-8933-eb8e1e43ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:30.818591 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d6046-ed73-4691-8933-eb8e1e43ea6c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:30.818870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d6046-ed73-4691-8933-eb8e1e43ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:30.819170 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d6046-ed73-4691-8933-eb8e1e43ea6c None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:30.819858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d6046-ed73-4691-8933-eb8e1e43ea6c None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:30.820159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d6046-ed73-4691-8933-eb8e1e43ea6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:30.821554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d6046-ed73-4691-8933-eb8e1e43ea6c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:30.831401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 102/216] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:30.836841 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c2ce7-38f7-4e31-8a93-d6d36920907c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:30.925507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:30.943340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c2ce7-38f7-4e31-8a93-d6d36920907c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:30.992070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628bbb4-2556-40bd-a854-bf214f5e230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:30.993069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628bbb4-2556-40bd-a854-bf214f5e230b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:30.993574 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628bbb4-2556-40bd-a854-bf214f5e230b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:30.994076 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628bbb4-2556-40bd-a854-bf214f5e230b None admin] PATH_INFO: `/v3/users/b670dcc05c8f46d78f9c6a350bd82f0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:31.014492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628bbb4-2556-40bd-a854-bf214f5e230b None admin] RBAC: Authorizing `identity:get_user(user_id=b670dcc05c8f46d78f9c6a350bd82f0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:31.015981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628bbb4-2556-40bd-a854-bf214f5e230b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:31.018509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 115/217] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:30 2022] GET /identity/v3/users/b670dcc05c8f46d78f9c6a350bd82f0b => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:31.024300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d6046-ed73-4691-8933-eb8e1e43ea6c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:31.075538 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:31.132959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d6046-ed73-4691-8933-eb8e1e43ea6c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:31.168241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3dea2-d5c5-47c2-a09b-c54ff68f66e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:31.168860 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3dea2-d5c5-47c2-a09b-c54ff68f66e0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:31.169138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3dea2-d5c5-47c2-a09b-c54ff68f66e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:31.169407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3dea2-d5c5-47c2-a09b-c54ff68f66e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:31.241414 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3dea2-d5c5-47c2-a09b-c54ff68f66e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:31.242909 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3dea2-d5c5-47c2-a09b-c54ff68f66e0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:31.291332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:31.323547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb569-b7d6-471e-aa99-6c9fa7f5ab3c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:31.324162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb569-b7d6-471e-aa99-6c9fa7f5ab3c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:31.324632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb569-b7d6-471e-aa99-6c9fa7f5ab3c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:31.326928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 116/218] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:19:31.332200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cdaf4-3594-421f-8639-dd3f0292dec7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:31.332832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cdaf4-3594-421f-8639-dd3f0292dec7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:31.333678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cdaf4-3594-421f-8639-dd3f0292dec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:31.361064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 103/219] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:31.362252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b06cdaf4-3594-421f-8639-dd3f0292dec7 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:31.363483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b06cdaf4-3594-421f-8639-dd3f0292dec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:31.367122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3dea2-d5c5-47c2-a09b-c54ff68f66e0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:31.487413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 117/220] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:31.495103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c5c37-ab16-471e-847c-e68e297db5c8 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:31.495566 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c5c37-ab16-471e-847c-e68e297db5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:31.495979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c5c37-ab16-471e-847c-e68e297db5c8 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:31.497682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 118/221] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:31.503945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e770a-8444-40dd-a341-73f9a01aab90 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:31.504460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e770a-8444-40dd-a341-73f9a01aab90 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:31.504900 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e770a-8444-40dd-a341-73f9a01aab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:31.511135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3dea2-d5c5-47c2-a09b-c54ff68f66e0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:31.535223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-204e770a-8444-40dd-a341-73f9a01aab90 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:31.536684 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-204e770a-8444-40dd-a341-73f9a01aab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:31.546429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb51e4-5527-4e92-9e4e-c05b491eaaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:31.547165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb51e4-5527-4e92-9e4e-c05b491eaaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:31.547516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb51e4-5527-4e92-9e4e-c05b491eaaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:31.547858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb51e4-5527-4e92-9e4e-c05b491eaaa8 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:31.549201 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb51e4-5527-4e92-9e4e-c05b491eaaa8 None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:31.550737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb51e4-5527-4e92-9e4e-c05b491eaaa8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:31.553065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 104/222] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:31 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:31.553665 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb51e4-5527-4e92-9e4e-c05b491eaaa8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:31.570948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:31.609310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 119/223] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:31.610407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e770a-8444-40dd-a341-73f9a01aab90 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:31.612978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:31.686252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb51e4-5527-4e92-9e4e-c05b491eaaa8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:31.717903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e770a-8444-40dd-a341-73f9a01aab90 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:31.724569 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0921-1421-4ecc-a6b5-8a16040015c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:31.725205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0921-1421-4ecc-a6b5-8a16040015c6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:31.725481 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0921-1421-4ecc-a6b5-8a16040015c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:31.725752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0921-1421-4ecc-a6b5-8a16040015c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:31.736597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b0921-1421-4ecc-a6b5-8a16040015c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4f3b0921-1421-4ecc-a6b5-8a16040015c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:31.741587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:31.742457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 105/224] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:19:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:31.743305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0921-1421-4ecc-a6b5-8a16040015c6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:31.764308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8c67-a516-4bd5-96b3-2e1f708905bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:31.765245 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8c67-a516-4bd5-96b3-2e1f708905bc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:31.765766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8c67-a516-4bd5-96b3-2e1f708905bc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:31.766234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8c67-a516-4bd5-96b3-2e1f708905bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:31.767219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d8c67-a516-4bd5-96b3-2e1f708905bc None admin] RBAC: Adding query filter params (role.id=8823542b01ef4a6ca68c563ef700d59d, scope.project.id=032c8fa1940c4117b584aca3ab1e4b80, user.id=b670dcc05c8f46d78f9c6a350bd82f0b) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:31.768357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d8c67-a516-4bd5-96b3-2e1f708905bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:31.769980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d8c67-a516-4bd5-96b3-2e1f708905bc None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:31.776277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 120/225] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:31 2022] GET /identity/v3/role_assignments?user.id=b670dcc05c8f46d78f9c6a350bd82f0b&scope.project.id=032c8fa1940c4117b584aca3ab1e4b80&role.id=8823542b01ef4a6ca68c563ef700d59d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:31.777303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8c67-a516-4bd5-96b3-2e1f708905bc None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:31.826998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:31.850292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:31.854789 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0921-1421-4ecc-a6b5-8a16040015c6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:31.900706 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8c67-a516-4bd5-96b3-2e1f708905bc None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:31.918394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972188f1-9f61-4d29-aa63-0b2bb1512311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:31.919047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972188f1-9f61-4d29-aa63-0b2bb1512311 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:31.919348 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972188f1-9f61-4d29-aa63-0b2bb1512311 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:31.919618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972188f1-9f61-4d29-aa63-0b2bb1512311 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:31.940632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e895b23-f92d-451f-9173-64a90c23cda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:31.941692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e895b23-f92d-451f-9173-64a90c23cda3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:31.942161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e895b23-f92d-451f-9173-64a90c23cda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:31.942661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e895b23-f92d-451f-9173-64a90c23cda3 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:31.943568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e895b23-f92d-451f-9173-64a90c23cda3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:31.944111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e895b23-f92d-451f-9173-64a90c23cda3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:31.945664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e895b23-f92d-451f-9173-64a90c23cda3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:31.955879 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 121/226] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:31.960458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972188f1-9f61-4d29-aa63-0b2bb1512311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:31.961579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e895b23-f92d-451f-9173-64a90c23cda3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-972188f1-9f61-4d29-aa63-0b2bb1512311 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:31.968967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:31.969884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:31.971776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 106/227] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:19:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:31.976506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972188f1-9f61-4d29-aa63-0b2bb1512311 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:32.123227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e895b23-f92d-451f-9173-64a90c23cda3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:32.146497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972188f1-9f61-4d29-aa63-0b2bb1512311 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:32.190237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0baceff-bc61-4dfb-9ec3-bca281515fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:32.190900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0baceff-bc61-4dfb-9ec3-bca281515fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:32.191227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0baceff-bc61-4dfb-9ec3-bca281515fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:32.191502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0baceff-bc61-4dfb-9ec3-bca281515fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:32.192196 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0baceff-bc61-4dfb-9ec3-bca281515fb1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:32.192500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0baceff-bc61-4dfb-9ec3-bca281515fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:32.194257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0baceff-bc61-4dfb-9ec3-bca281515fb1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:32.196538 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:32.199481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:32.208098 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 107/228] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:19:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:32.215181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f00b3-7d7b-4da9-b98f-e1ecc0ee6111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:32.215355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0baceff-bc61-4dfb-9ec3-bca281515fb1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:32.215436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f00b3-7d7b-4da9-b98f-e1ecc0ee6111 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:32.215436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f00b3-7d7b-4da9-b98f-e1ecc0ee6111 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:32.215436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f00b3-7d7b-4da9-b98f-e1ecc0ee6111 None admin] PATH_INFO: `/v3/users/0fd971d09a9846d68e9b8616413cdde9` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:32.216457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f00b3-7d7b-4da9-b98f-e1ecc0ee6111 None admin] RBAC: Authorizing `identity:get_user(user_id=0fd971d09a9846d68e9b8616413cdde9)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:32.217964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f00b3-7d7b-4da9-b98f-e1ecc0ee6111 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:32.219638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 122/229] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:31 2022] GET /identity/v3/users/0fd971d09a9846d68e9b8616413cdde9 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:32.228095 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f00b3-7d7b-4da9-b98f-e1ecc0ee6111 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:32.322380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0baceff-bc61-4dfb-9ec3-bca281515fb1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:32.366971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d22db-ea2f-4093-a90c-151a117213aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:32.367641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d22db-ea2f-4093-a90c-151a117213aa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:32.367919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d22db-ea2f-4093-a90c-151a117213aa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:32.368190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d22db-ea2f-4093-a90c-151a117213aa None admin] PATH_INFO: `/v3/users/0fd971d09a9846d68e9b8616413cdde9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:32.369328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d22db-ea2f-4093-a90c-151a117213aa None admin] RBAC: Authorizing `identity:get_user(user_id=0fd971d09a9846d68e9b8616413cdde9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:32.370773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d22db-ea2f-4093-a90c-151a117213aa None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:32.379638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 108/230] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:32 2022] GET /identity/v3/users/0fd971d09a9846d68e9b8616413cdde9 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:32.380481 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d22db-ea2f-4093-a90c-151a117213aa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:32.416320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f00b3-7d7b-4da9-b98f-e1ecc0ee6111 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:32.453443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69725bd-a875-446d-b499-d9b27599c423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:32.454014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69725bd-a875-446d-b499-d9b27599c423 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:32.454292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69725bd-a875-446d-b499-d9b27599c423 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:32.454563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69725bd-a875-446d-b499-d9b27599c423 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:32.457215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69725bd-a875-446d-b499-d9b27599c423 None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:32.458659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69725bd-a875-446d-b499-d9b27599c423 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:32.463727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 123/231] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:32 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:32.466088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69725bd-a875-446d-b499-d9b27599c423 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:32.504988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:32.536747 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d22db-ea2f-4093-a90c-151a117213aa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:32.574657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84e43f-f7d1-4758-8a36-efc30ac21a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:32.575351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84e43f-f7d1-4758-8a36-efc30ac21a1b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:32.575628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84e43f-f7d1-4758-8a36-efc30ac21a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:32.575902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84e43f-f7d1-4758-8a36-efc30ac21a1b None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:32.577071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84e43f-f7d1-4758-8a36-efc30ac21a1b None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:32.578525 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84e43f-f7d1-4758-8a36-efc30ac21a1b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:32.580770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 109/232] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:32 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:32.587186 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84e43f-f7d1-4758-8a36-efc30ac21a1b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:32.664069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:32.697495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84e43f-f7d1-4758-8a36-efc30ac21a1b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:32.733193 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:32.739765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12e648-e4ef-4723-bb34-5e228ac7efc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:32.740433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12e648-e4ef-4723-bb34-5e228ac7efc8 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:32.740732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12e648-e4ef-4723-bb34-5e228ac7efc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:32.740990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12e648-e4ef-4723-bb34-5e228ac7efc8 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80/users/0fd971d09a9846d68e9b8616413cdde9/roles/74caf7e4c7474d40b5657d5e42da5546` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:32.745906 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12e648-e4ef-4723-bb34-5e228ac7efc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=032c8fa1940c4117b584aca3ab1e4b80, user_id=0fd971d09a9846d68e9b8616413cdde9, role_id=74caf7e4c7474d40b5657d5e42da5546)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:32.747387 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12e648-e4ef-4723-bb34-5e228ac7efc8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:32.760523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69725bd-a875-446d-b499-d9b27599c423 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:32.775406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 110/233] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:19:32 2022] PUT /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80/users/0fd971d09a9846d68e9b8616413cdde9/roles/74caf7e4c7474d40b5657d5e42da5546 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:19:32.805604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30745636-735e-4bb7-abff-8cc8e2722724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:32.806280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30745636-735e-4bb7-abff-8cc8e2722724 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:32.806561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30745636-735e-4bb7-abff-8cc8e2722724 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:32.806835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30745636-735e-4bb7-abff-8cc8e2722724 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80/users/0fd971d09a9846d68e9b8616413cdde9/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:32.808881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30745636-735e-4bb7-abff-8cc8e2722724 None admin] RBAC: Authorizing `identity:create_grant(project_id=032c8fa1940c4117b584aca3ab1e4b80, user_id=0fd971d09a9846d68e9b8616413cdde9, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:32.810343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30745636-735e-4bb7-abff-8cc8e2722724 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:32.837596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 124/234] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:19:32 2022] PUT /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80/users/0fd971d09a9846d68e9b8616413cdde9/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:33.215484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf2ed0-a812-458b-808a-1c287896407f None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:33.216475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf2ed0-a812-458b-808a-1c287896407f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:33.216985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf2ed0-a812-458b-808a-1c287896407f None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:33.218531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 111/235] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:33.223985 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2b3c0-f3f3-48e4-b209-1b8cc71abcbc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:33.224414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2b3c0-f3f3-48e4-b209-1b8cc71abcbc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:33.224585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2b3c0-f3f3-48e4-b209-1b8cc71abcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:33.247431 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-10f2b3c0-f3f3-48e4-b209-1b8cc71abcbc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:33.248546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-10f2b3c0-f3f3-48e4-b209-1b8cc71abcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:33.275738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ff242-9c84-4b1e-98c5-57e78822b779 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:33.276370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ff242-9c84-4b1e-98c5-57e78822b779 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:33.276838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ff242-9c84-4b1e-98c5-57e78822b779 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:33.278727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 112/236] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:33.286059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068af943-6f2e-4abc-b4ad-b8c486c369bc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:33.286605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068af943-6f2e-4abc-b4ad-b8c486c369bc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:33.287075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068af943-6f2e-4abc-b4ad-b8c486c369bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:33.317852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-068af943-6f2e-4abc-b4ad-b8c486c369bc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:33.319046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-068af943-6f2e-4abc-b4ad-b8c486c369bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:33.362486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 125/237] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:33.397327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2b3c0-f3f3-48e4-b209-1b8cc71abcbc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:33.444305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 113/238] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:33.481736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:33.502885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068af943-6f2e-4abc-b4ad-b8c486c369bc None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:33.560777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2b3c0-f3f3-48e4-b209-1b8cc71abcbc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:33.602453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bdb1b-6fc7-462a-bc3c-a060e872d166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:33.603988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bdb1b-6fc7-462a-bc3c-a060e872d166 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:33.604466 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bdb1b-6fc7-462a-bc3c-a060e872d166 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:33.604930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bdb1b-6fc7-462a-bc3c-a060e872d166 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:33.623673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bdb1b-6fc7-462a-bc3c-a060e872d166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d09bdb1b-6fc7-462a-bc3c-a060e872d166 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:33.630352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:33.631230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:33.632010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:33.632010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:33.632010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:33.632010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:33.632010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:33.632010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:33.632010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:33.632010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:33.632010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:33.632010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:33.632010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:33.632010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:33.634604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 126/239] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:19:33.640748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bdb1b-6fc7-462a-bc3c-a060e872d166 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:33.724403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068af943-6f2e-4abc-b4ad-b8c486c369bc None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:33.755766 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:33.759374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bdb1b-6fc7-462a-bc3c-a060e872d166 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:33.780611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dde4f3-d954-43aa-8303-1213ab10d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:33.781926 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dde4f3-d954-43aa-8303-1213ab10d0aa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:33.782422 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dde4f3-d954-43aa-8303-1213ab10d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:33.782899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dde4f3-d954-43aa-8303-1213ab10d0aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:33.785030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dde4f3-d954-43aa-8303-1213ab10d0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:33.787830 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dde4f3-d954-43aa-8303-1213ab10d0aa None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:33.789980 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 114/240] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:33.792401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:33.796001 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dde4f3-d954-43aa-8303-1213ab10d0aa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:33.828716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2c851-13ef-4f54-ae6e-fa66b3fe2027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:33.830962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2c851-13ef-4f54-ae6e-fa66b3fe2027 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:33.831514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2c851-13ef-4f54-ae6e-fa66b3fe2027 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:33.832009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2c851-13ef-4f54-ae6e-fa66b3fe2027 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:33.834396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2c851-13ef-4f54-ae6e-fa66b3fe2027 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:33.834904 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2c851-13ef-4f54-ae6e-fa66b3fe2027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:33.837543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2c851-13ef-4f54-ae6e-fa66b3fe2027 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:33.851381 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 127/241] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:33.858714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2c851-13ef-4f54-ae6e-fa66b3fe2027 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:33.992055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dde4f3-d954-43aa-8303-1213ab10d0aa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:33.994746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2c851-13ef-4f54-ae6e-fa66b3fe2027 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:34.038786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6be806-47da-4025-83eb-a73fc1bb51c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:34.039439 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6be806-47da-4025-83eb-a73fc1bb51c4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:34.039711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6be806-47da-4025-83eb-a73fc1bb51c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:34.039977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6be806-47da-4025-83eb-a73fc1bb51c4 None admin] PATH_INFO: `/v3/users/6e9b22694b5f41a582d1380ce8eb848d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:34.066607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6be806-47da-4025-83eb-a73fc1bb51c4 None admin] RBAC: Authorizing `identity:get_user(user_id=6e9b22694b5f41a582d1380ce8eb848d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:34.068071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6be806-47da-4025-83eb-a73fc1bb51c4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:34.071477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da16d81-8c90-428c-9751-ad0a6d4dc045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:34.072077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16d81-8c90-428c-9751-ad0a6d4dc045 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:34.072347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16d81-8c90-428c-9751-ad0a6d4dc045 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:34.072612 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16d81-8c90-428c-9751-ad0a6d4dc045 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:34.073248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da16d81-8c90-428c-9751-ad0a6d4dc045 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:34.074664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da16d81-8c90-428c-9751-ad0a6d4dc045 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:34.077038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 128/242] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:33 2022] GET /identity/v3/users/6e9b22694b5f41a582d1380ce8eb848d => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:34.077847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6be806-47da-4025-83eb-a73fc1bb51c4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:34.119754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 115/243] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:19:33 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:19:34.132026 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:34.210845 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6be806-47da-4025-83eb-a73fc1bb51c4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:34.255424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14b12-938a-4a87-9a89-7052552c0b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:34.256112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14b12-938a-4a87-9a89-7052552c0b5f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:34.256391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14b12-938a-4a87-9a89-7052552c0b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:34.256586 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14b12-938a-4a87-9a89-7052552c0b5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:34.340707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0a590-b687-4fcc-b309-ec1a9f0690dc None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:34.341210 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0a590-b687-4fcc-b309-ec1a9f0690dc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:34.341210 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0a590-b687-4fcc-b309-ec1a9f0690dc None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:34.342756 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 116/244] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:34.349437 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31be62a-368a-4631-9dfc-b20d2b5999cc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:34.349717 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31be62a-368a-4631-9dfc-b20d2b5999cc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:34.349989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31be62a-368a-4631-9dfc-b20d2b5999cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:34.351603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db14b12-938a-4a87-9a89-7052552c0b5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:34.353067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db14b12-938a-4a87-9a89-7052552c0b5f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:34.370121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a31be62a-368a-4631-9dfc-b20d2b5999cc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:34.373327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a31be62a-368a-4631-9dfc-b20d2b5999cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:34.394453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:34.425527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:34.459304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 117/245] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:34.481438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 129/246] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:34.483908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31be62a-368a-4631-9dfc-b20d2b5999cc None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:34.487827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14b12-938a-4a87-9a89-7052552c0b5f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:34.592236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31be62a-368a-4631-9dfc-b20d2b5999cc None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:34.599073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14b12-938a-4a87-9a89-7052552c0b5f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:34.629180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930f5e7-458f-4b46-b949-10cde7459a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:34.629814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930f5e7-458f-4b46-b949-10cde7459a2a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:34.630264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930f5e7-458f-4b46-b949-10cde7459a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:34.630533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930f5e7-458f-4b46-b949-10cde7459a2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:34.639336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4d19-c37b-4711-8100-e515685688e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:34.640245 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4d19-c37b-4711-8100-e515685688e9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:34.640527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4d19-c37b-4711-8100-e515685688e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:34.640796 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4d19-c37b-4711-8100-e515685688e9 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:34.641942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a4d19-c37b-4711-8100-e515685688e9 None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:34.642904 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930f5e7-458f-4b46-b949-10cde7459a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:34.643451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a4d19-c37b-4711-8100-e515685688e9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:34.645256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 130/247] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:34 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-5930f5e7-458f-4b46-b949-10cde7459a2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:34.647831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:34.650219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:34.652282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 118/248] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:34.655942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930f5e7-458f-4b46-b949-10cde7459a2a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:34.656126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4d19-c37b-4711-8100-e515685688e9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:34.663385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:34.701861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:34.792329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930f5e7-458f-4b46-b949-10cde7459a2a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:34.792680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4d19-c37b-4711-8100-e515685688e9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:34.834919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2dc7a-b126-4120-bc24-ae3cbe4a92b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:34.835273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c85c97-1311-4b27-a300-d301a194c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:34.835569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c85c97-1311-4b27-a300-d301a194c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:34.835750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2dc7a-b126-4120-bc24-ae3cbe4a92b3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:34.835916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2dc7a-b126-4120-bc24-ae3cbe4a92b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:34.836058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c85c97-1311-4b27-a300-d301a194c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:34.836199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2dc7a-b126-4120-bc24-ae3cbe4a92b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:34.836338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c85c97-1311-4b27-a300-d301a194c5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:34.836809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2dc7a-b126-4120-bc24-ae3cbe4a92b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:34.836963 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c85c97-1311-4b27-a300-d301a194c5e4 None admin] RBAC: Adding query filter params (role.id=14ade4f163274596811571bcb806cb12, scope.project.id=032c8fa1940c4117b584aca3ab1e4b80, user.id=6e9b22694b5f41a582d1380ce8eb848d) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:34.837105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2dc7a-b126-4120-bc24-ae3cbe4a92b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:34.837242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c85c97-1311-4b27-a300-d301a194c5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:34.838485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2dc7a-b126-4120-bc24-ae3cbe4a92b3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:34.838664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c85c97-1311-4b27-a300-d301a194c5e4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:34.846851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 131/249] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:34 2022] GET /identity/v3/role_assignments?user.id=6e9b22694b5f41a582d1380ce8eb848d&scope.project.id=032c8fa1940c4117b584aca3ab1e4b80&role.id=14ade4f163274596811571bcb806cb12 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:34.855035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 119/250] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:34.860920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c85c97-1311-4b27-a300-d301a194c5e4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:34.945229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:34.996057 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c85c97-1311-4b27-a300-d301a194c5e4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:35.043832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31ff4-1c84-4197-91d5-10c5b48f72f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:35.044496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31ff4-1c84-4197-91d5-10c5b48f72f5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:35.044775 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31ff4-1c84-4197-91d5-10c5b48f72f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:35.045042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31ff4-1c84-4197-91d5-10c5b48f72f5 None admin] PATH_INFO: `/v3/users/b670dcc05c8f46d78f9c6a350bd82f0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:35.046253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e31ff4-1c84-4197-91d5-10c5b48f72f5 None admin] RBAC: Authorizing `identity:get_user(user_id=b670dcc05c8f46d78f9c6a350bd82f0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:35.047727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e31ff4-1c84-4197-91d5-10c5b48f72f5 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:35.049856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 132/251] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:34 2022] GET /identity/v3/users/b670dcc05c8f46d78f9c6a350bd82f0b => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:35.055527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2dc7a-b126-4120-bc24-ae3cbe4a92b3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:35.184949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:35.189376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2dc7a-b126-4120-bc24-ae3cbe4a92b3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:35.201304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b5b25-c72d-4994-8f21-a0f4ebac885e None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:35.201603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b5b25-c72d-4994-8f21-a0f4ebac885e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:35.201849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b5b25-c72d-4994-8f21-a0f4ebac885e None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:35.203926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 133/252] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:35.209676 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f030ee-b3a8-4d9e-8216-a778b49f6ef7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:35.210222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f030ee-b3a8-4d9e-8216-a778b49f6ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:35.210498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f030ee-b3a8-4d9e-8216-a778b49f6ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:35.238240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdb3b4-8ffe-4b24-ba5d-c8be9d6e3cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:35.238881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdb3b4-8ffe-4b24-ba5d-c8be9d6e3cba None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:35.239184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdb3b4-8ffe-4b24-ba5d-c8be9d6e3cba None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:35.239457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdb3b4-8ffe-4b24-ba5d-c8be9d6e3cba None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:35.241627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdb3b4-8ffe-4b24-ba5d-c8be9d6e3cba None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:35.243114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdb3b4-8ffe-4b24-ba5d-c8be9d6e3cba None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:35.245779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 120/253] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:35 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:35.250595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdb3b4-8ffe-4b24-ba5d-c8be9d6e3cba None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:35.262632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-90f030ee-b3a8-4d9e-8216-a778b49f6ef7 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:35.263886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-90f030ee-b3a8-4d9e-8216-a778b49f6ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:35.350517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 134/254] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:35.378928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f030ee-b3a8-4d9e-8216-a778b49f6ef7 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:35.496998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdb3b4-8ffe-4b24-ba5d-c8be9d6e3cba None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:35.519438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:35.572056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48815c19-68b8-4c6f-8551-d53195bc06b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:35.573660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48815c19-68b8-4c6f-8551-d53195bc06b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:35.574321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48815c19-68b8-4c6f-8551-d53195bc06b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:35.575417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48815c19-68b8-4c6f-8551-d53195bc06b5 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80/users/b670dcc05c8f46d78f9c6a350bd82f0b/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:35.578711 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48815c19-68b8-4c6f-8551-d53195bc06b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=032c8fa1940c4117b584aca3ab1e4b80, user_id=b670dcc05c8f46d78f9c6a350bd82f0b, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:35.581922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48815c19-68b8-4c6f-8551-d53195bc06b5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:35.590074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f030ee-b3a8-4d9e-8216-a778b49f6ef7 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:35.604999 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 121/255] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:19:35 2022] PUT /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80/users/b670dcc05c8f46d78f9c6a350bd82f0b/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:35.606954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114e3b7-8fcd-48ac-a4b8-1e97fcf0480a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:35.607479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114e3b7-8fcd-48ac-a4b8-1e97fcf0480a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:35.608228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114e3b7-8fcd-48ac-a4b8-1e97fcf0480a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:35.612232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 122/256] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:35.620489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a120e22-f43e-43aa-9e6e-a5e0f3edf8b3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:35.621106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a120e22-f43e-43aa-9e6e-a5e0f3edf8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:35.621706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a120e22-f43e-43aa-9e6e-a5e0f3edf8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:35.655159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6a120e22-f43e-43aa-9e6e-a5e0f3edf8b3 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:35.659394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6a120e22-f43e-43aa-9e6e-a5e0f3edf8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:35.674871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493e239-1720-4279-bbea-99b6e918c781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:35.675946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493e239-1720-4279-bbea-99b6e918c781 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:35.676422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493e239-1720-4279-bbea-99b6e918c781 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:35.676883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493e239-1720-4279-bbea-99b6e918c781 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:35.698981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493e239-1720-4279-bbea-99b6e918c781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:35.707763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-e493e239-1720-4279-bbea-99b6e918c781 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:35.708991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:35.709851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:35.710622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:35.710622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:35.710622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:35.710622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:35.710622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:35.710622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:35.710622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:35.710622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:35.710622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:35.710622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:35.710622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:35.710622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:35.714404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 135/257] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:19:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:19:35.728252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493e239-1720-4279-bbea-99b6e918c781 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:35.811869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 123/258] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:35.851407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a120e22-f43e-43aa-9e6e-a5e0f3edf8b3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:35.859287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493e239-1720-4279-bbea-99b6e918c781 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:35.884228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:35.903860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5841de9-d27a-4c04-9d76-945f5b702ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:35.907110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5841de9-d27a-4c04-9d76-945f5b702ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:35.907110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5841de9-d27a-4c04-9d76-945f5b702ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:35.907110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5841de9-d27a-4c04-9d76-945f5b702ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:35.907110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5841de9-d27a-4c04-9d76-945f5b702ba6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:35.907110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5841de9-d27a-4c04-9d76-945f5b702ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:35.907469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5841de9-d27a-4c04-9d76-945f5b702ba6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:35.919376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 136/259] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:19:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:35.926021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5841de9-d27a-4c04-9d76-945f5b702ba6 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:36.047463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5841de9-d27a-4c04-9d76-945f5b702ba6 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:36.085564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fbd43-b85b-402b-a6bd-4308205bbf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:36.086485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fbd43-b85b-402b-a6bd-4308205bbf15 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:36.086763 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fbd43-b85b-402b-a6bd-4308205bbf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:36.087029 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fbd43-b85b-402b-a6bd-4308205bbf15 None admin] PATH_INFO: `/v3/users/0fd971d09a9846d68e9b8616413cdde9` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:36.088316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fbd43-b85b-402b-a6bd-4308205bbf15 None admin] RBAC: Authorizing `identity:get_user(user_id=0fd971d09a9846d68e9b8616413cdde9)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:36.089884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fbd43-b85b-402b-a6bd-4308205bbf15 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:36.091487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 137/260] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:35 2022] GET /identity/v3/users/0fd971d09a9846d68e9b8616413cdde9 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:36.092268 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a120e22-f43e-43aa-9e6e-a5e0f3edf8b3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:36.098726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fbd43-b85b-402b-a6bd-4308205bbf15 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:36.161072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2600a9-ebce-429c-a34e-6c8655e3326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:36.162064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2600a9-ebce-429c-a34e-6c8655e3326e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:36.162537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2600a9-ebce-429c-a34e-6c8655e3326e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:36.163022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2600a9-ebce-429c-a34e-6c8655e3326e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:36.164108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:36.174821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2600a9-ebce-429c-a34e-6c8655e3326e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9b2600a9-ebce-429c-a34e-6c8655e3326e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:36.179955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:36.180863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:36.181645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:36.181645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:36.181645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:36.181645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:36.181645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:36.181645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:36.181645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:36.181645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:36.181645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:36.181645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:36.181645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:36.181645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:36.184028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 124/261] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:19:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:19:36.190214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2600a9-ebce-429c-a34e-6c8655e3326e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:36.210981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fbd43-b85b-402b-a6bd-4308205bbf15 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:36.229710 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:36.253513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96d829-8f1a-4ab0-adce-a2e255e5a1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:36.254396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96d829-8f1a-4ab0-adce-a2e255e5a1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:36.255118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96d829-8f1a-4ab0-adce-a2e255e5a1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:36.255528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96d829-8f1a-4ab0-adce-a2e255e5a1e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:36.339800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96d829-8f1a-4ab0-adce-a2e255e5a1e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:36.342008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96d829-8f1a-4ab0-adce-a2e255e5a1e9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:36.399991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2600a9-ebce-429c-a34e-6c8655e3326e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:36.423647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:36.458674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 138/262] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:36.464821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96d829-8f1a-4ab0-adce-a2e255e5a1e9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:36.515800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d8920-cc34-43ad-add4-011ead07d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:36.516594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d8920-cc34-43ad-add4-011ead07d860 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:36.516971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d8920-cc34-43ad-add4-011ead07d860 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:36.517361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d8920-cc34-43ad-add4-011ead07d860 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:36.518777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d8920-cc34-43ad-add4-011ead07d860 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:36.519234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d8920-cc34-43ad-add4-011ead07d860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:36.520725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d8920-cc34-43ad-add4-011ead07d860 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:36.541286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 125/263] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:36.547187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d8920-cc34-43ad-add4-011ead07d860 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:36.572539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96d829-8f1a-4ab0-adce-a2e255e5a1e9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:36.610181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de93de8-566f-489e-adf1-4553be23bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:36.611019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de93de8-566f-489e-adf1-4553be23bd47 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:36.615428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de93de8-566f-489e-adf1-4553be23bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:36.615897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de93de8-566f-489e-adf1-4553be23bd47 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:36.617549 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de93de8-566f-489e-adf1-4553be23bd47 None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:36.619391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de93de8-566f-489e-adf1-4553be23bd47 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:36.621416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 139/264] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:36 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:36.627935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de93de8-566f-489e-adf1-4553be23bd47 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:36.689441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:36.742262 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de93de8-566f-489e-adf1-4553be23bd47 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:36.756869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:36.791366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d8920-cc34-43ad-add4-011ead07d860 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:36.807122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b19dd-5c5a-42ca-871a-a5ca1ea88049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:36.808040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b19dd-5c5a-42ca-871a-a5ca1ea88049 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:36.808508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b19dd-5c5a-42ca-871a-a5ca1ea88049 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:36.808964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b19dd-5c5a-42ca-871a-a5ca1ea88049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:36.809967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b19dd-5c5a-42ca-871a-a5ca1ea88049 None admin] RBAC: Adding query filter params (role.id=74caf7e4c7474d40b5657d5e42da5546, scope.project.id=032c8fa1940c4117b584aca3ab1e4b80, user.id=0fd971d09a9846d68e9b8616413cdde9) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:36.810509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b19dd-5c5a-42ca-871a-a5ca1ea88049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:36.812197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b19dd-5c5a-42ca-871a-a5ca1ea88049 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:36.824082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 140/265] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:36 2022] GET /identity/v3/role_assignments?user.id=0fd971d09a9846d68e9b8616413cdde9&scope.project.id=032c8fa1940c4117b584aca3ab1e4b80&role.id=74caf7e4c7474d40b5657d5e42da5546 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:36.832427 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f7ac6-5bd7-4238-84a5-f76b24b342d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:36.833076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f7ac6-5bd7-4238-84a5-f76b24b342d2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:36.833360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f7ac6-5bd7-4238-84a5-f76b24b342d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:36.833629 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f7ac6-5bd7-4238-84a5-f76b24b342d2 None admin] PATH_INFO: `/v3/users/0fd971d09a9846d68e9b8616413cdde9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:36.834843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f7ac6-5bd7-4238-84a5-f76b24b342d2 None admin] RBAC: Authorizing `identity:get_user(user_id=0fd971d09a9846d68e9b8616413cdde9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:36.836413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f7ac6-5bd7-4238-84a5-f76b24b342d2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:36.838138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 126/266] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:36 2022] GET /identity/v3/users/0fd971d09a9846d68e9b8616413cdde9 => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:36.843831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b19dd-5c5a-42ca-871a-a5ca1ea88049 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:36.953524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:36.974133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b19dd-5c5a-42ca-871a-a5ca1ea88049 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:37.037644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc9095-6be1-4cd0-a5b4-197985cfb5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:37.038364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc9095-6be1-4cd0-a5b4-197985cfb5fa None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:37.038648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc9095-6be1-4cd0-a5b4-197985cfb5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:37.038914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc9095-6be1-4cd0-a5b4-197985cfb5fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:37.143287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc9095-6be1-4cd0-a5b4-197985cfb5fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:37.144736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc9095-6be1-4cd0-a5b4-197985cfb5fa None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:37.246140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:37.272082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 141/267] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 22:19:37.277342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f7ac6-5bd7-4238-84a5-f76b24b342d2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:37.418030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f7ac6-5bd7-4238-84a5-f76b24b342d2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:37.458919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df5788-3588-4c7a-b131-7d7fac94eaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:37.459582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df5788-3588-4c7a-b131-7d7fac94eaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:37.459856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df5788-3588-4c7a-b131-7d7fac94eaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:37.460131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df5788-3588-4c7a-b131-7d7fac94eaa0 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:37.461266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df5788-3588-4c7a-b131-7d7fac94eaa0 None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:37.462767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df5788-3588-4c7a-b131-7d7fac94eaa0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:37.464571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 127/268] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:37 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:37.472172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc9095-6be1-4cd0-a5b4-197985cfb5fa None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:37.623616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc9095-6be1-4cd0-a5b4-197985cfb5fa None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:37.672113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e31cf0-239a-4ec5-9bbf-034af1c8ec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:37.672393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67006b4-b50f-4511-84c5-ca983108ea55 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:37.672845 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e31cf0-239a-4ec5-9bbf-034af1c8ec7f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:37.673021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e31cf0-239a-4ec5-9bbf-034af1c8ec7f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:37.673255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e31cf0-239a-4ec5-9bbf-034af1c8ec7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:37.673762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67006b4-b50f-4511-84c5-ca983108ea55 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:37.674023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e31cf0-239a-4ec5-9bbf-034af1c8ec7f None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=032c8fa1940c4117b584aca3ab1e4b80, user.id=0fd971d09a9846d68e9b8616413cdde9) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:37.674333 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e31cf0-239a-4ec5-9bbf-034af1c8ec7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:37.674648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67006b4-b50f-4511-84c5-ca983108ea55 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:37.675795 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e31cf0-239a-4ec5-9bbf-034af1c8ec7f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:37.676703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 128/269] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:37.681888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eed98-dacb-4120-955d-30c0831b92c8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:37.682418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eed98-dacb-4120-955d-30c0831b92c8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:37.682887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eed98-dacb-4120-955d-30c0831b92c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:37.684907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 142/270] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:37 2022] GET /identity/v3/role_assignments?user.id=0fd971d09a9846d68e9b8616413cdde9&scope.project.id=032c8fa1940c4117b584aca3ab1e4b80&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:37.705723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-927eed98-dacb-4120-955d-30c0831b92c8 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:37.707345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-927eed98-dacb-4120-955d-30c0831b92c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:37.731487 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:37.828678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828491f-b8b5-4692-9908-8f5bed395638 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:37.829033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828491f-b8b5-4692-9908-8f5bed395638 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:37.829225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828491f-b8b5-4692-9908-8f5bed395638 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:37.831455 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 143/271] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:37.838280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fed176-215f-4602-b4d4-1fa878548a7f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:37.838644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fed176-215f-4602-b4d4-1fa878548a7f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:37.838830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fed176-215f-4602-b4d4-1fa878548a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:37.841144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 129/272] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:37.864931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927eed98-dacb-4120-955d-30c0831b92c8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:37.870170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-36fed176-215f-4602-b4d4-1fa878548a7f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:37.871614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-36fed176-215f-4602-b4d4-1fa878548a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:37.933000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:37.963291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 144/273] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:37.965061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58467ccb-ee2e-4641-acb5-63017cb29c32 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:37.965516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58467ccb-ee2e-4641-acb5-63017cb29c32 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:37.965957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58467ccb-ee2e-4641-acb5-63017cb29c32 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:37.967408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 145/274] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:37.972912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65a189-68b2-4894-b94a-14682e5bf5eb None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:37.973425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65a189-68b2-4894-b94a-14682e5bf5eb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:37.973956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65a189-68b2-4894-b94a-14682e5bf5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:37.982806 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927eed98-dacb-4120-955d-30c0831b92c8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:38.003959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8d65a189-68b2-4894-b94a-14682e5bf5eb None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:38.005432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8d65a189-68b2-4894-b94a-14682e5bf5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:38.026259 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc1f6e-b38e-4183-b9f0-cd124c229b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:38.026892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc1f6e-b38e-4183-b9f0-cd124c229b03 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:38.027201 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc1f6e-b38e-4183-b9f0-cd124c229b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:38.027470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc1f6e-b38e-4183-b9f0-cd124c229b03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:38.038828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc1f6e-b38e-4183-b9f0-cd124c229b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-3bcc1f6e-b38e-4183-b9f0-cd124c229b03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:38.043603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:38.044518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 130/275] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:19:38.051411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc1f6e-b38e-4183-b9f0-cd124c229b03 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:38.054942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:38.081718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 146/276] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:38.091971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65a189-68b2-4894-b94a-14682e5bf5eb None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:38.162298 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc1f6e-b38e-4183-b9f0-cd124c229b03 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:38.198195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ff702-9b7f-4f24-a5b4-6c7aa67e5ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:38.198849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ff702-9b7f-4f24-a5b4-6c7aa67e5ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:38.199165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ff702-9b7f-4f24-a5b4-6c7aa67e5ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:38.199419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ff702-9b7f-4f24-a5b4-6c7aa67e5ac9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:38.200517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ff702-9b7f-4f24-a5b4-6c7aa67e5ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:38.201967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ff702-9b7f-4f24-a5b4-6c7aa67e5ac9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:38.202079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65a189-68b2-4894-b94a-14682e5bf5eb None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:38.203566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 131/277] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:38.208353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ff702-9b7f-4f24-a5b4-6c7aa67e5ac9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:38.219335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:38.247252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667880c7-20f3-41b8-8079-050137b39e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:38.248121 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667880c7-20f3-41b8-8079-050137b39e56 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:38.248542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667880c7-20f3-41b8-8079-050137b39e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:38.248954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667880c7-20f3-41b8-8079-050137b39e56 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:38.250434 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667880c7-20f3-41b8-8079-050137b39e56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:38.250896 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667880c7-20f3-41b8-8079-050137b39e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:38.253350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667880c7-20f3-41b8-8079-050137b39e56 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:38.264460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 147/278] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:38.265543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667880c7-20f3-41b8-8079-050137b39e56 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:38.280730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:38.313123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ff702-9b7f-4f24-a5b4-6c7aa67e5ac9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:38.351430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c9641-665b-4921-956d-cbc1ffdf9647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:38.352312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c9641-665b-4921-956d-cbc1ffdf9647 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:38.352586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c9641-665b-4921-956d-cbc1ffdf9647 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:38.352853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c9641-665b-4921-956d-cbc1ffdf9647 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:38.364874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c9641-665b-4921-956d-cbc1ffdf9647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-265c9641-665b-4921-956d-cbc1ffdf9647 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:38.369662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:38.370541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 132/279] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:38.375738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c9641-665b-4921-956d-cbc1ffdf9647 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:38.393779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667880c7-20f3-41b8-8079-050137b39e56 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:38.427492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba4b55-bfac-4e64-939b-ea5d47473351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:38.428100 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba4b55-bfac-4e64-939b-ea5d47473351 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:38.428402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba4b55-bfac-4e64-939b-ea5d47473351 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:38.428673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba4b55-bfac-4e64-939b-ea5d47473351 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:38.429301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba4b55-bfac-4e64-939b-ea5d47473351 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:38.430736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba4b55-bfac-4e64-939b-ea5d47473351 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:38.453485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 148/280] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:19:38 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:19:38.463511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba4b55-bfac-4e64-939b-ea5d47473351 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:38.490531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c9641-665b-4921-956d-cbc1ffdf9647 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:38.506875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:38.529930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:38.536872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a54d3-2a7d-40bc-9544-8f1f9153bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:38.537976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a54d3-2a7d-40bc-9544-8f1f9153bf2a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:38.538466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a54d3-2a7d-40bc-9544-8f1f9153bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:38.538932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a54d3-2a7d-40bc-9544-8f1f9153bf2a None admin] PATH_INFO: `/v3/users/e346ea085a734800a092f80a2241fc50` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:38.555588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a54d3-2a7d-40bc-9544-8f1f9153bf2a None admin] RBAC: Authorizing `identity:get_user(user_id=e346ea085a734800a092f80a2241fc50)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:38.557066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a54d3-2a7d-40bc-9544-8f1f9153bf2a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:38.563125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 133/281] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:38 2022] GET /identity/v3/users/e346ea085a734800a092f80a2241fc50 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:38.563125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7db3da-69e2-45b5-87fb-95d07dcaf8c3 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:38.563125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7db3da-69e2-45b5-87fb-95d07dcaf8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:38.563125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7db3da-69e2-45b5-87fb-95d07dcaf8c3 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:38.563125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 134/282] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:38.567400 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7db3da-69e2-45b5-87fb-95d07dcaf8c3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:38.603801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba4b55-bfac-4e64-939b-ea5d47473351 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:38.640284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251b75-a88f-43c2-8a6b-677b884f4cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:38.640894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251b75-a88f-43c2-8a6b-677b884f4cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:38.641166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251b75-a88f-43c2-8a6b-677b884f4cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:38.641434 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251b75-a88f-43c2-8a6b-677b884f4cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:38.642092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64251b75-a88f-43c2-8a6b-677b884f4cb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:38.642389 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64251b75-a88f-43c2-8a6b-677b884f4cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:38.644402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64251b75-a88f-43c2-8a6b-677b884f4cb2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:38.652943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 149/283] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:38.654128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ac012-7dcd-4dec-9292-5a046f5ab8a2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:38.654405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ac012-7dcd-4dec-9292-5a046f5ab8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:38.654670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ac012-7dcd-4dec-9292-5a046f5ab8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:38.674706 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-564ac012-7dcd-4dec-9292-5a046f5ab8a2 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:38.675924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-564ac012-7dcd-4dec-9292-5a046f5ab8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:38.679431 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7db3da-69e2-45b5-87fb-95d07dcaf8c3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:38.725895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35aa793-1b08-4963-b9c0-475520f1cd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:38.725895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aa793-1b08-4963-b9c0-475520f1cd7b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:38.726142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aa793-1b08-4963-b9c0-475520f1cd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:38.726361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aa793-1b08-4963-b9c0-475520f1cd7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:38.727073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35aa793-1b08-4963-b9c0-475520f1cd7b None admin] RBAC: Adding query filter params (role.id=8823542b01ef4a6ca68c563ef700d59d, user.id=e346ea085a734800a092f80a2241fc50, scope.system=all) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:38.727410 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35aa793-1b08-4963-b9c0-475520f1cd7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:38.728832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35aa793-1b08-4963-b9c0-475520f1cd7b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:38.736069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 135/284] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Aug 7 22:19:38 2022] GET /identity/v3/role_assignments?user.id=e346ea085a734800a092f80a2241fc50&scope.system=all&role.id=8823542b01ef4a6ca68c563ef700d59d => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:38.737039 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35aa793-1b08-4963-b9c0-475520f1cd7b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:38.765653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 150/285] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:38.792924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ac012-7dcd-4dec-9292-5a046f5ab8a2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:38.810947 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:38.823766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:38.873884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35aa793-1b08-4963-b9c0-475520f1cd7b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:38.928045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783e914-a138-4b93-9619-89729f98a66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:38.929021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783e914-a138-4b93-9619-89729f98a66f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:38.929365 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783e914-a138-4b93-9619-89729f98a66f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:38.929705 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783e914-a138-4b93-9619-89729f98a66f None admin] PATH_INFO: `/v3/users/6e9b22694b5f41a582d1380ce8eb848d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:38.931593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783e914-a138-4b93-9619-89729f98a66f None admin] RBAC: Authorizing `identity:get_user(user_id=6e9b22694b5f41a582d1380ce8eb848d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:38.933757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783e914-a138-4b93-9619-89729f98a66f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:38.935875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 136/286] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:38 2022] GET /identity/v3/users/6e9b22694b5f41a582d1380ce8eb848d => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:38.936667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ac012-7dcd-4dec-9292-5a046f5ab8a2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:38.941903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783e914-a138-4b93-9619-89729f98a66f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:38.991904 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d277d9-99d2-4afe-881f-ef07f5bba300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:38.992780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d277d9-99d2-4afe-881f-ef07f5bba300 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:38.993255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d277d9-99d2-4afe-881f-ef07f5bba300 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:38.994104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d277d9-99d2-4afe-881f-ef07f5bba300 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:39.022815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d277d9-99d2-4afe-881f-ef07f5bba300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-e1d277d9-99d2-4afe-881f-ef07f5bba300 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:39.030198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:39.031289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:39.032228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 151/287] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:19:39.037986 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d277d9-99d2-4afe-881f-ef07f5bba300 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:39.130969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783e914-a138-4b93-9619-89729f98a66f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:39.168880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:39.182060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf71e47-12bd-4515-9c3d-de16aaab9b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:39.182883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf71e47-12bd-4515-9c3d-de16aaab9b85 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:39.183317 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf71e47-12bd-4515-9c3d-de16aaab9b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:39.183739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf71e47-12bd-4515-9c3d-de16aaab9b85 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:39.185039 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf71e47-12bd-4515-9c3d-de16aaab9b85 None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:39.186653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf71e47-12bd-4515-9c3d-de16aaab9b85 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:39.188836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 137/288] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:38 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:39.196818 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf71e47-12bd-4515-9c3d-de16aaab9b85 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:39.212897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:39.241692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d277d9-99d2-4afe-881f-ef07f5bba300 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:39.296975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4f3b-e2ed-4d06-90c0-7904bf45bf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:39.297582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4f3b-e2ed-4d06-90c0-7904bf45bf7a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:39.297852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4f3b-e2ed-4d06-90c0-7904bf45bf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:39.298114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4f3b-e2ed-4d06-90c0-7904bf45bf7a None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:39.298826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4f3b-e2ed-4d06-90c0-7904bf45bf7a None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:39.299140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4f3b-e2ed-4d06-90c0-7904bf45bf7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:39.300496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4f3b-e2ed-4d06-90c0-7904bf45bf7a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:39.320694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 152/289] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:39.327228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4f3b-e2ed-4d06-90c0-7904bf45bf7a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:39.352382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf71e47-12bd-4515-9c3d-de16aaab9b85 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:39.415106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a98e12-f2b9-4545-a670-3983ab6a14d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:39.416131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a98e12-f2b9-4545-a670-3983ab6a14d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:39.416621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a98e12-f2b9-4545-a670-3983ab6a14d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:39.417083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a98e12-f2b9-4545-a670-3983ab6a14d9 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80/users/6e9b22694b5f41a582d1380ce8eb848d/roles/14ade4f163274596811571bcb806cb12` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:39.419241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a98e12-f2b9-4545-a670-3983ab6a14d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=032c8fa1940c4117b584aca3ab1e4b80, user_id=6e9b22694b5f41a582d1380ce8eb848d, role_id=14ade4f163274596811571bcb806cb12)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:39.420895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a98e12-f2b9-4545-a670-3983ab6a14d9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:39.442554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 138/290] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:19:39 2022] PUT /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80/users/6e9b22694b5f41a582d1380ce8eb848d/roles/14ade4f163274596811571bcb806cb12 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:39.479023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4f3b-e2ed-4d06-90c0-7904bf45bf7a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:39.535926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aaab6b-1e23-451f-ba0b-383c97be8a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:39.537376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaab6b-1e23-451f-ba0b-383c97be8a7f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:39.537880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaab6b-1e23-451f-ba0b-383c97be8a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:39.538346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaab6b-1e23-451f-ba0b-383c97be8a7f None admin] PATH_INFO: `/v3/users/b670dcc05c8f46d78f9c6a350bd82f0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:39.541813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aaab6b-1e23-451f-ba0b-383c97be8a7f None admin] RBAC: Authorizing `identity:get_user(user_id=b670dcc05c8f46d78f9c6a350bd82f0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:39.543640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aaab6b-1e23-451f-ba0b-383c97be8a7f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:39.545947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 153/291] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:39 2022] GET /identity/v3/users/b670dcc05c8f46d78f9c6a350bd82f0b => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:39.551748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a98e12-f2b9-4545-a670-3983ab6a14d9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:39.627510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:39.685119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a98e12-f2b9-4545-a670-3983ab6a14d9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:39.723489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21150-54fa-40d4-a627-9aefbfdb562d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:39.724095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21150-54fa-40d4-a627-9aefbfdb562d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:39.724369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21150-54fa-40d4-a627-9aefbfdb562d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:39.724637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21150-54fa-40d4-a627-9aefbfdb562d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:39.800974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c21150-54fa-40d4-a627-9aefbfdb562d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:39.802503 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c21150-54fa-40d4-a627-9aefbfdb562d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:39.869237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:39.935934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 139/292] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:39.941417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aaab6b-1e23-451f-ba0b-383c97be8a7f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:39.958644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:40.077453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aaab6b-1e23-451f-ba0b-383c97be8a7f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:40.131801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d194f-ffa0-4f87-850b-7709a873edc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:40.132444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d194f-ffa0-4f87-850b-7709a873edc4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:40.132721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d194f-ffa0-4f87-850b-7709a873edc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:40.132993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d194f-ffa0-4f87-850b-7709a873edc4 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:40.134167 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d194f-ffa0-4f87-850b-7709a873edc4 None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:40.135624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d194f-ffa0-4f87-850b-7709a873edc4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:40.137485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 154/293] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:39 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:40.143643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21150-54fa-40d4-a627-9aefbfdb562d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:40.269995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21150-54fa-40d4-a627-9aefbfdb562d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:40.319048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285f31b-a6ac-4768-ba85-120e53d9c2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:40.319685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285f31b-a6ac-4768-ba85-120e53d9c2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:40.319968 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285f31b-a6ac-4768-ba85-120e53d9c2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:40.320236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285f31b-a6ac-4768-ba85-120e53d9c2b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:40.320964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285f31b-a6ac-4768-ba85-120e53d9c2b7 None admin] RBAC: Adding query filter params (role.id=8823542b01ef4a6ca68c563ef700d59d, scope.project.id=032c8fa1940c4117b584aca3ab1e4b80, user.id=b670dcc05c8f46d78f9c6a350bd82f0b) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:40.321266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285f31b-a6ac-4768-ba85-120e53d9c2b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:40.322697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285f31b-a6ac-4768-ba85-120e53d9c2b7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:40.328785 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 140/294] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:40 2022] GET /identity/v3/role_assignments?user.id=b670dcc05c8f46d78f9c6a350bd82f0b&scope.project.id=032c8fa1940c4117b584aca3ab1e4b80&role.id=8823542b01ef4a6ca68c563ef700d59d => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:40.866090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54f0bb-d318-46df-84d0-4c8580e707b0 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:40.866597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54f0bb-d318-46df-84d0-4c8580e707b0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:40.866597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54f0bb-d318-46df-84d0-4c8580e707b0 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:40.868125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 155/295] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:40.873217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b599-3355-4d23-80e2-367ed459eaa6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:40.873643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b599-3355-4d23-80e2-367ed459eaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:40.873821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b599-3355-4d23-80e2-367ed459eaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:40.894795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6073b599-3355-4d23-80e2-367ed459eaa6 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:40.897020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6073b599-3355-4d23-80e2-367ed459eaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:40.907345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:40.969916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 141/296] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:40.987638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1890b-deee-4418-a9a3-6509701fd920 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:40.987925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1890b-deee-4418-a9a3-6509701fd920 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:40.988253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1890b-deee-4418-a9a3-6509701fd920 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:40.989783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 156/297] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:40.999152 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736df19e-f8de-4394-9172-a892ac7d70bb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:40.999152 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736df19e-f8de-4394-9172-a892ac7d70bb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:40.999152 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736df19e-f8de-4394-9172-a892ac7d70bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:40.999661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1890b-deee-4418-a9a3-6509701fd920 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:41.015187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-736df19e-f8de-4394-9172-a892ac7d70bb None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:41.016376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-736df19e-f8de-4394-9172-a892ac7d70bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:41.092124 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 142/298] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:41.103445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:41.114937 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736df19e-f8de-4394-9172-a892ac7d70bb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:41.124976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1890b-deee-4418-a9a3-6509701fd920 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:41.167832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99ad6f-bf48-4fab-8325-1f380704e9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:41.168458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99ad6f-bf48-4fab-8325-1f380704e9bc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:41.168759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99ad6f-bf48-4fab-8325-1f380704e9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:41.169000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99ad6f-bf48-4fab-8325-1f380704e9bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:41.170091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99ad6f-bf48-4fab-8325-1f380704e9bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:41.171558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99ad6f-bf48-4fab-8325-1f380704e9bc None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:41.173294 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 157/299] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:41.174344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61006aec-ee01-47f5-84db-8375919c9f7c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:41.174625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61006aec-ee01-47f5-84db-8375919c9f7c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:41.174894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61006aec-ee01-47f5-84db-8375919c9f7c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:41.176265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 158/300] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:41.180963 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61006aec-ee01-47f5-84db-8375919c9f7c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:41.199823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:41.229036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736df19e-f8de-4394-9172-a892ac7d70bb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:41.264195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b09e9-77b1-4779-8567-5f160f610f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:41.264809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b09e9-77b1-4779-8567-5f160f610f1c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:41.265087 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b09e9-77b1-4779-8567-5f160f610f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:41.265354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b09e9-77b1-4779-8567-5f160f610f1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:41.276304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b09e9-77b1-4779-8567-5f160f610f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1c2b09e9-77b1-4779-8567-5f160f610f1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:41.281042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:41.281902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:41.282691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 143/301] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:19:41.288271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e3d47-9a7a-4ef8-894b-1e172e1f5535 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:41.288557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e3d47-9a7a-4ef8-894b-1e172e1f5535 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:41.288814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e3d47-9a7a-4ef8-894b-1e172e1f5535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:41.291868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61006aec-ee01-47f5-84db-8375919c9f7c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:41.306124 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-872e3d47-9a7a-4ef8-894b-1e172e1f5535 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:41.307307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-872e3d47-9a7a-4ef8-894b-1e172e1f5535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:41.325492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c899c-7d3c-4779-bf68-5de72058240e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:41.326106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c899c-7d3c-4779-bf68-5de72058240e None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:41.326385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c899c-7d3c-4779-bf68-5de72058240e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:41.326709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c899c-7d3c-4779-bf68-5de72058240e None admin] PATH_INFO: `/v3/groups` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:41.327359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c899c-7d3c-4779-bf68-5de72058240e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:41.328780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c899c-7d3c-4779-bf68-5de72058240e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:41.345883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 159/302] 10.222.0.15 () {60 vars in 1134 bytes} [Sun Aug 7 22:19:41 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:19:41.346976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c899c-7d3c-4779-bf68-5de72058240e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:41.362647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:41.405306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 144/303] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:41.430476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e3d47-9a7a-4ef8-894b-1e172e1f5535 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:41.498735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c899c-7d3c-4779-bf68-5de72058240e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:41.514929 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:41.544317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4cdeb-1a1f-4b26-9195-0603a96ad14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:41.545086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4cdeb-1a1f-4b26-9195-0603a96ad14d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:41.545366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4cdeb-1a1f-4b26-9195-0603a96ad14d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:41.545646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4cdeb-1a1f-4b26-9195-0603a96ad14d None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:41.546313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4cdeb-1a1f-4b26-9195-0603a96ad14d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:41.546619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4cdeb-1a1f-4b26-9195-0603a96ad14d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:41.548028 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4cdeb-1a1f-4b26-9195-0603a96ad14d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:41.557744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 160/304] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:41.563441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4cdeb-1a1f-4b26-9195-0603a96ad14d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:41.565242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e3d47-9a7a-4ef8-894b-1e172e1f5535 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:41.607176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423015e9-9c7b-4bb0-8ac4-6f63471ae9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:41.608707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423015e9-9c7b-4bb0-8ac4-6f63471ae9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:41.609572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423015e9-9c7b-4bb0-8ac4-6f63471ae9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:41.610180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423015e9-9c7b-4bb0-8ac4-6f63471ae9c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:41.625317 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423015e9-9c7b-4bb0-8ac4-6f63471ae9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-423015e9-9c7b-4bb0-8ac4-6f63471ae9c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:41.632863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:41.633716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:41.634521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:41.634521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:41.634521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:41.634521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:41.634521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:41.634521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:41.634521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:41.634521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:41.634521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:41.634521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:41.634521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:41.634521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:41.636462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 145/305] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:19:41.637947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:41.644626 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423015e9-9c7b-4bb0-8ac4-6f63471ae9c5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:41.676728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4cdeb-1a1f-4b26-9195-0603a96ad14d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:41.724417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759b056-6831-45ff-82cf-ccf48adf4c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:41.725058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759b056-6831-45ff-82cf-ccf48adf4c6d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:41.725585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759b056-6831-45ff-82cf-ccf48adf4c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:41.725864 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759b056-6831-45ff-82cf-ccf48adf4c6d None admin] PATH_INFO: `/v3/users/804888b20fc94710aed8b65932c8f655` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:41.747410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759b056-6831-45ff-82cf-ccf48adf4c6d None admin] RBAC: Authorizing `identity:get_user(user_id=804888b20fc94710aed8b65932c8f655)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:41.749851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759b056-6831-45ff-82cf-ccf48adf4c6d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:41.752425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 161/306] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:41 2022] GET /identity/v3/users/804888b20fc94710aed8b65932c8f655 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:41.757720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759b056-6831-45ff-82cf-ccf48adf4c6d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:41.772023 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423015e9-9c7b-4bb0-8ac4-6f63471ae9c5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:41.796869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:41.808549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67c694-fd3f-4fba-a6f3-6ffaf8bcb3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:41.809157 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67c694-fd3f-4fba-a6f3-6ffaf8bcb3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:41.809438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67c694-fd3f-4fba-a6f3-6ffaf8bcb3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:41.809713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67c694-fd3f-4fba-a6f3-6ffaf8bcb3d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:41.810372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67c694-fd3f-4fba-a6f3-6ffaf8bcb3d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:41.810675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67c694-fd3f-4fba-a6f3-6ffaf8bcb3d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:41.812151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67c694-fd3f-4fba-a6f3-6ffaf8bcb3d9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:41.821231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 146/307] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:41.828430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67c694-fd3f-4fba-a6f3-6ffaf8bcb3d9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:41.872926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759b056-6831-45ff-82cf-ccf48adf4c6d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:41.901997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:41.913463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022778b-e6da-47d4-a394-f1a5dfee577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:41.914318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022778b-e6da-47d4-a394-f1a5dfee577a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:41.914726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022778b-e6da-47d4-a394-f1a5dfee577a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:41.915152 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022778b-e6da-47d4-a394-f1a5dfee577a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:41.916150 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022778b-e6da-47d4-a394-f1a5dfee577a None admin] RBAC: Adding query filter params (role.id=14ade4f163274596811571bcb806cb12, user.id=804888b20fc94710aed8b65932c8f655, scope.system=all) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:41.916696 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022778b-e6da-47d4-a394-f1a5dfee577a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:41.918246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022778b-e6da-47d4-a394-f1a5dfee577a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:41.924687 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 162/308] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Aug 7 22:19:41 2022] GET /identity/v3/role_assignments?user.id=804888b20fc94710aed8b65932c8f655&scope.system=all&role.id=14ade4f163274596811571bcb806cb12 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:41.935160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67c694-fd3f-4fba-a6f3-6ffaf8bcb3d9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:41.974227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea62e58-9d15-4b57-a2e1-9c311758b74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:41.974931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea62e58-9d15-4b57-a2e1-9c311758b74a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:41.975263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea62e58-9d15-4b57-a2e1-9c311758b74a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:41.975534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea62e58-9d15-4b57-a2e1-9c311758b74a None admin] PATH_INFO: `/v3/users/e346ea085a734800a092f80a2241fc50` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:41.976712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea62e58-9d15-4b57-a2e1-9c311758b74a None admin] RBAC: Authorizing `identity:get_user(user_id=e346ea085a734800a092f80a2241fc50)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:41.978175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea62e58-9d15-4b57-a2e1-9c311758b74a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:41.980161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 147/309] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:41 2022] GET /identity/v3/users/e346ea085a734800a092f80a2241fc50 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:41.986368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022778b-e6da-47d4-a394-f1a5dfee577a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:42.109424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db57638-4c98-4110-aaff-739d20b23aac None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:42.109766 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db57638-4c98-4110-aaff-739d20b23aac None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:42.109971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db57638-4c98-4110-aaff-739d20b23aac None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:42.111521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 148/310] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:42.116443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f526140-5cfc-49f1-9f3b-ffc0b994af65 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:42.116795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f526140-5cfc-49f1-9f3b-ffc0b994af65 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:42.117134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f526140-5cfc-49f1-9f3b-ffc0b994af65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:42.121951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022778b-e6da-47d4-a394-f1a5dfee577a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:42.136435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5f526140-5cfc-49f1-9f3b-ffc0b994af65 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:42.138157 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5f526140-5cfc-49f1-9f3b-ffc0b994af65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:42.163589 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5573ba-efa0-4b6e-b030-1ff08fba2abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:42.164252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5573ba-efa0-4b6e-b030-1ff08fba2abb None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:42.164523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5573ba-efa0-4b6e-b030-1ff08fba2abb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:42.164791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5573ba-efa0-4b6e-b030-1ff08fba2abb None admin] PATH_INFO: `/v3/system/users/e346ea085a734800a092f80a2241fc50/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:42.166637 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5573ba-efa0-4b6e-b030-1ff08fba2abb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e346ea085a734800a092f80a2241fc50, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:42.168618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5573ba-efa0-4b6e-b030-1ff08fba2abb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:42.179823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 163/311] 10.222.0.15 () {58 vars in 1334 bytes} [Sun Aug 7 22:19:41 2022] PUT /identity/v3/system/users/e346ea085a734800a092f80a2241fc50/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:42.203593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:42.224397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 149/312] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:42.250004 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5573ba-efa0-4b6e-b030-1ff08fba2abb None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:42.318567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:42.370351 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5573ba-efa0-4b6e-b030-1ff08fba2abb None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:42.408992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628fe3f-c78e-460c-9274-9c26335142d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:42.409951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628fe3f-c78e-460c-9274-9c26335142d5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:42.410425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628fe3f-c78e-460c-9274-9c26335142d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:42.410879 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628fe3f-c78e-460c-9274-9c26335142d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:42.421641 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628fe3f-c78e-460c-9274-9c26335142d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-3628fe3f-c78e-460c-9274-9c26335142d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:42.427590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:42.428429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:42.429200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:42.429200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:42.429200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:42.429200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:42.429200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:42.429200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:42.429200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:42.429200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:42.429200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:42.429200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:42.429200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:42.429200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:42.431783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 164/313] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:42.438198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f526140-5cfc-49f1-9f3b-ffc0b994af65 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:42.546259 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f526140-5cfc-49f1-9f3b-ffc0b994af65 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:42.583291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464e919-c7b6-45cc-97bd-209c8637999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:42.584244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464e919-c7b6-45cc-97bd-209c8637999e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:42.584732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464e919-c7b6-45cc-97bd-209c8637999e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:42.585187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464e919-c7b6-45cc-97bd-209c8637999e None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:42.586035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464e919-c7b6-45cc-97bd-209c8637999e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:42.586540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464e919-c7b6-45cc-97bd-209c8637999e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:42.588109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464e919-c7b6-45cc-97bd-209c8637999e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:42.597547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 150/314] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:42.603302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628fe3f-c78e-460c-9274-9c26335142d5 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:42.709772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628fe3f-c78e-460c-9274-9c26335142d5 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:42.724330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:42.745954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cce30-33e0-494c-9ada-21a82081330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:42.746582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cce30-33e0-494c-9ada-21a82081330e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:42.746854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cce30-33e0-494c-9ada-21a82081330e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:42.747139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cce30-33e0-494c-9ada-21a82081330e None admin] PATH_INFO: `/v3/users/6e9b22694b5f41a582d1380ce8eb848d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:42.748284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cce30-33e0-494c-9ada-21a82081330e None admin] RBAC: Authorizing `identity:get_user(user_id=6e9b22694b5f41a582d1380ce8eb848d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:42.749974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cce30-33e0-494c-9ada-21a82081330e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:42.751571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 165/315] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:42 2022] GET /identity/v3/users/6e9b22694b5f41a582d1380ce8eb848d => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:42.757587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464e919-c7b6-45cc-97bd-209c8637999e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:42.810552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:42.867800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464e919-c7b6-45cc-97bd-209c8637999e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:42.902438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6d022-bb4b-4546-a92c-45937d5be3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:42.903105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6d022-bb4b-4546-a92c-45937d5be3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:42.903386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6d022-bb4b-4546-a92c-45937d5be3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:42.903654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6d022-bb4b-4546-a92c-45937d5be3f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:42.975304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6d022-bb4b-4546-a92c-45937d5be3f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:42.976769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6d022-bb4b-4546-a92c-45937d5be3f8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:43.024549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:43.080484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 151/316] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:43.085664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cce30-33e0-494c-9ada-21a82081330e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:43.193053 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cce30-33e0-494c-9ada-21a82081330e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:43.227291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a2500-c59c-4685-8e66-705e1c6f436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:43.227908 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a2500-c59c-4685-8e66-705e1c6f436d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:43.228180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a2500-c59c-4685-8e66-705e1c6f436d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:43.228444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a2500-c59c-4685-8e66-705e1c6f436d None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:43.229560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a2500-c59c-4685-8e66-705e1c6f436d None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:43.230978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a2500-c59c-4685-8e66-705e1c6f436d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:43.232969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 166/317] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:43 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:43.239339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6d022-bb4b-4546-a92c-45937d5be3f8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:43.343240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6d022-bb4b-4546-a92c-45937d5be3f8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:43.381667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefa4a7-9e7f-4719-a696-1efa4ee54e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:43.382283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefa4a7-9e7f-4719-a696-1efa4ee54e0c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:43.382560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefa4a7-9e7f-4719-a696-1efa4ee54e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:43.382827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefa4a7-9e7f-4719-a696-1efa4ee54e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:43.383589 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefa4a7-9e7f-4719-a696-1efa4ee54e0c None admin] RBAC: Adding query filter params (role.id=14ade4f163274596811571bcb806cb12, scope.project.id=032c8fa1940c4117b584aca3ab1e4b80, user.id=6e9b22694b5f41a582d1380ce8eb848d) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:43.383895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefa4a7-9e7f-4719-a696-1efa4ee54e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:43.385333 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefa4a7-9e7f-4719-a696-1efa4ee54e0c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:43.392324 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 152/318] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:19:43 2022] GET /identity/v3/role_assignments?user.id=6e9b22694b5f41a582d1380ce8eb848d&scope.project.id=032c8fa1940c4117b584aca3ab1e4b80&role.id=14ade4f163274596811571bcb806cb12 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:43.540978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73540397-e89c-4bcf-be99-34e3358dac44 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:43.541303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73540397-e89c-4bcf-be99-34e3358dac44 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:43.541514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73540397-e89c-4bcf-be99-34e3358dac44 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:43.542842 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 167/319] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:43.548879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc8109-67d3-45e4-8582-82848ff6e22f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:43.549164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc8109-67d3-45e4-8582-82848ff6e22f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:43.549442 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc8109-67d3-45e4-8582-82848ff6e22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:43.568519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4abc8109-67d3-45e4-8582-82848ff6e22f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:43.569745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4abc8109-67d3-45e4-8582-82848ff6e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:43.575415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:43.648407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 153/320] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:43.670494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73540397-e89c-4bcf-be99-34e3358dac44 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:43.724912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:43.777494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73540397-e89c-4bcf-be99-34e3358dac44 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:43.811039 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dae07-e9e8-4454-8227-dd40aecfb85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:43.811692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dae07-e9e8-4454-8227-dd40aecfb85d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:43.811972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dae07-e9e8-4454-8227-dd40aecfb85d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:43.812243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dae07-e9e8-4454-8227-dd40aecfb85d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:43.813336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805dae07-e9e8-4454-8227-dd40aecfb85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:43.814811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805dae07-e9e8-4454-8227-dd40aecfb85d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:43.816584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 168/321] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:19:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:43.822371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc8109-67d3-45e4-8582-82848ff6e22f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:43.923075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc8109-67d3-45e4-8582-82848ff6e22f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:43.956545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc53433-180c-49b8-8b59-d258f6ca1e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:43.957143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53433-180c-49b8-8b59-d258f6ca1e3b None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:43.957414 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53433-180c-49b8-8b59-d258f6ca1e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:43.957679 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53433-180c-49b8-8b59-d258f6ca1e3b None admin] PATH_INFO: `/v3/groups` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:43.958284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc53433-180c-49b8-8b59-d258f6ca1e3b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:43.959730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc53433-180c-49b8-8b59-d258f6ca1e3b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:43.973306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:43.983554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 154/322] 10.222.0.15 () {60 vars in 1134 bytes} [Sun Aug 7 22:19:43 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:19:44.064184 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237ffa9-e26f-4514-aad8-c612e50dfe84 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:44.065173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237ffa9-e26f-4514-aad8-c612e50dfe84 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:44.065419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237ffa9-e26f-4514-aad8-c612e50dfe84 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:44.067869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 169/323] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:44.076285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110ce5-eaec-4d7d-a952-2f42ab8c1105 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:44.076604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110ce5-eaec-4d7d-a952-2f42ab8c1105 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:44.076829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110ce5-eaec-4d7d-a952-2f42ab8c1105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:44.096070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-83110ce5-eaec-4d7d-a952-2f42ab8c1105 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:44.097283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-83110ce5-eaec-4d7d-a952-2f42ab8c1105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:44.175237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 155/324] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:44.195304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237ffa9-e26f-4514-aad8-c612e50dfe84 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:44.301694 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065a512-706f-47a6-a8fe-90d50c5f7b00 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:44.302011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065a512-706f-47a6-a8fe-90d50c5f7b00 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:44.302245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065a512-706f-47a6-a8fe-90d50c5f7b00 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:44.303661 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 156/325] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:19:44.309122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba936e-7f83-4f70-ad28-efd8459a760d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:44.309786 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba936e-7f83-4f70-ad28-efd8459a760d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:44.310143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba936e-7f83-4f70-ad28-efd8459a760d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:44.313319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237ffa9-e26f-4514-aad8-c612e50dfe84 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:44.331211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-07ba936e-7f83-4f70-ad28-efd8459a760d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:44.332747 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-07ba936e-7f83-4f70-ad28-efd8459a760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:44.334020 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:44.357098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af54db-1d27-44d0-bcde-36e2744e451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:44.357720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af54db-1d27-44d0-bcde-36e2744e451e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:44.357992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af54db-1d27-44d0-bcde-36e2744e451e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:44.358287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af54db-1d27-44d0-bcde-36e2744e451e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:44.376480 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af54db-1d27-44d0-bcde-36e2744e451e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-75af54db-1d27-44d0-bcde-36e2744e451e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:44.381247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:44.382132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:44.382915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 170/326] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:44.388608 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af54db-1d27-44d0-bcde-36e2744e451e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:44.422409 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 157/327] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:44.452407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba936e-7f83-4f70-ad28-efd8459a760d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:44.508276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af54db-1d27-44d0-bcde-36e2744e451e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:44.535216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:44.558815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d87c7-46a4-4ff1-997d-571d6109e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:44.559453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d87c7-46a4-4ff1-997d-571d6109e435 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:44.560061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d87c7-46a4-4ff1-997d-571d6109e435 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:44.560354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d87c7-46a4-4ff1-997d-571d6109e435 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:44.561027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d87c7-46a4-4ff1-997d-571d6109e435 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:44.561635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d87c7-46a4-4ff1-997d-571d6109e435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:44.564128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d87c7-46a4-4ff1-997d-571d6109e435 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:44.578277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 171/328] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:44.584352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d87c7-46a4-4ff1-997d-571d6109e435 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:44.592753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba936e-7f83-4f70-ad28-efd8459a760d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:44.646619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:44.647638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb13f64-6407-4e2f-8eff-f4aec3bc5940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:44.648858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb13f64-6407-4e2f-8eff-f4aec3bc5940 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:44.649690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb13f64-6407-4e2f-8eff-f4aec3bc5940 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:44.650187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb13f64-6407-4e2f-8eff-f4aec3bc5940 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:44.666510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb13f64-6407-4e2f-8eff-f4aec3bc5940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0eb13f64-6407-4e2f-8eff-f4aec3bc5940 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:44.673582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:44.674684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:44.675607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:44.675607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:44.675607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:44.675607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:44.675607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:44.675607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:44.675607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:44.675607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:44.675607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:44.675607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:44.675607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:44.675607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:44.680797 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 158/329] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:44.686095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb13f64-6407-4e2f-8eff-f4aec3bc5940 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:44.732738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d87c7-46a4-4ff1-997d-571d6109e435 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:44.777784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd47dc3-38db-4bee-8564-c8ae1b7e1be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:44.778831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd47dc3-38db-4bee-8564-c8ae1b7e1be8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:44.779364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd47dc3-38db-4bee-8564-c8ae1b7e1be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:44.779856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd47dc3-38db-4bee-8564-c8ae1b7e1be8 None admin] PATH_INFO: `/v3/users/804888b20fc94710aed8b65932c8f655` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:44.782095 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd47dc3-38db-4bee-8564-c8ae1b7e1be8 None admin] RBAC: Authorizing `identity:get_user(user_id=804888b20fc94710aed8b65932c8f655)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:44.788794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd47dc3-38db-4bee-8564-c8ae1b7e1be8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:44.795209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 172/330] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:44 2022] GET /identity/v3/users/804888b20fc94710aed8b65932c8f655 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:44.797029 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd47dc3-38db-4bee-8564-c8ae1b7e1be8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:44.818283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb13f64-6407-4e2f-8eff-f4aec3bc5940 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:44.846249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:44.877250 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127977a-6d59-4f10-8b63-9709c56cb506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:44.878160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127977a-6d59-4f10-8b63-9709c56cb506 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:44.878613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127977a-6d59-4f10-8b63-9709c56cb506 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:44.879095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127977a-6d59-4f10-8b63-9709c56cb506 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:44.879940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127977a-6d59-4f10-8b63-9709c56cb506 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:44.880451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127977a-6d59-4f10-8b63-9709c56cb506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:44.882174 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127977a-6d59-4f10-8b63-9709c56cb506 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:44.903262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 159/331] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:44.909430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127977a-6d59-4f10-8b63-9709c56cb506 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:44.918252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd47dc3-38db-4bee-8564-c8ae1b7e1be8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:44.943561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:44.957963 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb34022-329d-4c77-9b3d-8a13f30e9464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:44.958751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb34022-329d-4c77-9b3d-8a13f30e9464 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:44.959173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb34022-329d-4c77-9b3d-8a13f30e9464 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:44.959521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb34022-329d-4c77-9b3d-8a13f30e9464 None admin] PATH_INFO: `/v3/system/users/804888b20fc94710aed8b65932c8f655/roles/14ade4f163274596811571bcb806cb12` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:44.961090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb34022-329d-4c77-9b3d-8a13f30e9464 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=804888b20fc94710aed8b65932c8f655, role_id=14ade4f163274596811571bcb806cb12)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:44.962604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb34022-329d-4c77-9b3d-8a13f30e9464 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:44.977351 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 173/332] 10.222.0.15 () {58 vars in 1334 bytes} [Sun Aug 7 22:19:44 2022] PUT /identity/v3/system/users/804888b20fc94710aed8b65932c8f655/roles/14ade4f163274596811571bcb806cb12 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:19:45.086652 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127977a-6d59-4f10-8b63-9709c56cb506 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:45.134814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e907f-f11a-4cf6-b964-f035a59d96ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:45.135494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e907f-f11a-4cf6-b964-f035a59d96ad None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:45.135768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e907f-f11a-4cf6-b964-f035a59d96ad None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:45.136036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e907f-f11a-4cf6-b964-f035a59d96ad None admin] PATH_INFO: `/v3/users/e346ea085a734800a092f80a2241fc50` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:45.137235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e907f-f11a-4cf6-b964-f035a59d96ad None admin] RBAC: Authorizing `identity:get_user(user_id=e346ea085a734800a092f80a2241fc50)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:45.138816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e907f-f11a-4cf6-b964-f035a59d96ad None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:45.140980 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 160/333] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:44 2022] GET /identity/v3/users/e346ea085a734800a092f80a2241fc50 => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:45.148991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb34022-329d-4c77-9b3d-8a13f30e9464 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:45.273539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb34022-329d-4c77-9b3d-8a13f30e9464 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:45.309811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354e685-e258-4c4f-9ecc-8c6bc6b3d51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:45.310418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354e685-e258-4c4f-9ecc-8c6bc6b3d51d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:45.310695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354e685-e258-4c4f-9ecc-8c6bc6b3d51d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:45.310963 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354e685-e258-4c4f-9ecc-8c6bc6b3d51d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:45.311710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354e685-e258-4c4f-9ecc-8c6bc6b3d51d None admin] RBAC: Adding query filter params (role.id=8823542b01ef4a6ca68c563ef700d59d, user.id=e346ea085a734800a092f80a2241fc50, scope.system=all) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:45.312014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354e685-e258-4c4f-9ecc-8c6bc6b3d51d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:45.313513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354e685-e258-4c4f-9ecc-8c6bc6b3d51d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:45.328494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 174/334] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Aug 7 22:19:45 2022] GET /identity/v3/role_assignments?user.id=e346ea085a734800a092f80a2241fc50&scope.system=all&role.id=8823542b01ef4a6ca68c563ef700d59d => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:46.718771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eea9e-d250-454a-bf57-7863da8a8579 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:46.719511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eea9e-d250-454a-bf57-7863da8a8579 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:46.719511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eea9e-d250-454a-bf57-7863da8a8579 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:46.721242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 161/335] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:46.726501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5b372-d486-4353-8557-dfac269b5a3e None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:46.727008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5b372-d486-4353-8557-dfac269b5a3e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:46.727206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5b372-d486-4353-8557-dfac269b5a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:46.750092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c6c5b372-d486-4353-8557-dfac269b5a3e None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:46.751352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c6c5b372-d486-4353-8557-dfac269b5a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:46.783589 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:46.836169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 175/336] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:46.862775 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eea9e-d250-454a-bf57-7863da8a8579 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:46.920644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:46.952272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a24523-5f17-442d-a532-f8c1f3a2ef8e None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:46.952884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a24523-5f17-442d-a532-f8c1f3a2ef8e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:46.953366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a24523-5f17-442d-a532-f8c1f3a2ef8e None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:46.956559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 176/337] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:19:46.964820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0dd13-5380-4870-a473-025f16532a96 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:46.965435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0dd13-5380-4870-a473-025f16532a96 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:46.966022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0dd13-5380-4870-a473-025f16532a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:46.990529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eea9e-d250-454a-bf57-7863da8a8579 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:47.007620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3db0dd13-5380-4870-a473-025f16532a96 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:47.008794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3db0dd13-5380-4870-a473-025f16532a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:47.066262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a2873-5080-425b-82ef-b7810452e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:47.066901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a2873-5080-425b-82ef-b7810452e5ab None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:47.067197 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a2873-5080-425b-82ef-b7810452e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:47.067466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a2873-5080-425b-82ef-b7810452e5ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:47.084699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a2873-5080-425b-82ef-b7810452e5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-136a2873-5080-425b-82ef-b7810452e5ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:47.092891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:47.094025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:47.094835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:47.094835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:47.094835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:47.094835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:47.094835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:47.094835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:47.094835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:47.094835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:47.094835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:47.094835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:47.094835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:47.094835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:47.104231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 162/338] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:47.114146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553cb58-1f42-43f4-9817-854a3ff32eef None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:47.114677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553cb58-1f42-43f4-9817-854a3ff32eef None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:47.115111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553cb58-1f42-43f4-9817-854a3ff32eef None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:47.116604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 163/339] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:19:47.117535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553cb58-1f42-43f4-9817-854a3ff32eef None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:47.157201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 177/340] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:47.159586 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b6bc1-5422-4fec-ad14-ca423e16e4d2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:47.160240 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b6bc1-5422-4fec-ad14-ca423e16e4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:47.162599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b6bc1-5422-4fec-ad14-ca423e16e4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:47.197572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-882b6bc1-5422-4fec-ad14-ca423e16e4d2 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:47.199922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-882b6bc1-5422-4fec-ad14-ca423e16e4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:47.304369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553cb58-1f42-43f4-9817-854a3ff32eef None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:47.332940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 178/341] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:47.333423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:47.333897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b6bc1-5422-4fec-ad14-ca423e16e4d2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:47.370834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebc6bc-6670-45ab-8830-c27c66d7579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:47.371453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebc6bc-6670-45ab-8830-c27c66d7579b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:47.371936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebc6bc-6670-45ab-8830-c27c66d7579b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:47.372821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebc6bc-6670-45ab-8830-c27c66d7579b None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:47.373743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebc6bc-6670-45ab-8830-c27c66d7579b None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:47.374178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebc6bc-6670-45ab-8830-c27c66d7579b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:47.375423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:47.376179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebc6bc-6670-45ab-8830-c27c66d7579b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:47.389560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 164/342] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:47.393919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebc6bc-6670-45ab-8830-c27c66d7579b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:47.514350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b6bc1-5422-4fec-ad14-ca423e16e4d2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:47.550910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bd389-6a81-4456-9675-310af975a138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:47.551828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bd389-6a81-4456-9675-310af975a138 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:47.552241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bd389-6a81-4456-9675-310af975a138 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:47.552646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bd389-6a81-4456-9675-310af975a138 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:47.566073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125bd389-6a81-4456-9675-310af975a138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:47.568520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebc6bc-6670-45ab-8830-c27c66d7579b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-125bd389-6a81-4456-9675-310af975a138 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:47.572403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:47.573251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:47.574019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:47.574019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:47.574019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:47.574019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:47.574019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:47.574019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:47.574019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:47.574019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:47.574019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:47.574019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:47.574019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:47.574019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:47.576935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 179/343] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:47.577924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bd389-6a81-4456-9675-310af975a138 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:47.629189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92804d48-72e9-4259-88c2-fd68e180bdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:47.629819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92804d48-72e9-4259-88c2-fd68e180bdfe None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:47.630093 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92804d48-72e9-4259-88c2-fd68e180bdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:47.630360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92804d48-72e9-4259-88c2-fd68e180bdfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:47.652150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92804d48-72e9-4259-88c2-fd68e180bdfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-92804d48-72e9-4259-88c2-fd68e180bdfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:47.657231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:47.658911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:47.663885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:47.663885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:47.663885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:47.663885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:47.663885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:47.663885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:47.663885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:47.663885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:47.663885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:47.663885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:47.663885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:47.663885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:47.666021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 165/344] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:19:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:47.667016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92804d48-72e9-4259-88c2-fd68e180bdfe None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:47.672014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:47.688920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bd389-6a81-4456-9675-310af975a138 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:47.733347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47f6ea-c748-45cb-8c07-9d2b004ce094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:47.733964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47f6ea-c748-45cb-8c07-9d2b004ce094 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:47.734707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47f6ea-c748-45cb-8c07-9d2b004ce094 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:47.734982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47f6ea-c748-45cb-8c07-9d2b004ce094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:47.744617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:47.821259 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47f6ea-c748-45cb-8c07-9d2b004ce094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:47.822890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47f6ea-c748-45cb-8c07-9d2b004ce094 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:47.896726 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92804d48-72e9-4259-88c2-fd68e180bdfe None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:47.945117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ce25b-822b-46eb-9d03-d51a2ff78932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:47.945717 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ce25b-822b-46eb-9d03-d51a2ff78932 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:47.945989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ce25b-822b-46eb-9d03-d51a2ff78932 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:47.946305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ce25b-822b-46eb-9d03-d51a2ff78932 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:47.946973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ce25b-822b-46eb-9d03-d51a2ff78932 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:47.947313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ce25b-822b-46eb-9d03-d51a2ff78932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:47.948665 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ce25b-822b-46eb-9d03-d51a2ff78932 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:47.957782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 166/345] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:47.958479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ce25b-822b-46eb-9d03-d51a2ff78932 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:47.962981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:48.011766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 180/346] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:48.012951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47f6ea-c748-45cb-8c07-9d2b004ce094 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:48.068955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:48.079178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ce25b-822b-46eb-9d03-d51a2ff78932 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:48.114875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2036e39-a1f3-4c56-bc2b-6675077c8ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:48.115537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2036e39-a1f3-4c56-bc2b-6675077c8ced None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:48.115817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2036e39-a1f3-4c56-bc2b-6675077c8ced None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:48.116090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2036e39-a1f3-4c56-bc2b-6675077c8ced None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:48.116823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2036e39-a1f3-4c56-bc2b-6675077c8ced None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:48.117129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2036e39-a1f3-4c56-bc2b-6675077c8ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:48.118609 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2036e39-a1f3-4c56-bc2b-6675077c8ced None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:48.128763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 167/347] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:19:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:48.129858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2036e39-a1f3-4c56-bc2b-6675077c8ced None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:48.183538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47f6ea-c748-45cb-8c07-9d2b004ce094 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:48.221902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99c7ed-8a48-43d1-b7a8-9d39281db5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:48.222776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99c7ed-8a48-43d1-b7a8-9d39281db5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:48.223221 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99c7ed-8a48-43d1-b7a8-9d39281db5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:48.223630 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99c7ed-8a48-43d1-b7a8-9d39281db5c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:48.238327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2036e39-a1f3-4c56-bc2b-6675077c8ced None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:48.273933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673b753-56c7-4012-a6e9-1d3fac14943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:48.274928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673b753-56c7-4012-a6e9-1d3fac14943e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:48.275403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673b753-56c7-4012-a6e9-1d3fac14943e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:48.275847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673b753-56c7-4012-a6e9-1d3fac14943e None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:48.276806 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:48.278230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673b753-56c7-4012-a6e9-1d3fac14943e None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:48.280065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673b753-56c7-4012-a6e9-1d3fac14943e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:48.283688 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 168/348] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:48 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:48.285656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673b753-56c7-4012-a6e9-1d3fac14943e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:48.297654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99c7ed-8a48-43d1-b7a8-9d39281db5c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:48.300802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99c7ed-8a48-43d1-b7a8-9d39281db5c8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:48.328170 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:48.403032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673b753-56c7-4012-a6e9-1d3fac14943e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:48.406248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 181/349] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:48.411863 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13135377-bafd-4e1f-a98e-a60eb4212ad3 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:48.412150 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13135377-bafd-4e1f-a98e-a60eb4212ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:48.412426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13135377-bafd-4e1f-a98e-a60eb4212ad3 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:48.413746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 182/350] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:48.414640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13135377-bafd-4e1f-a98e-a60eb4212ad3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:48.442116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f37584-f66e-4174-a4ae-37c53b77e9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:48.442868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f37584-f66e-4174-a4ae-37c53b77e9ba None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:48.443185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f37584-f66e-4174-a4ae-37c53b77e9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:48.443456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f37584-f66e-4174-a4ae-37c53b77e9ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:48.516125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:48.525114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f37584-f66e-4174-a4ae-37c53b77e9ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:48.526979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f37584-f66e-4174-a4ae-37c53b77e9ba None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:48.546536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13135377-bafd-4e1f-a98e-a60eb4212ad3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:48.564988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:48.592162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42719c-23c1-40b4-9f16-79368a8edae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:48.592798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42719c-23c1-40b4-9f16-79368a8edae4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:48.593078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42719c-23c1-40b4-9f16-79368a8edae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:48.593350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42719c-23c1-40b4-9f16-79368a8edae4 None admin] PATH_INFO: `/v3/groups/1efb36710cd5416aaab1a2f3cdea887d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:48.601519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42719c-23c1-40b4-9f16-79368a8edae4 None admin] RBAC: Authorizing `identity:get_group(group_id=1efb36710cd5416aaab1a2f3cdea887d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:48.602965 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42719c-23c1-40b4-9f16-79368a8edae4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:48.604998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 183/351] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:48 2022] GET /identity/v3/groups/1efb36710cd5416aaab1a2f3cdea887d => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:48.605784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42719c-23c1-40b4-9f16-79368a8edae4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:48.666643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 169/352] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:48.668614 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6aa06-880c-4303-a6ed-7875f8a25484 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:48.668998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6aa06-880c-4303-a6ed-7875f8a25484 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:48.669477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6aa06-880c-4303-a6ed-7875f8a25484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:48.693399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f5d6aa06-880c-4303-a6ed-7875f8a25484 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:48.694605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f5d6aa06-880c-4303-a6ed-7875f8a25484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:48.727458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42719c-23c1-40b4-9f16-79368a8edae4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:48.767834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd77e1d-3569-4f47-bf6e-51dcda0f45c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:48.768561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd77e1d-3569-4f47-bf6e-51dcda0f45c4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:48.768739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd77e1d-3569-4f47-bf6e-51dcda0f45c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:48.768991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd77e1d-3569-4f47-bf6e-51dcda0f45c4 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:48.770104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd77e1d-3569-4f47-bf6e-51dcda0f45c4 None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:48.771579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd77e1d-3569-4f47-bf6e-51dcda0f45c4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:48.773382 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 184/353] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:48 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:48.774545 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476004-6795-4e46-8c12-63b11c904bb3 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:48.774814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476004-6795-4e46-8c12-63b11c904bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:48.775101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476004-6795-4e46-8c12-63b11c904bb3 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:48.776315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 185/354] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:48.777001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b476004-6795-4e46-8c12-63b11c904bb3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:48.780642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 170/355] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:48.781573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6aa06-880c-4303-a6ed-7875f8a25484 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:48.796844 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:48.848674 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:48.904362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6aa06-880c-4303-a6ed-7875f8a25484 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:48.909285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b476004-6795-4e46-8c12-63b11c904bb3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:48.949789 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25d7d0-3c6f-49d2-8296-f1c19a772957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:48.949972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75521182-9b8b-45e0-b768-1f18fd172490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:48.949972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75521182-9b8b-45e0-b768-1f18fd172490 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:48.950141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25d7d0-3c6f-49d2-8296-f1c19a772957 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:48.950141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25d7d0-3c6f-49d2-8296-f1c19a772957 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:48.950267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75521182-9b8b-45e0-b768-1f18fd172490 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:48.950332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25d7d0-3c6f-49d2-8296-f1c19a772957 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:48.950405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75521182-9b8b-45e0-b768-1f18fd172490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:48.950405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75521182-9b8b-45e0-b768-1f18fd172490 None admin] RBAC: Adding query filter params (group.id=1efb36710cd5416aaab1a2f3cdea887d, role.id=8823542b01ef4a6ca68c563ef700d59d, scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:48.950405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75521182-9b8b-45e0-b768-1f18fd172490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:48.950927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75521182-9b8b-45e0-b768-1f18fd172490 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:48.953213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25d7d0-3c6f-49d2-8296-f1c19a772957 None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:48.953213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25d7d0-3c6f-49d2-8296-f1c19a772957 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:48.955129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 171/356] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:48 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:48.956195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25d7d0-3c6f-49d2-8296-f1c19a772957 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:48.962946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 186/357] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 22:19:48 2022] GET /identity/v3/role_assignments?group.id=1efb36710cd5416aaab1a2f3cdea887d&scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2&role.id=8823542b01ef4a6ca68c563ef700d59d => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:48.967170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8f701-4f5a-4542-b473-d4c37a38ce3d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:48.967170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8f701-4f5a-4542-b473-d4c37a38ce3d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:48.967170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8f701-4f5a-4542-b473-d4c37a38ce3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:48.988035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b7d8f701-4f5a-4542-b473-d4c37a38ce3d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:48.989258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b7d8f701-4f5a-4542-b473-d4c37a38ce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:49.089879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25d7d0-3c6f-49d2-8296-f1c19a772957 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:49.091551 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 187/358] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:49.092814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8f701-4f5a-4542-b473-d4c37a38ce3d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:49.102414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:49.124888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:49.143401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719aecc3-9652-439b-95a4-06ac277d3a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:49.144866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719aecc3-9652-439b-95a4-06ac277d3a26 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:49.145351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719aecc3-9652-439b-95a4-06ac277d3a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:49.145833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719aecc3-9652-439b-95a4-06ac277d3a26 None admin] PATH_INFO: `/v3/groups/1efb36710cd5416aaab1a2f3cdea887d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:49.148148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719aecc3-9652-439b-95a4-06ac277d3a26 None admin] RBAC: Authorizing `identity:get_group(group_id=1efb36710cd5416aaab1a2f3cdea887d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:49.150396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719aecc3-9652-439b-95a4-06ac277d3a26 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:49.152261 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 172/359] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:48 2022] GET /identity/v3/groups/1efb36710cd5416aaab1a2f3cdea887d => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:49.154215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719aecc3-9652-439b-95a4-06ac277d3a26 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:49.210260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8f701-4f5a-4542-b473-d4c37a38ce3d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:49.255108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6db7ac-f934-41e5-9ef3-3bdd2eeb2bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:49.256114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db7ac-f934-41e5-9ef3-3bdd2eeb2bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:49.256607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db7ac-f934-41e5-9ef3-3bdd2eeb2bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:49.257507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db7ac-f934-41e5-9ef3-3bdd2eeb2bf3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:49.270307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719aecc3-9652-439b-95a4-06ac277d3a26 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:49.276483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6db7ac-f934-41e5-9ef3-3bdd2eeb2bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-3e6db7ac-f934-41e5-9ef3-3bdd2eeb2bf3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:49.280311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:49.281206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:49.282017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 188/360] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:19:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:49.283726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bf731-1ac6-47b0-95a2-fc6c9fee0f7f None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:49.283976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bf731-1ac6-47b0-95a2-fc6c9fee0f7f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:49.285087 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bf731-1ac6-47b0-95a2-fc6c9fee0f7f None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:49.288149 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 189/361] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:49.288149 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bf731-1ac6-47b0-95a2-fc6c9fee0f7f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:49.321597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd9d6c-bfe7-4021-af0b-2524e9f5a278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:49.322580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd9d6c-bfe7-4021-af0b-2524e9f5a278 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:49.322857 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd9d6c-bfe7-4021-af0b-2524e9f5a278 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:49.323322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd9d6c-bfe7-4021-af0b-2524e9f5a278 None admin] PATH_INFO: `/v3/groups/1efb36710cd5416aaab1a2f3cdea887d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:49.324696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd9d6c-bfe7-4021-af0b-2524e9f5a278 None admin] RBAC: Authorizing `identity:get_group(group_id=1efb36710cd5416aaab1a2f3cdea887d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:49.326140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd9d6c-bfe7-4021-af0b-2524e9f5a278 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:49.328960 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 173/362] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:49 2022] GET /identity/v3/groups/1efb36710cd5416aaab1a2f3cdea887d => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:49.329581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd9d6c-bfe7-4021-af0b-2524e9f5a278 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:49.377434 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:49.412770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:49.423721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bf731-1ac6-47b0-95a2-fc6c9fee0f7f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:49.468130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912ee49-4c02-4c48-b39b-d0480d7de83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:49.468715 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912ee49-4c02-4c48-b39b-d0480d7de83c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:49.468818 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd9d6c-bfe7-4021-af0b-2524e9f5a278 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:49.469047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912ee49-4c02-4c48-b39b-d0480d7de83c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:49.469251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912ee49-4c02-4c48-b39b-d0480d7de83c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:49.482365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912ee49-4c02-4c48-b39b-d0480d7de83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a912ee49-4c02-4c48-b39b-d0480d7de83c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:49.487316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:49.488185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:49.489136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 190/363] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:49.489936 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912ee49-4c02-4c48-b39b-d0480d7de83c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:49.520245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e261f4-3a5e-47d8-ac8f-d004ec65e971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:49.520448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e261f4-3a5e-47d8-ac8f-d004ec65e971 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:49.520677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e261f4-3a5e-47d8-ac8f-d004ec65e971 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:49.520934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e261f4-3a5e-47d8-ac8f-d004ec65e971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:49.521671 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e261f4-3a5e-47d8-ac8f-d004ec65e971 None admin] RBAC: Adding query filter params (group.id=1efb36710cd5416aaab1a2f3cdea887d, role.id=8823542b01ef4a6ca68c563ef700d59d, scope.project.id=032c8fa1940c4117b584aca3ab1e4b80) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:49.523662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e261f4-3a5e-47d8-ac8f-d004ec65e971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:49.523662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e261f4-3a5e-47d8-ac8f-d004ec65e971 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:49.530477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 174/364] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 22:19:49 2022] GET /identity/v3/role_assignments?group.id=1efb36710cd5416aaab1a2f3cdea887d&scope.project.id=032c8fa1940c4117b584aca3ab1e4b80&role.id=8823542b01ef4a6ca68c563ef700d59d => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:49.532284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2143c69-829d-4c82-882c-648acc3d5f4e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:49.532781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2143c69-829d-4c82-882c-648acc3d5f4e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:49.533799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2143c69-829d-4c82-882c-648acc3d5f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:49.556763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d2143c69-829d-4c82-882c-648acc3d5f4e None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:49.557992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d2143c69-829d-4c82-882c-648acc3d5f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:49.631467 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912ee49-4c02-4c48-b39b-d0480d7de83c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:49.648516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 175/365] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:49.649608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2143c69-829d-4c82-882c-648acc3d5f4e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:49.663456 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:49.679200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311d607-1dbb-46af-a8d4-26dc45d294b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:49.680236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311d607-1dbb-46af-a8d4-26dc45d294b1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:49.680716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311d607-1dbb-46af-a8d4-26dc45d294b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:49.681185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311d607-1dbb-46af-a8d4-26dc45d294b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:49.682265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311d607-1dbb-46af-a8d4-26dc45d294b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:49.682793 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311d607-1dbb-46af-a8d4-26dc45d294b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:49.684458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311d607-1dbb-46af-a8d4-26dc45d294b1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:49.701554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 191/366] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:19:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:49.702860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311d607-1dbb-46af-a8d4-26dc45d294b1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:49.716782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:49.795401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2143c69-829d-4c82-882c-648acc3d5f4e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:49.848263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311d607-1dbb-46af-a8d4-26dc45d294b1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:49.853146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca772c-6e5f-48e4-bb4e-4c73fbe69aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:49.853478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca772c-6e5f-48e4-bb4e-4c73fbe69aeb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:49.853759 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca772c-6e5f-48e4-bb4e-4c73fbe69aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:49.854028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca772c-6e5f-48e4-bb4e-4c73fbe69aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:49.854821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca772c-6e5f-48e4-bb4e-4c73fbe69aeb None admin] RBAC: Adding query filter params (group.id=1efb36710cd5416aaab1a2f3cdea887d, role.id=74caf7e4c7474d40b5657d5e42da5546, scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:49.855165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca772c-6e5f-48e4-bb4e-4c73fbe69aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:49.856608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca772c-6e5f-48e4-bb4e-4c73fbe69aeb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:49.865723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 176/367] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 22:19:49 2022] GET /identity/v3/role_assignments?group.id=1efb36710cd5416aaab1a2f3cdea887d&scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2&role.id=74caf7e4c7474d40b5657d5e42da5546 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:49.872672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca772c-6e5f-48e4-bb4e-4c73fbe69aeb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:49.918794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff80bb3-511d-4b37-a230-297c443a8747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:49.919789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff80bb3-511d-4b37-a230-297c443a8747 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:49.920368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff80bb3-511d-4b37-a230-297c443a8747 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:49.920860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff80bb3-511d-4b37-a230-297c443a8747 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:49.922975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff80bb3-511d-4b37-a230-297c443a8747 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:49.923890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff80bb3-511d-4b37-a230-297c443a8747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:49.926759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff80bb3-511d-4b37-a230-297c443a8747 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:49.947371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 192/368] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:49.948630 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff80bb3-511d-4b37-a230-297c443a8747 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:50.070450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:50.094354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca772c-6e5f-48e4-bb4e-4c73fbe69aeb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:50.113609 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:50.139140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff80bb3-511d-4b37-a230-297c443a8747 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:50.147807 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efc3f6-7f39-4bfd-b9a3-50640dba2975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:50.148718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efc3f6-7f39-4bfd-b9a3-50640dba2975 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:50.149232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efc3f6-7f39-4bfd-b9a3-50640dba2975 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:50.149703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efc3f6-7f39-4bfd-b9a3-50640dba2975 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:50.173007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71525041-59ec-41f2-ba48-4d916a3e7fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:50.173814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71525041-59ec-41f2-ba48-4d916a3e7fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:50.174092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71525041-59ec-41f2-ba48-4d916a3e7fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:50.174365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71525041-59ec-41f2-ba48-4d916a3e7fc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:50.207914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71525041-59ec-41f2-ba48-4d916a3e7fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-71525041-59ec-41f2-ba48-4d916a3e7fc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:50.218556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:50.219531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:50.220300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 193/369] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:19:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:50.221794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71525041-59ec-41f2-ba48-4d916a3e7fc7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:50.235188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efc3f6-7f39-4bfd-b9a3-50640dba2975 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:50.237089 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efc3f6-7f39-4bfd-b9a3-50640dba2975 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:50.352466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 177/370] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:50.353639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efc3f6-7f39-4bfd-b9a3-50640dba2975 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:50.379523 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:50.472592 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efc3f6-7f39-4bfd-b9a3-50640dba2975 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:50.511204 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb46e99-ebb8-429f-9f8a-4041525d8650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:50.512482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb46e99-ebb8-429f-9f8a-4041525d8650 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:50.512981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb46e99-ebb8-429f-9f8a-4041525d8650 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:50.513476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb46e99-ebb8-429f-9f8a-4041525d8650 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:50.514336 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb46e99-ebb8-429f-9f8a-4041525d8650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:50.514827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb46e99-ebb8-429f-9f8a-4041525d8650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:50.516418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb46e99-ebb8-429f-9f8a-4041525d8650 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:50.521957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71525041-59ec-41f2-ba48-4d916a3e7fc7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:50.527628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 178/371] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:50.528796 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb46e99-ebb8-429f-9f8a-4041525d8650 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:50.548673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:50.614703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a350b-cc08-4b74-927a-4712244dd0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:50.615288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a350b-cc08-4b74-927a-4712244dd0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:50.615566 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a350b-cc08-4b74-927a-4712244dd0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:50.615838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a350b-cc08-4b74-927a-4712244dd0e3 None admin] PATH_INFO: `/v3/users/804888b20fc94710aed8b65932c8f655` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:50.616985 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a350b-cc08-4b74-927a-4712244dd0e3 None admin] RBAC: Authorizing `identity:get_user(user_id=804888b20fc94710aed8b65932c8f655)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:50.618415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a350b-cc08-4b74-927a-4712244dd0e3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:50.622064 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 194/372] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:19:50 2022] GET /identity/v3/users/804888b20fc94710aed8b65932c8f655 => generated 293 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:50.622857 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a350b-cc08-4b74-927a-4712244dd0e3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:50.640030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb46e99-ebb8-429f-9f8a-4041525d8650 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:50.644004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:50.678519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae38ba-4205-4a19-aba5-7e1e4591c2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:50.679521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae38ba-4205-4a19-aba5-7e1e4591c2ca None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:50.679999 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae38ba-4205-4a19-aba5-7e1e4591c2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:50.680488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae38ba-4205-4a19-aba5-7e1e4591c2ca None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:50.686383 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae38ba-4205-4a19-aba5-7e1e4591c2ca None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:50.688071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae38ba-4205-4a19-aba5-7e1e4591c2ca None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:50.691750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 179/373] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:50 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:50.692744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae38ba-4205-4a19-aba5-7e1e4591c2ca None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:50.808722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a350b-cc08-4b74-927a-4712244dd0e3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:50.862067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0456ebb-35c4-4f47-8a49-48bc99f16103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:50.863525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0456ebb-35c4-4f47-8a49-48bc99f16103 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:50.864001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0456ebb-35c4-4f47-8a49-48bc99f16103 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:50.864465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0456ebb-35c4-4f47-8a49-48bc99f16103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:50.888032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae38ba-4205-4a19-aba5-7e1e4591c2ca None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:50.951868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470284e-f54c-4eb0-ae91-74f112c6110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:50.952844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470284e-f54c-4eb0-ae91-74f112c6110d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:50.953370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470284e-f54c-4eb0-ae91-74f112c6110d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:50.953859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470284e-f54c-4eb0-ae91-74f112c6110d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:50.954978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470284e-f54c-4eb0-ae91-74f112c6110d None admin] RBAC: Adding query filter params (role.id=14ade4f163274596811571bcb806cb12, user.id=804888b20fc94710aed8b65932c8f655, scope.system=all) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:50.955518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470284e-f54c-4eb0-ae91-74f112c6110d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:50.957134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470284e-f54c-4eb0-ae91-74f112c6110d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:50.966874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:50.972304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 180/374] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Aug 7 22:19:50 2022] GET /identity/v3/role_assignments?user.id=804888b20fc94710aed8b65932c8f655&scope.system=all&role.id=14ade4f163274596811571bcb806cb12 => generated 510 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:50.973548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470284e-f54c-4eb0-ae91-74f112c6110d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:50.999150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:51.047938 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0456ebb-35c4-4f47-8a49-48bc99f16103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:51.049959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0456ebb-35c4-4f47-8a49-48bc99f16103 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:51.129293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470284e-f54c-4eb0-ae91-74f112c6110d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:51.188918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629471d-cf95-4499-8967-a5f40a0185d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:51.189532 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629471d-cf95-4499-8967-a5f40a0185d6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:51.189809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629471d-cf95-4499-8967-a5f40a0185d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:51.190081 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629471d-cf95-4499-8967-a5f40a0185d6 None admin] PATH_INFO: `/v3/groups/1efb36710cd5416aaab1a2f3cdea887d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:51.195975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629471d-cf95-4499-8967-a5f40a0185d6 None admin] RBAC: Authorizing `identity:get_group(group_id=1efb36710cd5416aaab1a2f3cdea887d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:51.197562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629471d-cf95-4499-8967-a5f40a0185d6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:51.199811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 181/375] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:50 2022] GET /identity/v3/groups/1efb36710cd5416aaab1a2f3cdea887d => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:51.205403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629471d-cf95-4499-8967-a5f40a0185d6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:51.216201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 195/376] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:51.223797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0456ebb-35c4-4f47-8a49-48bc99f16103 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:51.334096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:51.382543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:51.401432 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629471d-cf95-4499-8967-a5f40a0185d6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:51.428031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0456ebb-35c4-4f47-8a49-48bc99f16103 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:51.478515 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acf3a1-b172-4da7-a82a-a8b22c6e3d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:51.479059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acf3a1-b172-4da7-a82a-a8b22c6e3d2a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:51.479363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acf3a1-b172-4da7-a82a-a8b22c6e3d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:51.479637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acf3a1-b172-4da7-a82a-a8b22c6e3d2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:51.480519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acf3a1-b172-4da7-a82a-a8b22c6e3d2a None admin] RBAC: Adding query filter params (group.id=1efb36710cd5416aaab1a2f3cdea887d, role.id=74caf7e4c7474d40b5657d5e42da5546, scope.project.id=032c8fa1940c4117b584aca3ab1e4b80) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:51.480801 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acf3a1-b172-4da7-a82a-a8b22c6e3d2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:51.480914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be03ea-abe2-4b0f-a7c7-4d74d126f42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:51.481482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be03ea-abe2-4b0f-a7c7-4d74d126f42f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:51.481918 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be03ea-abe2-4b0f-a7c7-4d74d126f42f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:51.482308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acf3a1-b172-4da7-a82a-a8b22c6e3d2a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:51.482468 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be03ea-abe2-4b0f-a7c7-4d74d126f42f None admin] PATH_INFO: `/v3/projects/7053e2b8fbb347c68a456428438dcda4` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:51.483813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be03ea-abe2-4b0f-a7c7-4d74d126f42f None admin] RBAC: Authorizing `identity:get_project(project_id=7053e2b8fbb347c68a456428438dcda4)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:51.485730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be03ea-abe2-4b0f-a7c7-4d74d126f42f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:51.489003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 196/377] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:51 2022] GET /identity/v3/projects/7053e2b8fbb347c68a456428438dcda4 => generated 344 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:51.494546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be03ea-abe2-4b0f-a7c7-4d74d126f42f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:51.495746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 182/378] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 22:19:51 2022] GET /identity/v3/role_assignments?group.id=1efb36710cd5416aaab1a2f3cdea887d&scope.project.id=032c8fa1940c4117b584aca3ab1e4b80&role.id=74caf7e4c7474d40b5657d5e42da5546 => generated 260 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:51.616050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be03ea-abe2-4b0f-a7c7-4d74d126f42f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:51.657347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c075d-1177-4aa5-857a-dbb726138cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:51.658311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c075d-1177-4aa5-857a-dbb726138cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:51.658728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c075d-1177-4aa5-857a-dbb726138cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:51.659163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c075d-1177-4aa5-857a-dbb726138cf7 None admin] PATH_INFO: `/v3/groups/380687ee992941a6ae5e57a0a52684e5` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:51.667260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c075d-1177-4aa5-857a-dbb726138cf7 None admin] RBAC: Authorizing `identity:get_group(group_id=380687ee992941a6ae5e57a0a52684e5)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:51.669044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c075d-1177-4aa5-857a-dbb726138cf7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:51.670944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 197/379] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:51 2022] GET /identity/v3/groups/380687ee992941a6ae5e57a0a52684e5 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:51.677584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acf3a1-b172-4da7-a82a-a8b22c6e3d2a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:51.797323 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acf3a1-b172-4da7-a82a-a8b22c6e3d2a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:51.835785 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86836429-ffb2-4851-aa66-656d77e3677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:51.836462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86836429-ffb2-4851-aa66-656d77e3677c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:51.836743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86836429-ffb2-4851-aa66-656d77e3677c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:51.837030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86836429-ffb2-4851-aa66-656d77e3677c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:51.837762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86836429-ffb2-4851-aa66-656d77e3677c None admin] RBAC: Adding query filter params (group.id=380687ee992941a6ae5e57a0a52684e5, role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=7053e2b8fbb347c68a456428438dcda4) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:51.838066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86836429-ffb2-4851-aa66-656d77e3677c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:51.839548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86836429-ffb2-4851-aa66-656d77e3677c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:51.842671 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:51.848831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41036e6d-7ef5-426a-acd0-2c4baea761b5 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:51.849108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41036e6d-7ef5-426a-acd0-2c4baea761b5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:51.849368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41036e6d-7ef5-426a-acd0-2c4baea761b5 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:51.851695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 198/380] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:19:51.854525 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 183/381] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 22:19:51 2022] GET /identity/v3/role_assignments?group.id=380687ee992941a6ae5e57a0a52684e5&scope.project.id=7053e2b8fbb347c68a456428438dcda4&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:51.857139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4860e3-5a8a-4e71-b23c-5d75cbff3bbd None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:51.857597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4860e3-5a8a-4e71-b23c-5d75cbff3bbd None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:51.858041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4860e3-5a8a-4e71-b23c-5d75cbff3bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:51.881991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3b4860e3-5a8a-4e71-b23c-5d75cbff3bbd None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:51.883901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3b4860e3-5a8a-4e71-b23c-5d75cbff3bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:51.887678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:51.983940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 199/382] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:51.989089 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633109a-5268-4430-b84a-902c600ce938 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:51.989597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633109a-5268-4430-b84a-902c600ce938 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:51.989675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633109a-5268-4430-b84a-902c600ce938 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:51.994340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 184/383] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:52.005771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872bdbc-1346-464f-8dea-722cd7d92096 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:52.006117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872bdbc-1346-464f-8dea-722cd7d92096 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:52.006319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872bdbc-1346-464f-8dea-722cd7d92096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:52.028535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633109a-5268-4430-b84a-902c600ce938 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:52.036323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5872bdbc-1346-464f-8dea-722cd7d92096 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:52.037523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5872bdbc-1346-464f-8dea-722cd7d92096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:52.129439 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 200/384] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:52.154008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872bdbc-1346-464f-8dea-722cd7d92096 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:52.239447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:52.266317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872bdbc-1346-464f-8dea-722cd7d92096 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:52.287772 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633109a-5268-4430-b84a-902c600ce938 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:52.306867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457a357-42ac-4cc3-84b8-01fb36e0e014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:52.307915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a357-42ac-4cc3-84b8-01fb36e0e014 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:52.308331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a357-42ac-4cc3-84b8-01fb36e0e014 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:52.309141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a357-42ac-4cc3-84b8-01fb36e0e014 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:52.321773 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457a357-42ac-4cc3-84b8-01fb36e0e014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-4457a357-42ac-4cc3-84b8-01fb36e0e014 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:52.326847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:52.327893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:52.328882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:52.328882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:52.328882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:52.328882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:52.328882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:52.328882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:52.328882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:52.328882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:52.328882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:52.328882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:52.328882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:52.328882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:52.331413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 201/385] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:52.337603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457a357-42ac-4cc3-84b8-01fb36e0e014 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:52.391407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99077071-319f-4b1f-8276-ca6ccf737378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:52.392355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99077071-319f-4b1f-8276-ca6ccf737378 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:52.392813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99077071-319f-4b1f-8276-ca6ccf737378 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:52.393217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99077071-319f-4b1f-8276-ca6ccf737378 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:52.415017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99077071-319f-4b1f-8276-ca6ccf737378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-99077071-319f-4b1f-8276-ca6ccf737378 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:52.425418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:52.426548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:52.427477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:52.427477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:52.427477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:52.427477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:52.427477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:52.427477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:52.427477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:52.427477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:52.427477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:52.427477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:52.427477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:52.427477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:52.428702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 185/386] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:52.437002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99077071-319f-4b1f-8276-ca6ccf737378 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:52.485379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457a357-42ac-4cc3-84b8-01fb36e0e014 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:52.521907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:52.529988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107dd29-5599-4d10-9fbf-9ed220c6a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:52.530884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107dd29-5599-4d10-9fbf-9ed220c6a20a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:52.531349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107dd29-5599-4d10-9fbf-9ed220c6a20a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:52.531787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107dd29-5599-4d10-9fbf-9ed220c6a20a None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:52.532589 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107dd29-5599-4d10-9fbf-9ed220c6a20a None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:52.533084 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107dd29-5599-4d10-9fbf-9ed220c6a20a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:52.535239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107dd29-5599-4d10-9fbf-9ed220c6a20a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:52.545016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 202/387] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:52.546578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95809d66-eda3-45e1-8dc3-d72fdd3e7cba None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:52.551473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95809d66-eda3-45e1-8dc3-d72fdd3e7cba None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:52.551776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95809d66-eda3-45e1-8dc3-d72fdd3e7cba None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:52.554803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 203/388] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:52.555508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95809d66-eda3-45e1-8dc3-d72fdd3e7cba None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:52.571214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:52.621031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99077071-319f-4b1f-8276-ca6ccf737378 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:52.662295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb8f83-53f0-4b8e-b04a-efec17e93802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:52.663286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb8f83-53f0-4b8e-b04a-efec17e93802 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:52.663757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb8f83-53f0-4b8e-b04a-efec17e93802 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:52.664239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb8f83-53f0-4b8e-b04a-efec17e93802 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:52.665095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb8f83-53f0-4b8e-b04a-efec17e93802 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:52.665583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb8f83-53f0-4b8e-b04a-efec17e93802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:52.668562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb8f83-53f0-4b8e-b04a-efec17e93802 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:52.673113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95809d66-eda3-45e1-8dc3-d72fdd3e7cba None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:52.678227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 186/389] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:52.679706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb45ab9-4dc0-4f63-9aa2-301fa53df223 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:52.680181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb45ab9-4dc0-4f63-9aa2-301fa53df223 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:52.680640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb45ab9-4dc0-4f63-9aa2-301fa53df223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:52.700002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0fb45ab9-4dc0-4f63-9aa2-301fa53df223 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:52.701598 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0fb45ab9-4dc0-4f63-9aa2-301fa53df223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:52.713086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb12d4-fd51-48c4-bff6-ec9b6b502431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:52.713767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb12d4-fd51-48c4-bff6-ec9b6b502431 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:52.714045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb12d4-fd51-48c4-bff6-ec9b6b502431 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:52.714368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb12d4-fd51-48c4-bff6-ec9b6b502431 None admin] PATH_INFO: `/v3/groups/1efb36710cd5416aaab1a2f3cdea887d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:52.715526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb12d4-fd51-48c4-bff6-ec9b6b502431 None admin] RBAC: Authorizing `identity:get_group(group_id=1efb36710cd5416aaab1a2f3cdea887d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:52.717074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb12d4-fd51-48c4-bff6-ec9b6b502431 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:52.719007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 204/390] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:52 2022] GET /identity/v3/groups/1efb36710cd5416aaab1a2f3cdea887d => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:52.723339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb12d4-fd51-48c4-bff6-ec9b6b502431 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:52.796241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 187/391] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:52.803742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:52.803968 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb45ab9-4dc0-4f63-9aa2-301fa53df223 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:52.855126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb12d4-fd51-48c4-bff6-ec9b6b502431 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:52.882313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:52.908720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13756a0c-5d47-4128-a7ad-79d214e8c5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:52.910316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13756a0c-5d47-4128-a7ad-79d214e8c5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:52.911404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13756a0c-5d47-4128-a7ad-79d214e8c5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:52.911879 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13756a0c-5d47-4128-a7ad-79d214e8c5f2 None admin] PATH_INFO: `/v3/groups/1efb36710cd5416aaab1a2f3cdea887d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:52.913533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13756a0c-5d47-4128-a7ad-79d214e8c5f2 None admin] RBAC: Authorizing `identity:get_group(group_id=1efb36710cd5416aaab1a2f3cdea887d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:52.916188 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13756a0c-5d47-4128-a7ad-79d214e8c5f2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:52.917937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 205/392] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:52 2022] GET /identity/v3/groups/1efb36710cd5416aaab1a2f3cdea887d => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:52.922568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13756a0c-5d47-4128-a7ad-79d214e8c5f2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:52.956397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb45ab9-4dc0-4f63-9aa2-301fa53df223 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:53.006907 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeb068-bf79-4355-bfaf-d3e8ad48aaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:53.007635 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeb068-bf79-4355-bfaf-d3e8ad48aaee None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:53.007845 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeb068-bf79-4355-bfaf-d3e8ad48aaee None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:53.008129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeb068-bf79-4355-bfaf-d3e8ad48aaee None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:53.009892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeb068-bf79-4355-bfaf-d3e8ad48aaee None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:53.011738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeb068-bf79-4355-bfaf-d3e8ad48aaee None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:53.014363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 188/393] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:52 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:53.015168 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeb068-bf79-4355-bfaf-d3e8ad48aaee None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:53.053266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13756a0c-5d47-4128-a7ad-79d214e8c5f2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:53.082217 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:53.092865 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31dc593-e5fc-40d6-9f74-651f6a21c5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:53.093765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dc593-e5fc-40d6-9f74-651f6a21c5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:53.094220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dc593-e5fc-40d6-9f74-651f6a21c5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:53.094635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dc593-e5fc-40d6-9f74-651f6a21c5b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:53.105961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31dc593-e5fc-40d6-9f74-651f6a21c5b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d31dc593-e5fc-40d6-9f74-651f6a21c5b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:53.112834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:53.113752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:53.114517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:53.114517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:53.114517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:53.114517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:53.114517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:53.114517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:53.114517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:53.114517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:53.114517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:53.114517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:53.114517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:53.114517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:53.116567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 206/394] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:19:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:53.117666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31dc593-e5fc-40d6-9f74-651f6a21c5b5 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:53.137044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeb068-bf79-4355-bfaf-d3e8ad48aaee None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:53.162093 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:53.177684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45181e92-0607-4b6b-afb4-61ef53bb51e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:53.178230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45181e92-0607-4b6b-afb4-61ef53bb51e4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:53.178504 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45181e92-0607-4b6b-afb4-61ef53bb51e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:53.178771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45181e92-0607-4b6b-afb4-61ef53bb51e4 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:53.180671 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45181e92-0607-4b6b-afb4-61ef53bb51e4 None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:53.182437 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45181e92-0607-4b6b-afb4-61ef53bb51e4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:53.184328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 189/395] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:53 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:53.184972 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45181e92-0607-4b6b-afb4-61ef53bb51e4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:53.241984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31dc593-e5fc-40d6-9f74-651f6a21c5b5 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:53.281003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76395cb9-753a-4f5c-9fa0-cf44f784fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:53.282129 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76395cb9-753a-4f5c-9fa0-cf44f784fdb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:53.282633 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76395cb9-753a-4f5c-9fa0-cf44f784fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:53.283717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76395cb9-753a-4f5c-9fa0-cf44f784fdb8 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80/groups/1efb36710cd5416aaab1a2f3cdea887d/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:53.285947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76395cb9-753a-4f5c-9fa0-cf44f784fdb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=032c8fa1940c4117b584aca3ab1e4b80, group_id=1efb36710cd5416aaab1a2f3cdea887d, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:53.288736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76395cb9-753a-4f5c-9fa0-cf44f784fdb8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:53.297373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45181e92-0607-4b6b-afb4-61ef53bb51e4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:53.307193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 207/396] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Aug 7 22:19:53 2022] PUT /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80/groups/1efb36710cd5416aaab1a2f3cdea887d/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:53.308836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76395cb9-753a-4f5c-9fa0-cf44f784fdb8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:53.346129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf687f3-def9-45a2-ad4c-74ac26d8e58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:53.346957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf687f3-def9-45a2-ad4c-74ac26d8e58f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:53.347272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf687f3-def9-45a2-ad4c-74ac26d8e58f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:53.347541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf687f3-def9-45a2-ad4c-74ac26d8e58f None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:53.348284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf687f3-def9-45a2-ad4c-74ac26d8e58f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:53.348566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf687f3-def9-45a2-ad4c-74ac26d8e58f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:53.350692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf687f3-def9-45a2-ad4c-74ac26d8e58f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:53.364227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 190/397] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:19:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:53.367663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf687f3-def9-45a2-ad4c-74ac26d8e58f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:53.388235 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:53.448346 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:53.468785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76395cb9-753a-4f5c-9fa0-cf44f784fdb8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:53.516721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513e235-f434-42d1-b4ca-bebc32d35332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:53.518127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513e235-f434-42d1-b4ca-bebc32d35332 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:53.518532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513e235-f434-42d1-b4ca-bebc32d35332 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:53.518819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513e235-f434-42d1-b4ca-bebc32d35332 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2/groups/1efb36710cd5416aaab1a2f3cdea887d/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:53.521877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513e235-f434-42d1-b4ca-bebc32d35332 None admin] RBAC: Authorizing `identity:create_grant(project_id=70e6e6919b9d48dd86e5410efb71c4d2, group_id=1efb36710cd5416aaab1a2f3cdea887d, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:53.524349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513e235-f434-42d1-b4ca-bebc32d35332 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:53.525901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf687f3-def9-45a2-ad4c-74ac26d8e58f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:53.551367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 208/398] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Aug 7 22:19:53 2022] PUT /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2/groups/1efb36710cd5416aaab1a2f3cdea887d/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:53.582412 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1229b3-261d-4f23-980b-903171d9fbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:53.583052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1229b3-261d-4f23-980b-903171d9fbeb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:53.583362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1229b3-261d-4f23-980b-903171d9fbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:53.583633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1229b3-261d-4f23-980b-903171d9fbeb None admin] PATH_INFO: `/v3/groups/1efb36710cd5416aaab1a2f3cdea887d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:53.584792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1229b3-261d-4f23-980b-903171d9fbeb None admin] RBAC: Authorizing `identity:get_group(group_id=1efb36710cd5416aaab1a2f3cdea887d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:53.586306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1229b3-261d-4f23-980b-903171d9fbeb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:53.588268 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 191/399] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:53 2022] GET /identity/v3/groups/1efb36710cd5416aaab1a2f3cdea887d => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:53.593860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513e235-f434-42d1-b4ca-bebc32d35332 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:53.711390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513e235-f434-42d1-b4ca-bebc32d35332 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:53.727467 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:53.750159 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbf100-ed0f-471c-ab29-ff825597670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:53.750794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbf100-ed0f-471c-ab29-ff825597670d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:53.751072 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbf100-ed0f-471c-ab29-ff825597670d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:53.751371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbf100-ed0f-471c-ab29-ff825597670d None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:53.752552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbf100-ed0f-471c-ab29-ff825597670d None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:53.753987 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbf100-ed0f-471c-ab29-ff825597670d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:53.755947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 209/400] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:53 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:53.761689 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1229b3-261d-4f23-980b-903171d9fbeb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:53.874874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1229b3-261d-4f23-980b-903171d9fbeb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:53.896216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:53.916446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdcc56-4c06-40ab-9018-4c94e5c511a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:53.917106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdcc56-4c06-40ab-9018-4c94e5c511a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:53.917380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdcc56-4c06-40ab-9018-4c94e5c511a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:53.917652 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdcc56-4c06-40ab-9018-4c94e5c511a2 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2/groups/1efb36710cd5416aaab1a2f3cdea887d/roles/74caf7e4c7474d40b5657d5e42da5546` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:53.922513 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdcc56-4c06-40ab-9018-4c94e5c511a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=70e6e6919b9d48dd86e5410efb71c4d2, group_id=1efb36710cd5416aaab1a2f3cdea887d, role_id=74caf7e4c7474d40b5657d5e42da5546)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:53.924565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdcc56-4c06-40ab-9018-4c94e5c511a2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:53.948677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 192/401] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Aug 7 22:19:53 2022] PUT /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2/groups/1efb36710cd5416aaab1a2f3cdea887d/roles/74caf7e4c7474d40b5657d5e42da5546 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:19:54.196788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822b275-98de-4138-a9f7-328d7545821a None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:54.197836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822b275-98de-4138-a9f7-328d7545821a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:54.198316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822b275-98de-4138-a9f7-328d7545821a None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:54.200075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 210/402] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:54.206040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a48f2b-70d6-4285-9650-ca8fee0fb8c3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:54.206963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a48f2b-70d6-4285-9650-ca8fee0fb8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:54.207485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a48f2b-70d6-4285-9650-ca8fee0fb8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:54.231122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c2a48f2b-70d6-4285-9650-ca8fee0fb8c3 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:54.232644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c2a48f2b-70d6-4285-9650-ca8fee0fb8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:54.304918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 193/403] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:54.315177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a93e-107a-4dbf-8e76-572f3e9b359c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:54.315466 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a93e-107a-4dbf-8e76-572f3e9b359c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:54.315715 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a93e-107a-4dbf-8e76-572f3e9b359c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:54.317029 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 211/404] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:54.322510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120606c-9b15-4e81-a1cc-590f6bd75f95 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:54.322798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120606c-9b15-4e81-a1cc-590f6bd75f95 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:54.323072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120606c-9b15-4e81-a1cc-590f6bd75f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:54.336414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061a93e-107a-4dbf-8e76-572f3e9b359c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:54.344543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d120606c-9b15-4e81-a1cc-590f6bd75f95 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:54.346375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d120606c-9b15-4e81-a1cc-590f6bd75f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:54.435001 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 194/405] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:54.460372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120606c-9b15-4e81-a1cc-590f6bd75f95 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:54.472289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061a93e-107a-4dbf-8e76-572f3e9b359c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:54.516505 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:54.535610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766484b7-5be1-40f0-a371-3395c9ec1e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:54.536227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766484b7-5be1-40f0-a371-3395c9ec1e8e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:54.536498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766484b7-5be1-40f0-a371-3395c9ec1e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:54.536762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766484b7-5be1-40f0-a371-3395c9ec1e8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:54.555404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766484b7-5be1-40f0-a371-3395c9ec1e8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-766484b7-5be1-40f0-a371-3395c9ec1e8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:54.560911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:54.561782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:54.562571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 212/406] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:19:54.569352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766484b7-5be1-40f0-a371-3395c9ec1e8e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:54.632827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:54.644903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120606c-9b15-4e81-a1cc-590f6bd75f95 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:54.710042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102573e9-e8d9-4520-893d-5aa339eabb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:54.710680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102573e9-e8d9-4520-893d-5aa339eabb97 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:54.710952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102573e9-e8d9-4520-893d-5aa339eabb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:54.711242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102573e9-e8d9-4520-893d-5aa339eabb97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:54.729013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102573e9-e8d9-4520-893d-5aa339eabb97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-102573e9-e8d9-4520-893d-5aa339eabb97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:54.734625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:54.735595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:19:54.736970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 195/407] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:19:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:19:54.744244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102573e9-e8d9-4520-893d-5aa339eabb97 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:54.764737 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766484b7-5be1-40f0-a371-3395c9ec1e8e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:54.819580 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706ac78-abfe-4206-aacd-3d4b8881145e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:54.820104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ac78-abfe-4206-aacd-3d4b8881145e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:54.820377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ac78-abfe-4206-aacd-3d4b8881145e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:54.820642 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ac78-abfe-4206-aacd-3d4b8881145e None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:54.821358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706ac78-abfe-4206-aacd-3d4b8881145e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:54.821657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706ac78-abfe-4206-aacd-3d4b8881145e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:54.823005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706ac78-abfe-4206-aacd-3d4b8881145e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:54.832033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 213/408] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:54.838025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706ac78-abfe-4206-aacd-3d4b8881145e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:54.937265 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:54.946833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102573e9-e8d9-4520-893d-5aa339eabb97 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:55.016039 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fe512-a5e5-43c0-b6ea-35bb799f0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:55.016642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fe512-a5e5-43c0-b6ea-35bb799f0d47 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:55.016912 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fe512-a5e5-43c0-b6ea-35bb799f0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:55.017179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fe512-a5e5-43c0-b6ea-35bb799f0d47 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:55.018478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fe512-a5e5-43c0-b6ea-35bb799f0d47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:55.018776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fe512-a5e5-43c0-b6ea-35bb799f0d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:55.020171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fe512-a5e5-43c0-b6ea-35bb799f0d47 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:55.043897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:55.045707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 196/409] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:19:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:55.047451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fe512-a5e5-43c0-b6ea-35bb799f0d47 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:55.053228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706ac78-abfe-4206-aacd-3d4b8881145e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:55.124037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f245b-312a-48a7-8b6a-c001da4fd69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:55.124598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f245b-312a-48a7-8b6a-c001da4fd69c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:55.125122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f245b-312a-48a7-8b6a-c001da4fd69c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:55.125384 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f245b-312a-48a7-8b6a-c001da4fd69c None admin] PATH_INFO: `/v3/groups/380687ee992941a6ae5e57a0a52684e5` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:55.126482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f245b-312a-48a7-8b6a-c001da4fd69c None admin] RBAC: Authorizing `identity:get_group(group_id=380687ee992941a6ae5e57a0a52684e5)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:55.130353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f245b-312a-48a7-8b6a-c001da4fd69c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:55.135565 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 214/410] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:54 2022] GET /identity/v3/groups/380687ee992941a6ae5e57a0a52684e5 => generated 229 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:55.140802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f245b-312a-48a7-8b6a-c001da4fd69c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:55.222055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fe512-a5e5-43c0-b6ea-35bb799f0d47 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:55.261160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df6211-ba6b-4021-8dc3-441d048ea4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:55.261794 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df6211-ba6b-4021-8dc3-441d048ea4af None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:55.262095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df6211-ba6b-4021-8dc3-441d048ea4af None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:55.262366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df6211-ba6b-4021-8dc3-441d048ea4af None admin] PATH_INFO: `/v3/groups/1efb36710cd5416aaab1a2f3cdea887d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:55.263842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df6211-ba6b-4021-8dc3-441d048ea4af None admin] RBAC: Authorizing `identity:get_group(group_id=1efb36710cd5416aaab1a2f3cdea887d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:55.266313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df6211-ba6b-4021-8dc3-441d048ea4af None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:55.269027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 197/411] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:55 2022] GET /identity/v3/groups/1efb36710cd5416aaab1a2f3cdea887d => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:55.274213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df6211-ba6b-4021-8dc3-441d048ea4af None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:55.305027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:55.334025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f245b-312a-48a7-8b6a-c001da4fd69c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:55.370328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f6dfc-94d5-4ba6-b63b-3380a52d4a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:55.370955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f6dfc-94d5-4ba6-b63b-3380a52d4a42 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:55.371260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f6dfc-94d5-4ba6-b63b-3380a52d4a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:55.371530 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f6dfc-94d5-4ba6-b63b-3380a52d4a42 None admin] PATH_INFO: `/v3/projects/7053e2b8fbb347c68a456428438dcda4` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:55.372653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f6dfc-94d5-4ba6-b63b-3380a52d4a42 None admin] RBAC: Authorizing `identity:get_project(project_id=7053e2b8fbb347c68a456428438dcda4)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:55.374143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f6dfc-94d5-4ba6-b63b-3380a52d4a42 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:55.376297 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 215/412] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:55 2022] GET /identity/v3/projects/7053e2b8fbb347c68a456428438dcda4 => generated 344 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:55.382470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f6dfc-94d5-4ba6-b63b-3380a52d4a42 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:55.385325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df6211-ba6b-4021-8dc3-441d048ea4af None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:55.419765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:55.421642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821c946-1133-4a80-b30f-921e8603bd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:55.422356 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821c946-1133-4a80-b30f-921e8603bd3a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:55.422678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821c946-1133-4a80-b30f-921e8603bd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:55.423007 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821c946-1133-4a80-b30f-921e8603bd3a None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:55.424431 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821c946-1133-4a80-b30f-921e8603bd3a None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:55.425915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821c946-1133-4a80-b30f-921e8603bd3a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:55.428088 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 198/413] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:55 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:55.433656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821c946-1133-4a80-b30f-921e8603bd3a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:55.492102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f6dfc-94d5-4ba6-b63b-3380a52d4a42 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:55.527202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568359a9-9d47-48cf-b10d-5daffb8e4e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:55.527860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568359a9-9d47-48cf-b10d-5daffb8e4e9f None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:55.528133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568359a9-9d47-48cf-b10d-5daffb8e4e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:55.528404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568359a9-9d47-48cf-b10d-5daffb8e4e9f None admin] PATH_INFO: `/v3/projects/7053e2b8fbb347c68a456428438dcda4/groups/380687ee992941a6ae5e57a0a52684e5/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:55.530448 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568359a9-9d47-48cf-b10d-5daffb8e4e9f None admin] RBAC: Authorizing `identity:create_grant(project_id=7053e2b8fbb347c68a456428438dcda4, group_id=380687ee992941a6ae5e57a0a52684e5, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:55.531927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568359a9-9d47-48cf-b10d-5daffb8e4e9f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:55.537169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:55.544302 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821c946-1133-4a80-b30f-921e8603bd3a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:55.558854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 216/414] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Aug 7 22:19:55 2022] PUT /identity/v3/projects/7053e2b8fbb347c68a456428438dcda4/groups/380687ee992941a6ae5e57a0a52684e5/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:19:55.585989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb31f4-4822-4645-a9f2-4d8223d0d946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:55.586662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb31f4-4822-4645-a9f2-4d8223d0d946 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:55.586934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb31f4-4822-4645-a9f2-4d8223d0d946 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:55.587226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb31f4-4822-4645-a9f2-4d8223d0d946 None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80/groups/1efb36710cd5416aaab1a2f3cdea887d/roles/74caf7e4c7474d40b5657d5e42da5546` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:55.589567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb31f4-4822-4645-a9f2-4d8223d0d946 None admin] RBAC: Authorizing `identity:create_grant(project_id=032c8fa1940c4117b584aca3ab1e4b80, group_id=1efb36710cd5416aaab1a2f3cdea887d, role_id=74caf7e4c7474d40b5657d5e42da5546)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:55.591060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb31f4-4822-4645-a9f2-4d8223d0d946 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:55.606826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 199/415] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Aug 7 22:19:55 2022] PUT /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80/groups/1efb36710cd5416aaab1a2f3cdea887d/roles/74caf7e4c7474d40b5657d5e42da5546 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:19:55.955965 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf0074-b2f8-4590-a7cf-9a92135b56d4 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:55.956298 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf0074-b2f8-4590-a7cf-9a92135b56d4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:55.956636 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf0074-b2f8-4590-a7cf-9a92135b56d4 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:55.958742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 217/416] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:55.978445 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007ee8-0171-43e2-8c4e-f03ca990155d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:55.978763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007ee8-0171-43e2-8c4e-f03ca990155d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:55.978990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007ee8-0171-43e2-8c4e-f03ca990155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:56.002994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-55007ee8-0171-43e2-8c4e-f03ca990155d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:56.004252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-55007ee8-0171-43e2-8c4e-f03ca990155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:56.099296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 200/417] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:56.138852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf0074-b2f8-4590-a7cf-9a92135b56d4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:56.258468 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:56.270888 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf0074-b2f8-4590-a7cf-9a92135b56d4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:56.309290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566445b0-1f0f-4d0f-bcda-cf039b3805d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:56.309922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566445b0-1f0f-4d0f-bcda-cf039b3805d9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:56.310200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566445b0-1f0f-4d0f-bcda-cf039b3805d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:56.310472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566445b0-1f0f-4d0f-bcda-cf039b3805d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:56.321372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566445b0-1f0f-4d0f-bcda-cf039b3805d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-566445b0-1f0f-4d0f-bcda-cf039b3805d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:56.326201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:56.327056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:56.327874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 218/418] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:56.333720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55007ee8-0171-43e2-8c4e-f03ca990155d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:56.438402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262759-4e61-4049-bf57-0532d47d9d05 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:56.438946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262759-4e61-4049-bf57-0532d47d9d05 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:56.439032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262759-4e61-4049-bf57-0532d47d9d05 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:56.440678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 219/419] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:19:56.445504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7514870-d38b-40cf-a39d-bb05a1dcc276 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:56.445782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7514870-d38b-40cf-a39d-bb05a1dcc276 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:56.446100 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7514870-d38b-40cf-a39d-bb05a1dcc276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:56.470196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d7514870-d38b-40cf-a39d-bb05a1dcc276 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:56.471966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d7514870-d38b-40cf-a39d-bb05a1dcc276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:56.480203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:56.505644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55007ee8-0171-43e2-8c4e-f03ca990155d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:56.546071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acac671-d9e0-4bba-a125-9918e49efae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:56.546811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acac671-d9e0-4bba-a125-9918e49efae3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:56.546981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acac671-d9e0-4bba-a125-9918e49efae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:56.547363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acac671-d9e0-4bba-a125-9918e49efae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:56.552320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 220/420] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:56.552506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acac671-d9e0-4bba-a125-9918e49efae3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:56.552506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acac671-d9e0-4bba-a125-9918e49efae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:56.552506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acac671-d9e0-4bba-a125-9918e49efae3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:56.554361 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28e042-d324-4790-bc30-7a173184b3f4 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:56.554827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28e042-d324-4790-bc30-7a173184b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:56.555368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28e042-d324-4790-bc30-7a173184b3f4 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:56.557188 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 221/421] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:56.564761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d5e41-71d9-4fca-bf24-ff710513eee8 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:56.565264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d5e41-71d9-4fca-bf24-ff710513eee8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:56.565716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d5e41-71d9-4fca-bf24-ff710513eee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:56.567195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 201/422] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:56.571274 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acac671-d9e0-4bba-a125-9918e49efae3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:56.595995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7a4d5e41-71d9-4fca-bf24-ff710513eee8 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:56.597479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7a4d5e41-71d9-4fca-bf24-ff710513eee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:56.670147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 222/423] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:19:56.671349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d5e41-71d9-4fca-bf24-ff710513eee8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:56.685026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acac671-d9e0-4bba-a125-9918e49efae3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:56.686682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:56.731434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c27c67-610a-4d8e-878e-45faf4b58d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:56.731785 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c27c67-610a-4d8e-878e-45faf4b58d43 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:56.732066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c27c67-610a-4d8e-878e-45faf4b58d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:56.732337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c27c67-610a-4d8e-878e-45faf4b58d43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:56.759463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:56.777510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d5e41-71d9-4fca-bf24-ff710513eee8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:56.801859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c27c67-610a-4d8e-878e-45faf4b58d43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:56.803322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c27c67-610a-4d8e-878e-45faf4b58d43 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:56.813341 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0d2f2-83bb-40e7-9212-531b766650dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:56.814305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0d2f2-83bb-40e7-9212-531b766650dc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:56.814782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0d2f2-83bb-40e7-9212-531b766650dc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:56.815281 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0d2f2-83bb-40e7-9212-531b766650dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:56.825921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0d2f2-83bb-40e7-9212-531b766650dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a7d0d2f2-83bb-40e7-9212-531b766650dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:56.831416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:56.832354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:56.833127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:56.833127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:56.833127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:56.833127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:56.833127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:56.833127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:56.833127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:56.833127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:56.833127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:56.833127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:56.833127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 22:19:56.833127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:56.835326 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 223/424] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:56.840912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0d2f2-83bb-40e7-9212-531b766650dc None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:56.913492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 202/425] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 22:19:56.914452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c27c67-610a-4d8e-878e-45faf4b58d43 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:56.920311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:56.948204 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0d2f2-83bb-40e7-9212-531b766650dc None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:56.975829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:57.000635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32225312-4dd2-4b08-a68c-90d48802cb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:57.001561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32225312-4dd2-4b08-a68c-90d48802cb47 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:57.002107 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32225312-4dd2-4b08-a68c-90d48802cb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:57.002584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32225312-4dd2-4b08-a68c-90d48802cb47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:57.013603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32225312-4dd2-4b08-a68c-90d48802cb47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-32225312-4dd2-4b08-a68c-90d48802cb47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:57.019035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:57.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:57.020817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:57.020817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:57.020817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:57.020817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:57.020817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:57.020817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:57.020817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:57.020817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:57.020817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:57.020817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:57.020817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:57.020817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:57.022250 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c27c67-610a-4d8e-878e-45faf4b58d43 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:57.023273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 224/426] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:19:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:57.024272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32225312-4dd2-4b08-a68c-90d48802cb47 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:57.063866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ec000-b6a2-42fa-abd7-4ee5047c2f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:57.065083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ec000-b6a2-42fa-abd7-4ee5047c2f1d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:57.065357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ec000-b6a2-42fa-abd7-4ee5047c2f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:57.065622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ec000-b6a2-42fa-abd7-4ee5047c2f1d None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:57.066293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ec000-b6a2-42fa-abd7-4ee5047c2f1d None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:57.066609 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ec000-b6a2-42fa-abd7-4ee5047c2f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:57.067993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ec000-b6a2-42fa-abd7-4ee5047c2f1d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:57.076501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 203/427] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:19:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:57.077488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ec000-b6a2-42fa-abd7-4ee5047c2f1d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:57.137263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32225312-4dd2-4b08-a68c-90d48802cb47 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:57.173939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6058c-4077-4807-a60f-f282fa2b848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:57.174696 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6058c-4077-4807-a60f-f282fa2b848e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:57.174976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6058c-4077-4807-a60f-f282fa2b848e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:57.175267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6058c-4077-4807-a60f-f282fa2b848e None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:57.176376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6058c-4077-4807-a60f-f282fa2b848e None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:57.178063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6058c-4077-4807-a60f-f282fa2b848e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:57.179695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 225/428] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:57 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:57.180442 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6058c-4077-4807-a60f-f282fa2b848e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:57.182821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:57.185374 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ec000-b6a2-42fa-abd7-4ee5047c2f1d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:57.197208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:57.222654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397e20-a2cd-4dab-99b2-2dfec7eed6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:57.222869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397e20-a2cd-4dab-99b2-2dfec7eed6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:57.223176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397e20-a2cd-4dab-99b2-2dfec7eed6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:57.223454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397e20-a2cd-4dab-99b2-2dfec7eed6f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:57.224115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb397e20-a2cd-4dab-99b2-2dfec7eed6f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:57.224423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb397e20-a2cd-4dab-99b2-2dfec7eed6f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:57.225786 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb397e20-a2cd-4dab-99b2-2dfec7eed6f7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:57.238652 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 204/429] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:19:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:57.239362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397e20-a2cd-4dab-99b2-2dfec7eed6f7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:57.298269 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6058c-4077-4807-a60f-f282fa2b848e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:57.338999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c40188-c12f-4d95-8675-80185376d136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:57.339926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c40188-c12f-4d95-8675-80185376d136 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:57.340213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c40188-c12f-4d95-8675-80185376d136 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:57.340488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c40188-c12f-4d95-8675-80185376d136 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:57.368701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397e20-a2cd-4dab-99b2-2dfec7eed6f7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:57.409008 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f1c95-d9ad-44a9-ad25-b10ce61b8156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:57.410092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f1c95-d9ad-44a9-ad25-b10ce61b8156 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:57.410571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f1c95-d9ad-44a9-ad25-b10ce61b8156 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:57.411018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f1c95-d9ad-44a9-ad25-b10ce61b8156 None admin] PATH_INFO: `/v3/groups/1efb36710cd5416aaab1a2f3cdea887d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:57.412394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f1c95-d9ad-44a9-ad25-b10ce61b8156 None admin] RBAC: Authorizing `identity:get_group(group_id=1efb36710cd5416aaab1a2f3cdea887d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:57.412723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c40188-c12f-4d95-8675-80185376d136 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:57.414169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f1c95-d9ad-44a9-ad25-b10ce61b8156 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:57.414284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c40188-c12f-4d95-8675-80185376d136 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:57.416054 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:57.417269 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 205/430] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:57 2022] GET /identity/v3/groups/1efb36710cd5416aaab1a2f3cdea887d => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:57.418191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f1c95-d9ad-44a9-ad25-b10ce61b8156 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:57.465930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:57.523967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 226/431] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:57.524957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c40188-c12f-4d95-8675-80185376d136 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:57.534280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f1c95-d9ad-44a9-ad25-b10ce61b8156 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:57.572644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e2a3-0480-4065-a4ab-3c02ec97c994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:57.573598 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e2a3-0480-4065-a4ab-3c02ec97c994 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:57.574073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e2a3-0480-4065-a4ab-3c02ec97c994 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:57.574516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e2a3-0480-4065-a4ab-3c02ec97c994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:57.628095 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c40188-c12f-4d95-8675-80185376d136 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:57.629530 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:57.653791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0e2a3-0480-4065-a4ab-3c02ec97c994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:57.655783 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0e2a3-0480-4065-a4ab-3c02ec97c994 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:57.665453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb133c1c-cb25-49ba-90e8-5364a0f714b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:57.666427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb133c1c-cb25-49ba-90e8-5364a0f714b3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:57.666427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb133c1c-cb25-49ba-90e8-5364a0f714b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:57.666605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb133c1c-cb25-49ba-90e8-5364a0f714b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:57.667330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb133c1c-cb25-49ba-90e8-5364a0f714b3 None admin] RBAC: Adding query filter params (group.id=1efb36710cd5416aaab1a2f3cdea887d, role.id=8823542b01ef4a6ca68c563ef700d59d, scope.project.id=032c8fa1940c4117b584aca3ab1e4b80) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:57.667636 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb133c1c-cb25-49ba-90e8-5364a0f714b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:57.669486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb133c1c-cb25-49ba-90e8-5364a0f714b3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:57.679220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 227/432] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 22:19:57 2022] GET /identity/v3/role_assignments?group.id=1efb36710cd5416aaab1a2f3cdea887d&scope.project.id=032c8fa1940c4117b584aca3ab1e4b80&role.id=8823542b01ef4a6ca68c563ef700d59d => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:57.680180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb133c1c-cb25-49ba-90e8-5364a0f714b3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:57.707831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:57.778347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 206/433] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:19:57.786079 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e2a3-0480-4065-a4ab-3c02ec97c994 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:57.874019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb133c1c-cb25-49ba-90e8-5364a0f714b3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:57.927478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e2a3-0480-4065-a4ab-3c02ec97c994 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:57.929353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d65d1d-4104-4c74-bb7d-25052f109076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:57.930275 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d65d1d-4104-4c74-bb7d-25052f109076 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:57.930750 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d65d1d-4104-4c74-bb7d-25052f109076 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:57.931261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d65d1d-4104-4c74-bb7d-25052f109076 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:57.932619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d65d1d-4104-4c74-bb7d-25052f109076 None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:57.934304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d65d1d-4104-4c74-bb7d-25052f109076 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:57.936263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 228/434] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:57 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:57.937418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273ae01-fbcb-4e8b-bcfd-e3d0214cb96b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:57.937699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273ae01-fbcb-4e8b-bcfd-e3d0214cb96b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:57.937967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273ae01-fbcb-4e8b-bcfd-e3d0214cb96b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:57.939831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 229/435] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:57.943934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273ae01-fbcb-4e8b-bcfd-e3d0214cb96b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:57.970058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b02fbe-5bf7-4532-abcb-29c93618a8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:57.970719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b02fbe-5bf7-4532-abcb-29c93618a8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:57.970995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b02fbe-5bf7-4532-abcb-29c93618a8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:57.971285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b02fbe-5bf7-4532-abcb-29c93618a8b7 None admin] PATH_INFO: `/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:57.972416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b02fbe-5bf7-4532-abcb-29c93618a8b7 None admin] RBAC: Authorizing `identity:get_project(project_id=70e6e6919b9d48dd86e5410efb71c4d2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:57.973838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b02fbe-5bf7-4532-abcb-29c93618a8b7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:57.975793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 207/436] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:57 2022] GET /identity/v3/projects/70e6e6919b9d48dd86e5410efb71c4d2 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:57.976773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f246-a29b-47b5-9875-1fb4c3181bc0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:57.977046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f246-a29b-47b5-9875-1fb4c3181bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:57.977308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f246-a29b-47b5-9875-1fb4c3181bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:57.988213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:57.995649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6a96f246-a29b-47b5-9875-1fb4c3181bc0 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:57.996844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6a96f246-a29b-47b5-9875-1fb4c3181bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:57.998958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:58.059235 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273ae01-fbcb-4e8b-bcfd-e3d0214cb96b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:58.072022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 208/437] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:58.073320 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52180117-5a2e-4611-9cff-48497af482f5 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:58.073604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52180117-5a2e-4611-9cff-48497af482f5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:58.073876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52180117-5a2e-4611-9cff-48497af482f5 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:58.075414 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 209/438] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:19:58.076111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52180117-5a2e-4611-9cff-48497af482f5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:58.097430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5c46a-e896-4d1f-8e60-5b0e9fbb1d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:58.098046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5c46a-e896-4d1f-8e60-5b0e9fbb1d84 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:58.098317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5c46a-e896-4d1f-8e60-5b0e9fbb1d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:58.098585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5c46a-e896-4d1f-8e60-5b0e9fbb1d84 None admin] PATH_INFO: `/v3/groups/1efb36710cd5416aaab1a2f3cdea887d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:58.099669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5c46a-e896-4d1f-8e60-5b0e9fbb1d84 None admin] RBAC: Authorizing `identity:get_group(group_id=1efb36710cd5416aaab1a2f3cdea887d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:58.101098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5c46a-e896-4d1f-8e60-5b0e9fbb1d84 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:58.102635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 230/439] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:57 2022] GET /identity/v3/groups/1efb36710cd5416aaab1a2f3cdea887d => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:58.103727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784050c8-deac-435d-9e79-3e1bf5e7e159 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:58.104002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784050c8-deac-435d-9e79-3e1bf5e7e159 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:58.104270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784050c8-deac-435d-9e79-3e1bf5e7e159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:58.121344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-784050c8-deac-435d-9e79-3e1bf5e7e159 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:19:58.122512 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-784050c8-deac-435d-9e79-3e1bf5e7e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:19:58.188816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 231/440] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:19:58.190202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784050c8-deac-435d-9e79-3e1bf5e7e159 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:58.190801 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52180117-5a2e-4611-9cff-48497af482f5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:58.220026 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:58.225294 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192396bc-dc10-4d46-a6fb-c5b82d02d4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:58.225920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192396bc-dc10-4d46-a6fb-c5b82d02d4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:58.226194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192396bc-dc10-4d46-a6fb-c5b82d02d4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:58.226461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192396bc-dc10-4d46-a6fb-c5b82d02d4b2 None admin] PATH_INFO: `/v3/groups/1efb36710cd5416aaab1a2f3cdea887d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:58.227594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192396bc-dc10-4d46-a6fb-c5b82d02d4b2 None admin] RBAC: Authorizing `identity:get_group(group_id=1efb36710cd5416aaab1a2f3cdea887d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:58.229021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192396bc-dc10-4d46-a6fb-c5b82d02d4b2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:58.230712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 210/441] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:58 2022] GET /identity/v3/groups/1efb36710cd5416aaab1a2f3cdea887d => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:58.231342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192396bc-dc10-4d46-a6fb-c5b82d02d4b2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:58.242004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:58.292482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784050c8-deac-435d-9e79-3e1bf5e7e159 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:58.326524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33f8e3-7c96-43d2-85bc-68a676f3452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:58.327164 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f8e3-7c96-43d2-85bc-68a676f3452d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:58.327438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f8e3-7c96-43d2-85bc-68a676f3452d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:58.327700 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f8e3-7c96-43d2-85bc-68a676f3452d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:58.332165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192396bc-dc10-4d46-a6fb-c5b82d02d4b2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:58.337573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33f8e3-7c96-43d2-85bc-68a676f3452d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-fe33f8e3-7c96-43d2-85bc-68a676f3452d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:58.342215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:58.343319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:58.344321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 232/442] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:58.345123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33f8e3-7c96-43d2-85bc-68a676f3452d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:58.370836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bde6b-c7c6-4d2e-b9df-32b455334e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:58.371464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bde6b-c7c6-4d2e-b9df-32b455334e2c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:58.371742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bde6b-c7c6-4d2e-b9df-32b455334e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:58.372011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bde6b-c7c6-4d2e-b9df-32b455334e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:58.372728 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bde6b-c7c6-4d2e-b9df-32b455334e2c None admin] RBAC: Adding query filter params (group.id=1efb36710cd5416aaab1a2f3cdea887d, role.id=8823542b01ef4a6ca68c563ef700d59d, scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:58.373033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bde6b-c7c6-4d2e-b9df-32b455334e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:58.374439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bde6b-c7c6-4d2e-b9df-32b455334e2c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:58.380944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 211/443] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 22:19:58 2022] GET /identity/v3/role_assignments?group.id=1efb36710cd5416aaab1a2f3cdea887d&scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2&role.id=8823542b01ef4a6ca68c563ef700d59d => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:58.381708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bde6b-c7c6-4d2e-b9df-32b455334e2c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:58.446256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:58.457047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33f8e3-7c96-43d2-85bc-68a676f3452d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:58.460474 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:58.496450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7dd6f-344a-40ac-a8fa-0d8a270d70cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:58.496905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bde6b-c7c6-4d2e-b9df-32b455334e2c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:58.497118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7dd6f-344a-40ac-a8fa-0d8a270d70cc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:58.497397 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7dd6f-344a-40ac-a8fa-0d8a270d70cc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:58.497664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7dd6f-344a-40ac-a8fa-0d8a270d70cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:58.512335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7dd6f-344a-40ac-a8fa-0d8a270d70cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d7f7dd6f-344a-40ac-a8fa-0d8a270d70cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:19:58.517061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:19:58.518516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:19:58.519519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 233/444] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:19:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:19:58.520398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7dd6f-344a-40ac-a8fa-0d8a270d70cc None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:58.539922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386f34a-f231-4e88-96eb-cdab3f5c9b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:58.541191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386f34a-f231-4e88-96eb-cdab3f5c9b7d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:58.541191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386f34a-f231-4e88-96eb-cdab3f5c9b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:58.541191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386f34a-f231-4e88-96eb-cdab3f5c9b7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:58.541754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386f34a-f231-4e88-96eb-cdab3f5c9b7d None admin] RBAC: Adding query filter params (group.id=1efb36710cd5416aaab1a2f3cdea887d, role.id=74caf7e4c7474d40b5657d5e42da5546, scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:58.542059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386f34a-f231-4e88-96eb-cdab3f5c9b7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:58.543520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386f34a-f231-4e88-96eb-cdab3f5c9b7d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:58.549759 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 212/445] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 22:19:58 2022] GET /identity/v3/role_assignments?group.id=1efb36710cd5416aaab1a2f3cdea887d&scope.project.id=70e6e6919b9d48dd86e5410efb71c4d2&role.id=74caf7e4c7474d40b5657d5e42da5546 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:58.550551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386f34a-f231-4e88-96eb-cdab3f5c9b7d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:58.656160 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7dd6f-344a-40ac-a8fa-0d8a270d70cc None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:58.683289 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386f34a-f231-4e88-96eb-cdab3f5c9b7d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:58.717113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7a665-3700-42b9-b34f-b50a527b2b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:58.717645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7a665-3700-42b9-b34f-b50a527b2b87 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:58.717917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7a665-3700-42b9-b34f-b50a527b2b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:58.718182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7a665-3700-42b9-b34f-b50a527b2b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:58.718845 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7a665-3700-42b9-b34f-b50a527b2b87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:58.719222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7a665-3700-42b9-b34f-b50a527b2b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:58.721176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7a665-3700-42b9-b34f-b50a527b2b87 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:58.726221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed4778-7f61-40b7-89e8-5658e35555ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:58.726829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4778-7f61-40b7-89e8-5658e35555ff None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:58.727185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4778-7f61-40b7-89e8-5658e35555ff None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:58.727512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4778-7f61-40b7-89e8-5658e35555ff None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:58.728181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed4778-7f61-40b7-89e8-5658e35555ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:58.728484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed4778-7f61-40b7-89e8-5658e35555ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:58.729855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed4778-7f61-40b7-89e8-5658e35555ff None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:58.730817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 234/446] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:58.731475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:58.737851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7a665-3700-42b9-b34f-b50a527b2b87 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:58.740846 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 213/447] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:19:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:19:58.747475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed4778-7f61-40b7-89e8-5658e35555ff None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:58.756626 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:58.855787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7a665-3700-42b9-b34f-b50a527b2b87 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:58.867569 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed4778-7f61-40b7-89e8-5658e35555ff None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:58.897541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75b2ea-836c-459e-9497-d99c22947afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:58.898442 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75b2ea-836c-459e-9497-d99c22947afd None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:58.898710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75b2ea-836c-459e-9497-d99c22947afd None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:58.898972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75b2ea-836c-459e-9497-d99c22947afd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:58.913720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c60693-93f9-4aff-b9be-81906ca8085a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:58.914485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c60693-93f9-4aff-b9be-81906ca8085a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:58.914764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c60693-93f9-4aff-b9be-81906ca8085a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:58.915036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c60693-93f9-4aff-b9be-81906ca8085a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:58.977336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75b2ea-836c-459e-9497-d99c22947afd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:58.978703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75b2ea-836c-459e-9497-d99c22947afd None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:58.992335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:58.999163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:59.001413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c60693-93f9-4aff-b9be-81906ca8085a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:59.003555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c60693-93f9-4aff-b9be-81906ca8085a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:59.097938 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 235/448] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 22:19:59.103311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75b2ea-836c-459e-9497-d99c22947afd None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:59.117807 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 214/449] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 22:19:59.123672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c60693-93f9-4aff-b9be-81906ca8085a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:59.209369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75b2ea-836c-459e-9497-d99c22947afd None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:59.220129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:59.224390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:59.226039 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c60693-93f9-4aff-b9be-81906ca8085a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:59.245572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b4310-8850-425f-9942-a7c6f8d83e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:59.246121 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b4310-8850-425f-9942-a7c6f8d83e65 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:59.246396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b4310-8850-425f-9942-a7c6f8d83e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:59.246667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b4310-8850-425f-9942-a7c6f8d83e65 None admin] PATH_INFO: `/v3/projects/7053e2b8fbb347c68a456428438dcda4` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:59.247795 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b4310-8850-425f-9942-a7c6f8d83e65 None admin] RBAC: Authorizing `identity:get_project(project_id=7053e2b8fbb347c68a456428438dcda4)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:59.249230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b4310-8850-425f-9942-a7c6f8d83e65 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:59.251321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 236/450] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:59 2022] GET /identity/v3/projects/7053e2b8fbb347c68a456428438dcda4 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:59.257104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b4310-8850-425f-9942-a7c6f8d83e65 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:59.265526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bda792-b22e-46cd-aafe-41c6d956624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:59.266136 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bda792-b22e-46cd-aafe-41c6d956624f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:59.266407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bda792-b22e-46cd-aafe-41c6d956624f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:59.266672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bda792-b22e-46cd-aafe-41c6d956624f None admin] PATH_INFO: `/v3/projects/032c8fa1940c4117b584aca3ab1e4b80` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:59.267844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bda792-b22e-46cd-aafe-41c6d956624f None admin] RBAC: Authorizing `identity:get_project(project_id=032c8fa1940c4117b584aca3ab1e4b80)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:59.269309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bda792-b22e-46cd-aafe-41c6d956624f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:59.270840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 215/451] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:19:59 2022] GET /identity/v3/projects/032c8fa1940c4117b584aca3ab1e4b80 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:59.276095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bda792-b22e-46cd-aafe-41c6d956624f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:59.352733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b4310-8850-425f-9942-a7c6f8d83e65 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:59.372403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bda792-b22e-46cd-aafe-41c6d956624f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:59.386059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63cc8d-8a84-4edf-8cae-b5d7acdd55de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:59.386675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63cc8d-8a84-4edf-8cae-b5d7acdd55de None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:59.386955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63cc8d-8a84-4edf-8cae-b5d7acdd55de None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:59.387256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63cc8d-8a84-4edf-8cae-b5d7acdd55de None admin] PATH_INFO: `/v3/groups/380687ee992941a6ae5e57a0a52684e5` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:59.388374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63cc8d-8a84-4edf-8cae-b5d7acdd55de None admin] RBAC: Authorizing `identity:get_group(group_id=380687ee992941a6ae5e57a0a52684e5)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:59.389786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63cc8d-8a84-4edf-8cae-b5d7acdd55de None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:59.391357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 237/452] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:59 2022] GET /identity/v3/groups/380687ee992941a6ae5e57a0a52684e5 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:59.396996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63cc8d-8a84-4edf-8cae-b5d7acdd55de None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:59.406607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b118ec1-5b1a-4e4d-9ef7-c962fbc2ce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:59.407258 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b118ec1-5b1a-4e4d-9ef7-c962fbc2ce8f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:59.407533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b118ec1-5b1a-4e4d-9ef7-c962fbc2ce8f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:59.407800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b118ec1-5b1a-4e4d-9ef7-c962fbc2ce8f None admin] PATH_INFO: `/v3/groups/1efb36710cd5416aaab1a2f3cdea887d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:59.409416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b118ec1-5b1a-4e4d-9ef7-c962fbc2ce8f None admin] RBAC: Authorizing `identity:get_group(group_id=1efb36710cd5416aaab1a2f3cdea887d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:59.410837 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b118ec1-5b1a-4e4d-9ef7-c962fbc2ce8f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:59.412432 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 216/453] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 22:19:59 2022] GET /identity/v3/groups/1efb36710cd5416aaab1a2f3cdea887d => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:59.418409 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b118ec1-5b1a-4e4d-9ef7-c962fbc2ce8f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:19:59.445272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:59.448848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:19:59.494530 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63cc8d-8a84-4edf-8cae-b5d7acdd55de None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:59.515935 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b118ec1-5b1a-4e4d-9ef7-c962fbc2ce8f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:19:59.527493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02e685-a4f9-4910-93af-f7afaf10c5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:59.528075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e685-a4f9-4910-93af-f7afaf10c5ed None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:59.528349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e685-a4f9-4910-93af-f7afaf10c5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:59.528614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e685-a4f9-4910-93af-f7afaf10c5ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:59.529324 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02e685-a4f9-4910-93af-f7afaf10c5ed None admin] RBAC: Adding query filter params (group.id=380687ee992941a6ae5e57a0a52684e5, role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=7053e2b8fbb347c68a456428438dcda4) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:59.529626 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02e685-a4f9-4910-93af-f7afaf10c5ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:59.531043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02e685-a4f9-4910-93af-f7afaf10c5ed None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:59.537108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 238/454] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 22:19:59 2022] GET /identity/v3/role_assignments?group.id=380687ee992941a6ae5e57a0a52684e5&scope.project.id=7053e2b8fbb347c68a456428438dcda4&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:19:59.550849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0840f-956e-4980-aecf-fa4fc18c9b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:19:59.551494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0840f-956e-4980-aecf-fa4fc18c9b63 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:19:59.551765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0840f-956e-4980-aecf-fa4fc18c9b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:19:59.552028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0840f-956e-4980-aecf-fa4fc18c9b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:19:59.552770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0840f-956e-4980-aecf-fa4fc18c9b63 None admin] RBAC: Adding query filter params (group.id=1efb36710cd5416aaab1a2f3cdea887d, role.id=74caf7e4c7474d40b5657d5e42da5546, scope.project.id=032c8fa1940c4117b584aca3ab1e4b80) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:19:59.553067 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0840f-956e-4980-aecf-fa4fc18c9b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:19:59.554529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0840f-956e-4980-aecf-fa4fc18c9b63 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:19:59.561173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 217/455] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 22:19:59 2022] GET /identity/v3/role_assignments?group.id=1efb36710cd5416aaab1a2f3cdea887d&scope.project.id=032c8fa1940c4117b584aca3ab1e4b80&role.id=74caf7e4c7474d40b5657d5e42da5546 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:02.306021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019523e-c2c0-4bfd-bc5e-511b953a1e94 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:02.306537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019523e-c2c0-4bfd-bc5e-511b953a1e94 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:02.306537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019523e-c2c0-4bfd-bc5e-511b953a1e94 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:02.307926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 239/456] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:02.324578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f10df0-a391-446b-b410-af269bea78fc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:02.325069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f10df0-a391-446b-b410-af269bea78fc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:02.325143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f10df0-a391-446b-b410-af269bea78fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:02.352044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-61f10df0-a391-446b-b410-af269bea78fc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:02.353212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-61f10df0-a391-446b-b410-af269bea78fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:02.403402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c7e78-000b-4d78-a15e-728a6ece700e None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:02.403675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c7e78-000b-4d78-a15e-728a6ece700e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:02.404109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c7e78-000b-4d78-a15e-728a6ece700e None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:02.405811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 240/457] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:02.412543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5c29-d20e-4e49-92ae-34043874b8ec None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:02.413115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5c29-d20e-4e49-92ae-34043874b8ec None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:02.413581 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5c29-d20e-4e49-92ae-34043874b8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:02.445710 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 218/458] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:02.446441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-21de5c29-d20e-4e49-92ae-34043874b8ec None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:02.447650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-21de5c29-d20e-4e49-92ae-34043874b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:02.474584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f10df0-a391-446b-b410-af269bea78fc None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:02.505630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:02.600222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f10df0-a391-446b-b410-af269bea78fc None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:02.608386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 241/459] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:20:02.636155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57391518-bed9-47e7-b205-5b567ed4f72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:02.637050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57391518-bed9-47e7-b205-5b567ed4f72a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:02.637468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57391518-bed9-47e7-b205-5b567ed4f72a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:02.637888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57391518-bed9-47e7-b205-5b567ed4f72a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:02.649133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57391518-bed9-47e7-b205-5b567ed4f72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:02.649344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888996-30c3-4709-bb79-1f69ef27aaec None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:02.649473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888996-30c3-4709-bb79-1f69ef27aaec None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:02.649902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888996-30c3-4709-bb79-1f69ef27aaec None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:02.650941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57391518-bed9-47e7-b205-5b567ed4f72a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:02.651921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 242/460] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:20:02.652864 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888996-30c3-4709-bb79-1f69ef27aaec None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-57391518-bed9-47e7-b205-5b567ed4f72a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:02.670896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:02.671881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:02.672720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:02.672720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:02.672720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:02.672720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 219/461] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:02.673225 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60696fe3-eaaa-4557-9aa0-ac8e13920e87 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:02.673497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60696fe3-eaaa-4557-9aa0-ac8e13920e87 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:02.673764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60696fe3-eaaa-4557-9aa0-ac8e13920e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:02.698365 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-60696fe3-eaaa-4557-9aa0-ac8e13920e87 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:02.699586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-60696fe3-eaaa-4557-9aa0-ac8e13920e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:02.705175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:02.767549 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888996-30c3-4709-bb79-1f69ef27aaec None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:02.769249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 220/462] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:02.769912 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60696fe3-eaaa-4557-9aa0-ac8e13920e87 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:02.782340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:02.803043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f11be-a9bf-4089-a62b-022177431000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:02.803685 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f11be-a9bf-4089-a62b-022177431000 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:02.803959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f11be-a9bf-4089-a62b-022177431000 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:02.804406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f11be-a9bf-4089-a62b-022177431000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:02.815064 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f11be-a9bf-4089-a62b-022177431000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:02.816509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f11be-a9bf-4089-a62b-022177431000 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-cd0f11be-a9bf-4089-a62b-022177431000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:02.831578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:02.832458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:02.833303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:02.833303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:02.833303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:02.833303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 243/463] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:02.834000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621edf2c-722f-4667-9a70-98722f90d3da None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:02.834000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621edf2c-722f-4667-9a70-98722f90d3da None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:02.834364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621edf2c-722f-4667-9a70-98722f90d3da None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:02.835662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 244/464] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:02.840033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621edf2c-722f-4667-9a70-98722f90d3da None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:02.887074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60696fe3-eaaa-4557-9aa0-ac8e13920e87 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:02.925823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1023-9dc9-4946-b6f9-8ba0c81ddde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:02.926423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1023-9dc9-4946-b6f9-8ba0c81ddde6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:02.926696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1023-9dc9-4946-b6f9-8ba0c81ddde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:02.926961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1023-9dc9-4946-b6f9-8ba0c81ddde6 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:02.927733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1023-9dc9-4946-b6f9-8ba0c81ddde6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:02.928057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1023-9dc9-4946-b6f9-8ba0c81ddde6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:02.929507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1023-9dc9-4946-b6f9-8ba0c81ddde6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:02.938157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:02.942143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 221/465] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:02.942956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1023-9dc9-4946-b6f9-8ba0c81ddde6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:02.949030 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621edf2c-722f-4667-9a70-98722f90d3da None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:02.982376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1872a-4cd1-484f-b65e-d5f24439daf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:02.982998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1872a-4cd1-484f-b65e-d5f24439daf2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:02.983306 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1872a-4cd1-484f-b65e-d5f24439daf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:02.983579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1872a-4cd1-484f-b65e-d5f24439daf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:02.998461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1872a-4cd1-484f-b65e-d5f24439daf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:03.000436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1872a-4cd1-484f-b65e-d5f24439daf2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-1ca1872a-4cd1-484f-b65e-d5f24439daf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:03.015059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:03.015988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:03.016797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:03.016797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:03.016797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:03.016797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 245/466] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:03.017716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eeca5-6f44-406a-88c8-e83b26fd2575 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:03.017716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eeca5-6f44-406a-88c8-e83b26fd2575 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:03.018012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eeca5-6f44-406a-88c8-e83b26fd2575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:03.026357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:03.036926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-701eeca5-6f44-406a-88c8-e83b26fd2575 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:03.038090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-701eeca5-6f44-406a-88c8-e83b26fd2575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:03.064575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1023-9dc9-4946-b6f9-8ba0c81ddde6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:03.101133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa29f2-3e20-4bd9-8643-d94555a321b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:03.101710 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa29f2-3e20-4bd9-8643-d94555a321b1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:03.101989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa29f2-3e20-4bd9-8643-d94555a321b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:03.102260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa29f2-3e20-4bd9-8643-d94555a321b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:03.102899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa29f2-3e20-4bd9-8643-d94555a321b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:03.103230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa29f2-3e20-4bd9-8643-d94555a321b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:03.104774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa29f2-3e20-4bd9-8643-d94555a321b1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:03.107365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 246/467] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:03.108134 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eeca5-6f44-406a-88c8-e83b26fd2575 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:03.123114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 222/468] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:03.123114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa29f2-3e20-4bd9-8643-d94555a321b1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:03.203176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:03.225570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eeca5-6f44-406a-88c8-e83b26fd2575 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:03.226051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa29f2-3e20-4bd9-8643-d94555a321b1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:03.254564 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:03.262924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdebd01-2aaa-48bd-917e-8819da4555d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:03.263604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdebd01-2aaa-48bd-917e-8819da4555d0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:03.263882 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdebd01-2aaa-48bd-917e-8819da4555d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:03.264149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdebd01-2aaa-48bd-917e-8819da4555d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:03.264427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17877d-57df-4c66-a4a0-abc3805c03fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:03.264837 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdebd01-2aaa-48bd-917e-8819da4555d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:03.265027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17877d-57df-4c66-a4a0-abc3805c03fb None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:03.265119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdebd01-2aaa-48bd-917e-8819da4555d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:03.265316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17877d-57df-4c66-a4a0-abc3805c03fb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:03.265572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17877d-57df-4c66-a4a0-abc3805c03fb None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:03.266200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17877d-57df-4c66-a4a0-abc3805c03fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:03.266487 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdebd01-2aaa-48bd-917e-8819da4555d0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:03.267799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17877d-57df-4c66-a4a0-abc3805c03fb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:03.283171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 223/469] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:03.283171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdebd01-2aaa-48bd-917e-8819da4555d0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:03.303155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 247/470] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:20:03 2022] POST /identity/v3/users => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:03.303155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17877d-57df-4c66-a4a0-abc3805c03fb None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:03.424406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17877d-57df-4c66-a4a0-abc3805c03fb None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:03.425365 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdebd01-2aaa-48bd-917e-8819da4555d0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:03.465791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ab061-babf-4f15-aac1-75dd7e92ac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:03.466430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ab061-babf-4f15-aac1-75dd7e92ac09 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:03.466770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ab061-babf-4f15-aac1-75dd7e92ac09 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:03.467217 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ab061-babf-4f15-aac1-75dd7e92ac09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:03.469792 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:03.474182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec83590-c20b-4e57-a92d-b4b5e50c8be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:03.474798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec83590-c20b-4e57-a92d-b4b5e50c8be0 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:03.476434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec83590-c20b-4e57-a92d-b4b5e50c8be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:03.476434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec83590-c20b-4e57-a92d-b4b5e50c8be0 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:03.476434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec83590-c20b-4e57-a92d-b4b5e50c8be0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:03.477535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec83590-c20b-4e57-a92d-b4b5e50c8be0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:03.482201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ab061-babf-4f15-aac1-75dd7e92ac09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:03.483886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ab061-babf-4f15-aac1-75dd7e92ac09 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-8a1ab061-babf-4f15-aac1-75dd7e92ac09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:03.499648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:03.500800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:03.501680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:03.501680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:03.501680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:03.501846 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 224/471] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:20:03 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:03.501846 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec83590-c20b-4e57-a92d-b4b5e50c8be0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:03.506910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 248/472] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:03.508317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0b20b-3b5c-4b2d-9411-b080e274fb66 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:03.508596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0b20b-3b5c-4b2d-9411-b080e274fb66 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:03.508864 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0b20b-3b5c-4b2d-9411-b080e274fb66 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:03.510374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 249/473] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:03.510952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0b20b-3b5c-4b2d-9411-b080e274fb66 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:03.567898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:03.641593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec83590-c20b-4e57-a92d-b4b5e50c8be0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:03.647910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0b20b-3b5c-4b2d-9411-b080e274fb66 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:03.685735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3687c-7777-4325-99b2-0ff424f17776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:03.686765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3687c-7777-4325-99b2-0ff424f17776 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:03.687039 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3687c-7777-4325-99b2-0ff424f17776 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:03.687325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3687c-7777-4325-99b2-0ff424f17776 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:03.688200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3687c-7777-4325-99b2-0ff424f17776 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:03.689660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3687c-7777-4325-99b2-0ff424f17776 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:03.701133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfd16b-3a1e-4d68-ad7c-20dbe935dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:03.701913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfd16b-3a1e-4d68-ad7c-20dbe935dfaa None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:03.702154 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfd16b-3a1e-4d68-ad7c-20dbe935dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:03.702453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfd16b-3a1e-4d68-ad7c-20dbe935dfaa None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:03.703485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfd16b-3a1e-4d68-ad7c-20dbe935dfaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:03.703719 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfd16b-3a1e-4d68-ad7c-20dbe935dfaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:03.705310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfd16b-3a1e-4d68-ad7c-20dbe935dfaa None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:03.712581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 225/474] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:20:03 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:03.713909 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5a20e-53be-4ce5-8a1e-6e2875ca2b6a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:03.714285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5a20e-53be-4ce5-8a1e-6e2875ca2b6a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:03.715038 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5a20e-53be-4ce5-8a1e-6e2875ca2b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:03.723619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 250/475] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:03.730812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfd16b-3a1e-4d68-ad7c-20dbe935dfaa None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:03.741151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-51f5a20e-53be-4ce5-8a1e-6e2875ca2b6a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:03.742998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-51f5a20e-53be-4ce5-8a1e-6e2875ca2b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:03.838270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:03.867571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 226/476] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:03.908068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5a20e-53be-4ce5-8a1e-6e2875ca2b6a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:03.912542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfd16b-3a1e-4d68-ad7c-20dbe935dfaa None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:03.944914 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:03.950559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14a51c-f51c-40df-9870-6ab7534910aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:03.951278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14a51c-f51c-40df-9870-6ab7534910aa None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:03.951558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14a51c-f51c-40df-9870-6ab7534910aa None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:03.951827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14a51c-f51c-40df-9870-6ab7534910aa None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:03.952468 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14a51c-f51c-40df-9870-6ab7534910aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:03.953887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14a51c-f51c-40df-9870-6ab7534910aa None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:03.985551 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 251/477] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:20:03 2022] POST /identity/v3/users => generated 249 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:04.043838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5a20e-53be-4ce5-8a1e-6e2875ca2b6a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:04.086196 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8091426-63ec-4205-9386-bead38765fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:04.086868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8091426-63ec-4205-9386-bead38765fb4 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:04.087175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8091426-63ec-4205-9386-bead38765fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:04.087444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8091426-63ec-4205-9386-bead38765fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:04.088117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8091426-63ec-4205-9386-bead38765fb4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:04.089616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8091426-63ec-4205-9386-bead38765fb4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:04.102382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.sql.core [None req-f8091426-63ec-4205-9386-bead38765fb4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 22:20:04.102382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 22:20:04.102382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [parameters: {'id': '7eb43c2b903d4ad794559fbfbf457dc3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 22:20:04.102382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80285) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f8091426-63ec-4205-9386-bead38765fb4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application conn.query(q) Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result.read() Aug 07 22:20:04.120358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return ref.to_dict() Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 22:20:04.121262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application next(self.gen) Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application yield resource Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application next(self.gen) Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise self.value Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application session.commit() Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 22:20:04.122224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.session.flush() Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application compat.raise_( Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 22:20:04.123814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 22:20:04.124869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application conn.query(q) Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result.read() Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 22:20:04.126097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [parameters: {'id': '7eb43c2b903d4ad794559fbfbf457dc3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:04.128460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 22:20:04.129264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:04.130380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 227/478] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Aug 7 22:20:03 2022] POST /identity/v3/roles => generated 144 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:04.134264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14a51c-f51c-40df-9870-6ab7534910aa None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:04.268552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14a51c-f51c-40df-9870-6ab7534910aa None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:04.270112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:04.307035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6119ec-30f5-4fc0-a348-23b08e4c9ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:04.307690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6119ec-30f5-4fc0-a348-23b08e4c9ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:04.307962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6119ec-30f5-4fc0-a348-23b08e4c9ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:04.308225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6119ec-30f5-4fc0-a348-23b08e4c9ab6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:04.318656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6119ec-30f5-4fc0-a348-23b08e4c9ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-6b6119ec-30f5-4fc0-a348-23b08e4c9ab6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:04.323899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:04.324794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:04.325561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 252/479] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:20:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:04.331236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8091426-63ec-4205-9386-bead38765fb4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:04.434163 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:04.441025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8091426-63ec-4205-9386-bead38765fb4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:04.479433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9d7dc-9192-453c-86e5-1e0cade28546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:04.480095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9d7dc-9192-453c-86e5-1e0cade28546 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:04.480370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9d7dc-9192-453c-86e5-1e0cade28546 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:04.480634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9d7dc-9192-453c-86e5-1e0cade28546 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:04.481480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9d7dc-9192-453c-86e5-1e0cade28546 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:04.481781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9d7dc-9192-453c-86e5-1e0cade28546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:04.483216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9d7dc-9192-453c-86e5-1e0cade28546 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:04.491845 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 228/480] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:05.729098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c23cd4-5bef-422a-832b-f971b20c742b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:05.731777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c23cd4-5bef-422a-832b-f971b20c742b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:05.731777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c23cd4-5bef-422a-832b-f971b20c742b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:05.732275 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 253/481] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:05.737566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a1871-a25e-4ed2-80a9-c7dbda107b9c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:05.737966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a1871-a25e-4ed2-80a9-c7dbda107b9c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:05.738131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a1871-a25e-4ed2-80a9-c7dbda107b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:05.764588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9f3a1871-a25e-4ed2-80a9-c7dbda107b9c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:05.765775 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9f3a1871-a25e-4ed2-80a9-c7dbda107b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:05.861811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 229/482] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:05.895135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c23cd4-5bef-422a-832b-f971b20c742b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:06.032701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c23cd4-5bef-422a-832b-f971b20c742b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:06.075113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ab5f5-1214-4b39-902a-ee1a0c8ef0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:06.075739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ab5f5-1214-4b39-902a-ee1a0c8ef0da None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.076016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ab5f5-1214-4b39-902a-ee1a0c8ef0da None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.076286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ab5f5-1214-4b39-902a-ee1a0c8ef0da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.088070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c53a3d-977c-4dd5-ac2b-eebba90f7bad None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.088342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c53a3d-977c-4dd5-ac2b-eebba90f7bad None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.088615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c53a3d-977c-4dd5-ac2b-eebba90f7bad None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.090193 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 230/483] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:06.092838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ab5f5-1214-4b39-902a-ee1a0c8ef0da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:06.094916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eb4cb-7e6a-46b7-a032-0551cb9ee13f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.095226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eb4cb-7e6a-46b7-a032-0551cb9ee13f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.095499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eb4cb-7e6a-46b7-a032-0551cb9ee13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-156ab5f5-1214-4b39-902a-ee1a0c8ef0da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:06.098101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:06.098956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:06.099790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 254/484] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:06.106545 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ab5f5-1214-4b39-902a-ee1a0c8ef0da None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:06.140173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5f0eb4cb-7e6a-46b7-a032-0551cb9ee13f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:06.141371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5f0eb4cb-7e6a-46b7-a032-0551cb9ee13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:06.141847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:06.215064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 231/485] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:06.239208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0eb4cb-7e6a-46b7-a032-0551cb9ee13f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:06.271527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:06.292267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ab5f5-1214-4b39-902a-ee1a0c8ef0da None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:06.339047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51713e-e6a5-4c1e-87f0-06f9bbbf2e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:06.339680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51713e-e6a5-4c1e-87f0-06f9bbbf2e99 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.339955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51713e-e6a5-4c1e-87f0-06f9bbbf2e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.340230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51713e-e6a5-4c1e-87f0-06f9bbbf2e99 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.340891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51713e-e6a5-4c1e-87f0-06f9bbbf2e99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:06.341190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51713e-e6a5-4c1e-87f0-06f9bbbf2e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:06.342938 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51713e-e6a5-4c1e-87f0-06f9bbbf2e99 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:06.359108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 255/486] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:06.359108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56eea1-b3d1-4ee6-bb92-f5b2c276ca7b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.359108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56eea1-b3d1-4ee6-bb92-f5b2c276ca7b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.359108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56eea1-b3d1-4ee6-bb92-f5b2c276ca7b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.359108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 256/487] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:06.359108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56eea1-b3d1-4ee6-bb92-f5b2c276ca7b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:06.380576 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0eb4cb-7e6a-46b7-a032-0551cb9ee13f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:06.426123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befa8ba-43d0-4023-b25e-f73d22d5696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:06.427541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befa8ba-43d0-4023-b25e-f73d22d5696d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.428264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befa8ba-43d0-4023-b25e-f73d22d5696d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.428692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befa8ba-43d0-4023-b25e-f73d22d5696d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.442678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befa8ba-43d0-4023-b25e-f73d22d5696d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4befa8ba-43d0-4023-b25e-f73d22d5696d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:06.448864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:06.449743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:06.450566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:06.450566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:06.450566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:06.450566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:06.450566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:06.450566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:06.450566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:06.450566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:06.450566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:06.450566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:06.450566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:06.450566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:06.455125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 232/488] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:06.456974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ea623-2ef0-4378-807c-4fd55331c3f1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.457326 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ea623-2ef0-4378-807c-4fd55331c3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.457668 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ea623-2ef0-4378-807c-4fd55331c3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.468396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:06.475115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b21ea623-2ef0-4378-807c-4fd55331c3f1 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:06.476380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b21ea623-2ef0-4378-807c-4fd55331c3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:06.488470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56eea1-b3d1-4ee6-bb92-f5b2c276ca7b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:06.527689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc2608-5b2f-4ba7-be96-55e177770334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:06.528582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc2608-5b2f-4ba7-be96-55e177770334 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.529065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc2608-5b2f-4ba7-be96-55e177770334 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.529547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc2608-5b2f-4ba7-be96-55e177770334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.541832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc2608-5b2f-4ba7-be96-55e177770334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:06.543623 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc2608-5b2f-4ba7-be96-55e177770334 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:06.555103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 233/489] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:06.555103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ea623-2ef0-4378-807c-4fd55331c3f1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:06.559163 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-17cc2608-5b2f-4ba7-be96-55e177770334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:06.569635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:06.570511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:06.571379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:06.571379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:06.571379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:06.573261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 257/490] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:06.578953 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc2608-5b2f-4ba7-be96-55e177770334 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:06.669761 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ea623-2ef0-4378-807c-4fd55331c3f1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:06.688185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc2608-5b2f-4ba7-be96-55e177770334 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:06.706083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c36a2-cae1-41d2-8a09-386577d4708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:06.706847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c36a2-cae1-41d2-8a09-386577d4708f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.707281 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c36a2-cae1-41d2-8a09-386577d4708f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.707703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c36a2-cae1-41d2-8a09-386577d4708f None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.708568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c36a2-cae1-41d2-8a09-386577d4708f None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:06.709089 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c36a2-cae1-41d2-8a09-386577d4708f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:06.710403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c36a2-cae1-41d2-8a09-386577d4708f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:06.723518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 234/491] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:06.724517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c36a2-cae1-41d2-8a09-386577d4708f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:06.727923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82f889-65a8-42e5-9461-20dee9aa1c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:06.728830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82f889-65a8-42e5-9461-20dee9aa1c43 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.729351 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82f889-65a8-42e5-9461-20dee9aa1c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.729930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82f889-65a8-42e5-9461-20dee9aa1c43 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.730216 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82f889-65a8-42e5-9461-20dee9aa1c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:06.730648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82f889-65a8-42e5-9461-20dee9aa1c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:06.732054 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82f889-65a8-42e5-9461-20dee9aa1c43 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:06.734602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:06.746636 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 258/492] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:06.747797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82f889-65a8-42e5-9461-20dee9aa1c43 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:06.804894 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:06.840268 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c36a2-cae1-41d2-8a09-386577d4708f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:06.854123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82f889-65a8-42e5-9461-20dee9aa1c43 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:06.877991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40e0b3-ad0b-48b3-9e2a-668f1d56ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:06.878617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40e0b3-ad0b-48b3-9e2a-668f1d56ce05 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.878889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40e0b3-ad0b-48b3-9e2a-668f1d56ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.879184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40e0b3-ad0b-48b3-9e2a-668f1d56ce05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.889552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356976e-5dc5-45ec-98e1-2bbdc445ef36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:06.889865 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40e0b3-ad0b-48b3-9e2a-668f1d56ce05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:06.890169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356976e-5dc5-45ec-98e1-2bbdc445ef36 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.890439 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356976e-5dc5-45ec-98e1-2bbdc445ef36 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.890705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356976e-5dc5-45ec-98e1-2bbdc445ef36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-ba40e0b3-ad0b-48b3-9e2a-668f1d56ce05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:06.895065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:06.895931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:06.896715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 235/493] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:06.897393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18222a05-ab5f-41e5-949c-4a8abfb8fda4 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:06.898457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18222a05-ab5f-41e5-949c-4a8abfb8fda4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:06.898457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18222a05-ab5f-41e5-949c-4a8abfb8fda4 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:06.899159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 236/494] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:06.899800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18222a05-ab5f-41e5-949c-4a8abfb8fda4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:06.912086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356976e-5dc5-45ec-98e1-2bbdc445ef36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:06.913541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356976e-5dc5-45ec-98e1-2bbdc445ef36 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-7356976e-5dc5-45ec-98e1-2bbdc445ef36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:06.928859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:06.929869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:06.930692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:06.930692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:06.930692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:06.930692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 259/495] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:06.930692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356976e-5dc5-45ec-98e1-2bbdc445ef36 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:06.992490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:07.021921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18222a05-ab5f-41e5-949c-4a8abfb8fda4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:07.041586 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356976e-5dc5-45ec-98e1-2bbdc445ef36 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:07.052618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:07.061732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390aac7a-30c1-4542-9b0b-598470478941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:07.062725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390aac7a-30c1-4542-9b0b-598470478941 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.063005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390aac7a-30c1-4542-9b0b-598470478941 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.063500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390aac7a-30c1-4542-9b0b-598470478941 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.071682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390aac7a-30c1-4542-9b0b-598470478941 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:07.073109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390aac7a-30c1-4542-9b0b-598470478941 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:07.076662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f251978-9692-47ce-8807-c4069d22170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:07.077252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251978-9692-47ce-8807-c4069d22170f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.077524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251978-9692-47ce-8807-c4069d22170f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.077785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251978-9692-47ce-8807-c4069d22170f None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.078429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f251978-9692-47ce-8807-c4069d22170f None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:07.078723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f251978-9692-47ce-8807-c4069d22170f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:07.080102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f251978-9692-47ce-8807-c4069d22170f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-390aac7a-30c1-4542-9b0b-598470478941 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:07.086019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:07.086873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:07.088156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:07.088156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:07.088156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:07.088156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:07.088156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:07.088156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:07.088156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:07.088156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:07.088156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:20:07.088156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:07.088156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 237/496] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 22:20:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:07.088705 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004efb7-59cd-4646-ac1a-7289f6663485 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.088705 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004efb7-59cd-4646-ac1a-7289f6663485 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.088817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004efb7-59cd-4646-ac1a-7289f6663485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.098478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 260/497] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:07.098478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f251978-9692-47ce-8807-c4069d22170f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:07.111638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8004efb7-59cd-4646-ac1a-7289f6663485 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:07.112610 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8004efb7-59cd-4646-ac1a-7289f6663485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:07.184559 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 238/498] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:07.185808 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004efb7-59cd-4646-ac1a-7289f6663485 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:07.205461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f251978-9692-47ce-8807-c4069d22170f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:07.216211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:07.240448 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709bd46-821e-4c2b-a972-2fe71b196505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:07.241043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709bd46-821e-4c2b-a972-2fe71b196505 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.241317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709bd46-821e-4c2b-a972-2fe71b196505 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.241591 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709bd46-821e-4c2b-a972-2fe71b196505 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.242219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709bd46-821e-4c2b-a972-2fe71b196505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:07.242517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709bd46-821e-4c2b-a972-2fe71b196505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:07.243898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709bd46-821e-4c2b-a972-2fe71b196505 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:07.256085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 261/499] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:07.256857 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709bd46-821e-4c2b-a972-2fe71b196505 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:07.287962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004efb7-59cd-4646-ac1a-7289f6663485 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:07.305145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:07.323331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32761d9-67f9-4cf3-9dc6-4d4d155daf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:07.323861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32761d9-67f9-4cf3-9dc6-4d4d155daf92 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32761d9-67f9-4cf3-9dc6-4d4d155daf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.324402 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32761d9-67f9-4cf3-9dc6-4d4d155daf92 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.325115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32761d9-67f9-4cf3-9dc6-4d4d155daf92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:07.325409 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32761d9-67f9-4cf3-9dc6-4d4d155daf92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:07.326829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32761d9-67f9-4cf3-9dc6-4d4d155daf92 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:07.360140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709bd46-821e-4c2b-a972-2fe71b196505 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:07.363639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 239/500] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 22:20:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:07.364864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbba66-fb89-4502-89c7-7c5c510a6be7 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.365149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbba66-fb89-4502-89c7-7c5c510a6be7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.365416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbba66-fb89-4502-89c7-7c5c510a6be7 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.370596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 240/501] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:07.370596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbba66-fb89-4502-89c7-7c5c510a6be7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:07.395701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9f345-ccc0-4cac-911d-ed7cfcb31411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:07.396316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9f345-ccc0-4cac-911d-ed7cfcb31411 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.396588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9f345-ccc0-4cac-911d-ed7cfcb31411 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.396853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9f345-ccc0-4cac-911d-ed7cfcb31411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.406532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9f345-ccc0-4cac-911d-ed7cfcb31411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:07.408003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9f345-ccc0-4cac-911d-ed7cfcb31411 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-7de9f345-ccc0-4cac-911d-ed7cfcb31411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:07.422464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:07.423418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:07.424797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:07.424797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:07.424797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:07.424797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 262/502] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:07.425028 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9f345-ccc0-4cac-911d-ed7cfcb31411 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:07.449851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:07.472410 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbba66-fb89-4502-89c7-7c5c510a6be7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:07.506835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a64272-5bff-45be-b934-99207340e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:07.507480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a64272-5bff-45be-b934-99207340e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.507756 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a64272-5bff-45be-b934-99207340e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.508025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a64272-5bff-45be-b934-99207340e3d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.517738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a64272-5bff-45be-b934-99207340e3d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e4a64272-5bff-45be-b934-99207340e3d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:07.522396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:07.523472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:07.524475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:07.524475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:07.524475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:07.524475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:07.524475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:07.524475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:07.524475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:07.524475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:07.524475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:07.524475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:07.524475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:07.524475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:07.525216 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9f345-ccc0-4cac-911d-ed7cfcb31411 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:07.527213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 241/503] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:07.528171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a64272-5bff-45be-b934-99207340e3d6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:07.556933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a094f6-641d-4b93-9301-9ee2817cd329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:07.557546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a094f6-641d-4b93-9301-9ee2817cd329 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.557822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a094f6-641d-4b93-9301-9ee2817cd329 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.558091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a094f6-641d-4b93-9301-9ee2817cd329 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.565613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a094f6-641d-4b93-9301-9ee2817cd329 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:07.567192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a094f6-641d-4b93-9301-9ee2817cd329 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:07.572525 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-e5a094f6-641d-4b93-9301-9ee2817cd329 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:07.579288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:07.580350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:07.581430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:07.581430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:07.581430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:07.581430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:07.581430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:07.581430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:07.581430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:07.581430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:07.581430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 22:20:07.581430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:07.587115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 263/504] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:07.587115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1f4e8-148a-4f7c-af6c-27350f98c114 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.587115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1f4e8-148a-4f7c-af6c-27350f98c114 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.587115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1f4e8-148a-4f7c-af6c-27350f98c114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.602468 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-eaf1f4e8-148a-4f7c-af6c-27350f98c114 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:07.603674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-eaf1f4e8-148a-4f7c-af6c-27350f98c114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:07.638365 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a64272-5bff-45be-b934-99207340e3d6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:07.669936 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 264/505] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:07.670760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1f4e8-148a-4f7c-af6c-27350f98c114 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:07.671802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758b839-e871-4bb5-8b0c-65da9937ceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:07.672399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758b839-e871-4bb5-8b0c-65da9937ceea None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.672678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758b839-e871-4bb5-8b0c-65da9937ceea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.672946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758b839-e871-4bb5-8b0c-65da9937ceea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.688225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:07.748017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758b839-e871-4bb5-8b0c-65da9937ceea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:07.749487 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758b839-e871-4bb5-8b0c-65da9937ceea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:07.772590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1f4e8-148a-4f7c-af6c-27350f98c114 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:07.783357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:07.810444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910bdb4-5f43-4a4e-9c4f-ba0b76e4b54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:07.811042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910bdb4-5f43-4a4e-9c4f-ba0b76e4b54d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.811357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910bdb4-5f43-4a4e-9c4f-ba0b76e4b54d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.811626 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910bdb4-5f43-4a4e-9c4f-ba0b76e4b54d None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.812260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910bdb4-5f43-4a4e-9c4f-ba0b76e4b54d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:07.812561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910bdb4-5f43-4a4e-9c4f-ba0b76e4b54d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:07.813897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910bdb4-5f43-4a4e-9c4f-ba0b76e4b54d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:07.825102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 265/506] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:07.825790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910bdb4-5f43-4a4e-9c4f-ba0b76e4b54d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:07.853012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 242/507] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:20:07.853928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758b839-e871-4bb5-8b0c-65da9937ceea None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:07.895063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:07.923947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910bdb4-5f43-4a4e-9c4f-ba0b76e4b54d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:07.951321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758b839-e871-4bb5-8b0c-65da9937ceea None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:07.956411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ad9c1-9f03-49d9-9395-2b5b9d05551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:07.956997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ad9c1-9f03-49d9-9395-2b5b9d05551c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.957269 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ad9c1-9f03-49d9-9395-2b5b9d05551c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.957535 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ad9c1-9f03-49d9-9395-2b5b9d05551c None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.958182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ad9c1-9f03-49d9-9395-2b5b9d05551c None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:07.958476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ad9c1-9f03-49d9-9395-2b5b9d05551c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:07.959853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ad9c1-9f03-49d9-9395-2b5b9d05551c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:07.967524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 266/508] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:07.968117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ad9c1-9f03-49d9-9395-2b5b9d05551c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:07.993545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38535ea4-93c3-4333-84a1-6d36e540df4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:07.994153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38535ea4-93c3-4333-84a1-6d36e540df4d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:07.994429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38535ea4-93c3-4333-84a1-6d36e540df4d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:07.994699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38535ea4-93c3-4333-84a1-6d36e540df4d None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:07.995468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38535ea4-93c3-4333-84a1-6d36e540df4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:07.995770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38535ea4-93c3-4333-84a1-6d36e540df4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:07.997193 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38535ea4-93c3-4333-84a1-6d36e540df4d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:07.999844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:08.016649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 243/509] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Aug 7 22:20:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:08.017639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38535ea4-93c3-4333-84a1-6d36e540df4d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:08.066409 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ad9c1-9f03-49d9-9395-2b5b9d05551c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:08.098637 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25f402-0e64-4c8a-9db9-7e048760da6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:08.099287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25f402-0e64-4c8a-9db9-7e048760da6e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:08.099560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25f402-0e64-4c8a-9db9-7e048760da6e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:08.099829 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25f402-0e64-4c8a-9db9-7e048760da6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:08.101648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:08.110477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25f402-0e64-4c8a-9db9-7e048760da6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:08.112407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25f402-0e64-4c8a-9db9-7e048760da6e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:08.114147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38535ea4-93c3-4333-84a1-6d36e540df4d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-db25f402-0e64-4c8a-9db9-7e048760da6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:08.128155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:08.134062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:08.135209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:08.135209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:08.135209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:08.135209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 267/510] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:08.135209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25f402-0e64-4c8a-9db9-7e048760da6e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:08.149534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376edaf-46d6-4d4f-a976-6a25e31b320e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:08.150155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376edaf-46d6-4d4f-a976-6a25e31b320e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:08.150435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376edaf-46d6-4d4f-a976-6a25e31b320e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:08.150704 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376edaf-46d6-4d4f-a976-6a25e31b320e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:08.159582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376edaf-46d6-4d4f-a976-6a25e31b320e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:08.161950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376edaf-46d6-4d4f-a976-6a25e31b320e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1376edaf-46d6-4d4f-a976-6a25e31b320e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:08.173659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:08.175062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:08.176146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:08.176146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:08.176146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:08.176146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:08.176146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:08.176146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:08.176146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:08.176146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:08.176146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 22:20:08.176146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:08.176146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 244/511] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:08.176860 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376edaf-46d6-4d4f-a976-6a25e31b320e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:08.228802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:08.235826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25f402-0e64-4c8a-9db9-7e048760da6e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:08.269770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d5b52-9dd8-4071-af87-85859a822592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:08.270470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d5b52-9dd8-4071-af87-85859a822592 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:08.270643 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d5b52-9dd8-4071-af87-85859a822592 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:08.270906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d5b52-9dd8-4071-af87-85859a822592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:08.273800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376edaf-46d6-4d4f-a976-6a25e31b320e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:08.280943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d5b52-9dd8-4071-af87-85859a822592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:08.282356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d5b52-9dd8-4071-af87-85859a822592 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-4f8d5b52-9dd8-4071-af87-85859a822592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:08.296340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:08.297405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:08.298234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:08.298234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:08.298234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:08.298234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 268/512] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:08.298234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d5b52-9dd8-4071-af87-85859a822592 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:08.310590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e227441-623f-434b-aa36-329aece5343f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:08.311241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227441-623f-434b-aa36-329aece5343f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:08.311518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227441-623f-434b-aa36-329aece5343f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:08.311786 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227441-623f-434b-aa36-329aece5343f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:08.322405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e227441-623f-434b-aa36-329aece5343f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:08.323866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e227441-623f-434b-aa36-329aece5343f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4e227441-623f-434b-aa36-329aece5343f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:08.337396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:08.338297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:08.339528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:08.339528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:08.339528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:08.339528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 245/513] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:08.339528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e227441-623f-434b-aa36-329aece5343f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:08.340251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:08.401302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d5b52-9dd8-4071-af87-85859a822592 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:08.435256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ab04f-eeb0-4b63-b11c-e58d8c54052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:08.435849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ab04f-eeb0-4b63-b11c-e58d8c54052e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:08.436121 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ab04f-eeb0-4b63-b11c-e58d8c54052e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:08.436386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ab04f-eeb0-4b63-b11c-e58d8c54052e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:08.436738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e227441-623f-434b-aa36-329aece5343f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:08.443382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:08.469320 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e6092-1c1d-4cbf-b612-cc412f3dd8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:08.469907 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e6092-1c1d-4cbf-b612-cc412f3dd8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:08.470180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e6092-1c1d-4cbf-b612-cc412f3dd8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:08.470451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e6092-1c1d-4cbf-b612-cc412f3dd8f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:08.471734 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e6092-1c1d-4cbf-b612-cc412f3dd8f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:08.472038 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e6092-1c1d-4cbf-b612-cc412f3dd8f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:08.473390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e6092-1c1d-4cbf-b612-cc412f3dd8f8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:08.484883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 246/514] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:08.485766 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e6092-1c1d-4cbf-b612-cc412f3dd8f8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:08.505671 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ab04f-eeb0-4b63-b11c-e58d8c54052e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:08.507150 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ab04f-eeb0-4b63-b11c-e58d8c54052e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:08.544664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:08.586283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e6092-1c1d-4cbf-b612-cc412f3dd8f8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:08.606819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 269/515] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:20:08.607786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ab04f-eeb0-4b63-b11c-e58d8c54052e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:08.620505 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d6b18-e665-443b-83da-e4682bd332be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:08.621104 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d6b18-e665-443b-83da-e4682bd332be None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:08.621374 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d6b18-e665-443b-83da-e4682bd332be None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:08.621639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d6b18-e665-443b-83da-e4682bd332be None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:08.622360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d6b18-e665-443b-83da-e4682bd332be None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:08.622658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d6b18-e665-443b-83da-e4682bd332be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:08.624124 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d6b18-e665-443b-83da-e4682bd332be None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:08.641712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 247/516] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Aug 7 22:20:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:08.642597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d6b18-e665-443b-83da-e4682bd332be None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:08.669975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:08.711373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ab04f-eeb0-4b63-b11c-e58d8c54052e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:08.744201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f4e99-6c96-4374-b1a1-cba2e078cc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:08.744795 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f4e99-6c96-4374-b1a1-cba2e078cc70 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:08.745070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f4e99-6c96-4374-b1a1-cba2e078cc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:08.745334 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f4e99-6c96-4374-b1a1-cba2e078cc70 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:08.745531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d6b18-e665-443b-83da-e4682bd332be None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:08.745964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f4e99-6c96-4374-b1a1-cba2e078cc70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:08.746260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f4e99-6c96-4374-b1a1-cba2e078cc70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:08.747656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f4e99-6c96-4374-b1a1-cba2e078cc70 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:08.754714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:08.760159 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 270/517] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:08.760925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f4e99-6c96-4374-b1a1-cba2e078cc70 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:08.780422 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c41894-21da-4314-9970-37bec006519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:08.781017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c41894-21da-4314-9970-37bec006519e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:08.781294 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c41894-21da-4314-9970-37bec006519e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:08.781560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c41894-21da-4314-9970-37bec006519e None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:08.782185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c41894-21da-4314-9970-37bec006519e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:08.782484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c41894-21da-4314-9970-37bec006519e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:08.783863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c41894-21da-4314-9970-37bec006519e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:08.794808 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 248/518] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:08.795655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c41894-21da-4314-9970-37bec006519e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:08.862418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f4e99-6c96-4374-b1a1-cba2e078cc70 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:08.878977 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:08.894621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c41894-21da-4314-9970-37bec006519e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:08.895909 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6eb9e-f107-4570-9292-aa0829317734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:08.896504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6eb9e-f107-4570-9292-aa0829317734 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:08.896783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6eb9e-f107-4570-9292-aa0829317734 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:08.897048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6eb9e-f107-4570-9292-aa0829317734 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:08.897662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6eb9e-f107-4570-9292-aa0829317734 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:08.899067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6eb9e-f107-4570-9292-aa0829317734 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:08.919743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 271/519] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:20:08 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:08.920591 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6eb9e-f107-4570-9292-aa0829317734 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:08.938683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f563e56-1d74-46f8-8515-e9e2283f559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:08.939690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f563e56-1d74-46f8-8515-e9e2283f559b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:08.940708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f563e56-1d74-46f8-8515-e9e2283f559b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:08.941155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f563e56-1d74-46f8-8515-e9e2283f559b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:08.953966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f563e56-1d74-46f8-8515-e9e2283f559b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:08.955483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f563e56-1d74-46f8-8515-e9e2283f559b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-6f563e56-1d74-46f8-8515-e9e2283f559b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:08.971492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:08.972458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:08.973287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:08.973287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:08.973287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:08.973287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 249/520] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:08.973498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f563e56-1d74-46f8-8515-e9e2283f559b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:08.991850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:09.036429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6eb9e-f107-4570-9292-aa0829317734 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:09.072765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e037-5745-4de1-875f-b6ce191d6cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:09.073016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e037-5745-4de1-875f-b6ce191d6cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:09.073293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e037-5745-4de1-875f-b6ce191d6cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:09.073562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e037-5745-4de1-875f-b6ce191d6cc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:09.102384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f563e56-1d74-46f8-8515-e9e2283f559b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:09.146595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e7f49-4505-426f-b069-283a23745ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:09.147294 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e7f49-4505-426f-b069-283a23745ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:09.147574 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e7f49-4505-426f-b069-283a23745ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:09.147840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e7f49-4505-426f-b069-283a23745ac5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:09.150854 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:09.151539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88e037-5745-4de1-875f-b6ce191d6cc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:09.153101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88e037-5745-4de1-875f-b6ce191d6cc3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:09.156613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e7f49-4505-426f-b069-283a23745ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:09.157529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e7f49-4505-426f-b069-283a23745ac5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-cd5e7f49-4505-426f-b069-283a23745ac5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:09.169920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:09.170827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:09.171982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:09.171982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:09.171982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:09.171982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:09.171982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:09.171982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:09.171982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:09.171982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:09.171982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 250/521] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:09.171982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e7f49-4505-426f-b069-283a23745ac5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:09.217009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:09.272141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 272/522] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:20:09.272141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e037-5745-4de1-875f-b6ce191d6cc3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:09.289730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e7f49-4505-426f-b069-283a23745ac5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:09.325297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b700bd-23df-46d4-94dc-d368ca09cf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:09.325911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b700bd-23df-46d4-94dc-d368ca09cf3c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:09.326184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b700bd-23df-46d4-94dc-d368ca09cf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:09.326448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b700bd-23df-46d4-94dc-d368ca09cf3c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:09.334625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b700bd-23df-46d4-94dc-d368ca09cf3c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:09.336107 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b700bd-23df-46d4-94dc-d368ca09cf3c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-90b700bd-23df-46d4-94dc-d368ca09cf3c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:09.347140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:09.348048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:09.348915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:09.348915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:09.348915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:09.348915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:09.348915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:09.348915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:09.348915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:09.348915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:09.348915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 22:20:09.348915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:09.348915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 251/523] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:09.349464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b700bd-23df-46d4-94dc-d368ca09cf3c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:09.380402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e037-5745-4de1-875f-b6ce191d6cc3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:09.410589 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:09.419618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4048167-36cd-4b03-8c06-a1959ceff837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:09.420223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4048167-36cd-4b03-8c06-a1959ceff837 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:09.420496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4048167-36cd-4b03-8c06-a1959ceff837 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:09.420762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4048167-36cd-4b03-8c06-a1959ceff837 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:09.421446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4048167-36cd-4b03-8c06-a1959ceff837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:09.421695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4048167-36cd-4b03-8c06-a1959ceff837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:09.423056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4048167-36cd-4b03-8c06-a1959ceff837 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:09.435181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 273/524] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:09.435867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4048167-36cd-4b03-8c06-a1959ceff837 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:09.452525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:09.467309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b700bd-23df-46d4-94dc-d368ca09cf3c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:09.508079 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d25b3d-6c3e-49c5-82f0-6d245770c755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:09.509188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d25b3d-6c3e-49c5-82f0-6d245770c755 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:09.509188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d25b3d-6c3e-49c5-82f0-6d245770c755 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:09.509188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d25b3d-6c3e-49c5-82f0-6d245770c755 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:09.509871 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d25b3d-6c3e-49c5-82f0-6d245770c755 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:09.510176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d25b3d-6c3e-49c5-82f0-6d245770c755 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:09.511629 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d25b3d-6c3e-49c5-82f0-6d245770c755 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:09.530036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 252/525] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:09.530746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d25b3d-6c3e-49c5-82f0-6d245770c755 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:09.544559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4048167-36cd-4b03-8c06-a1959ceff837 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:09.582992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804c2e7-7f06-431b-b112-0aa6925300eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:09.583642 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804c2e7-7f06-431b-b112-0aa6925300eb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:09.583918 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804c2e7-7f06-431b-b112-0aa6925300eb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:09.584189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804c2e7-7f06-431b-b112-0aa6925300eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:09.594833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804c2e7-7f06-431b-b112-0aa6925300eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:09.596826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804c2e7-7f06-431b-b112-0aa6925300eb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-9804c2e7-7f06-431b-b112-0aa6925300eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:09.610977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:09.612110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:09.613248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:09.613248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:09.613248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:09.621238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 274/526] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:09.622059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804c2e7-7f06-431b-b112-0aa6925300eb None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:09.647190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d25b3d-6c3e-49c5-82f0-6d245770c755 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:09.666273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:09.686556 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27a0c8-c2bc-4975-aa45-0c06f8e9a2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:09.687076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27a0c8-c2bc-4975-aa45-0c06f8e9a2be None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:09.687376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27a0c8-c2bc-4975-aa45-0c06f8e9a2be None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:09.687810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27a0c8-c2bc-4975-aa45-0c06f8e9a2be None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:09.688394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27a0c8-c2bc-4975-aa45-0c06f8e9a2be None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:09.688656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27a0c8-c2bc-4975-aa45-0c06f8e9a2be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:09.690104 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27a0c8-c2bc-4975-aa45-0c06f8e9a2be None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:09.691705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:09.709996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 253/527] 10.222.0.15 () {56 vars in 1139 bytes} [Sun Aug 7 22:20:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:09.710729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27a0c8-c2bc-4975-aa45-0c06f8e9a2be None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:09.736191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804c2e7-7f06-431b-b112-0aa6925300eb None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:09.771427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce7e0a-c11d-4c39-86dc-37b171b1ff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:09.772079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce7e0a-c11d-4c39-86dc-37b171b1ff23 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:09.772358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce7e0a-c11d-4c39-86dc-37b171b1ff23 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:09.772628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce7e0a-c11d-4c39-86dc-37b171b1ff23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:09.780447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce7e0a-c11d-4c39-86dc-37b171b1ff23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:09.781691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce7e0a-c11d-4c39-86dc-37b171b1ff23 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-c7ce7e0a-c11d-4c39-86dc-37b171b1ff23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:09.793529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:09.794356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:09.795308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:09.795308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:09.795308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:09.795308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:09.795308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:09.795308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:09.795308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:09.795308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:09.799359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 275/528] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:09.800177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce7e0a-c11d-4c39-86dc-37b171b1ff23 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:09.819949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27a0c8-c2bc-4975-aa45-0c06f8e9a2be None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:09.856855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55ea8b-ad56-428f-9a0e-a19f459409a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:09.857522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55ea8b-ad56-428f-9a0e-a19f459409a3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:09.857719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55ea8b-ad56-428f-9a0e-a19f459409a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:09.857990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55ea8b-ad56-428f-9a0e-a19f459409a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:09.858863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55ea8b-ad56-428f-9a0e-a19f459409a3 None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=cc8bf701e94c403ab70fcffaeb81b65b) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:09.859040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55ea8b-ad56-428f-9a0e-a19f459409a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:09.860478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55ea8b-ad56-428f-9a0e-a19f459409a3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:09.865956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 254/529] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:09 2022] GET /identity/v3/role_assignments?user.id=cc8bf701e94c403ab70fcffaeb81b65b&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:09.866625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55ea8b-ad56-428f-9a0e-a19f459409a3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:09.912990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:09.933805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce7e0a-c11d-4c39-86dc-37b171b1ff23 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:09.974167 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:09.987351 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbd967-2d2a-467a-bc4f-a547e97fc786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:09.988222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbd967-2d2a-467a-bc4f-a547e97fc786 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:09.988669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbd967-2d2a-467a-bc4f-a547e97fc786 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:09.989103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbd967-2d2a-467a-bc4f-a547e97fc786 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:09.989896 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbd967-2d2a-467a-bc4f-a547e97fc786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:09.990339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbd967-2d2a-467a-bc4f-a547e97fc786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:09.992520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbd967-2d2a-467a-bc4f-a547e97fc786 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:09.998038 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55ea8b-ad56-428f-9a0e-a19f459409a3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:10.010636 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 276/530] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:10.011875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbd967-2d2a-467a-bc4f-a547e97fc786 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:10.049166 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bda3b-5b6b-40f1-9405-67a5096c007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:10.050033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bda3b-5b6b-40f1-9405-67a5096c007f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:10.050768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bda3b-5b6b-40f1-9405-67a5096c007f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:10.051044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bda3b-5b6b-40f1-9405-67a5096c007f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:10.129535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bda3b-5b6b-40f1-9405-67a5096c007f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:10.131041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bda3b-5b6b-40f1-9405-67a5096c007f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:10.152137 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbd967-2d2a-467a-bc4f-a547e97fc786 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:10.173448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:10.208094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bb6cb-fbc6-4de7-a39c-9c3dd3c7f28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:10.209076 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bb6cb-fbc6-4de7-a39c-9c3dd3c7f28f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:10.209555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bb6cb-fbc6-4de7-a39c-9c3dd3c7f28f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:10.210046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bb6cb-fbc6-4de7-a39c-9c3dd3c7f28f None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:10.210945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bb6cb-fbc6-4de7-a39c-9c3dd3c7f28f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:10.211469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bb6cb-fbc6-4de7-a39c-9c3dd3c7f28f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:10.213651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bb6cb-fbc6-4de7-a39c-9c3dd3c7f28f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:10.243518 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 277/531] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:10.244691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 255/532] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:20:10.245006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bb6cb-fbc6-4de7-a39c-9c3dd3c7f28f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:10.245562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bda3b-5b6b-40f1-9405-67a5096c007f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:10.304026 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:10.362500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bb6cb-fbc6-4de7-a39c-9c3dd3c7f28f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:10.369561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bda3b-5b6b-40f1-9405-67a5096c007f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:10.408119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efedf2-4268-475b-b192-11d1fee46d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:10.409635 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efedf2-4268-475b-b192-11d1fee46d22 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:10.410054 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6e2a3-f6fe-46c7-9f26-7351c5992cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:10.410360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efedf2-4268-475b-b192-11d1fee46d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:10.410674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6e2a3-f6fe-46c7-9f26-7351c5992cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:10.410944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6e2a3-f6fe-46c7-9f26-7351c5992cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:10.411237 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6e2a3-f6fe-46c7-9f26-7351c5992cc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:10.411451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efedf2-4268-475b-b192-11d1fee46d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:10.419100 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:10.420237 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6e2a3-f6fe-46c7-9f26-7351c5992cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:10.422155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6e2a3-f6fe-46c7-9f26-7351c5992cc0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:10.423701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efedf2-4268-475b-b192-11d1fee46d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:10.425718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efedf2-4268-475b-b192-11d1fee46d22 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a9b6e2a3-f6fe-46c7-9f26-7351c5992cc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:10.436573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:10.437410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:10.438229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:10.438229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:10.438229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:10.438229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:10.438229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:10.438229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:10.438229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:10.438229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:10.442395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 278/533] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:10.443260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6e2a3-f6fe-46c7-9f26-7351c5992cc0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-c2efedf2-4268-475b-b192-11d1fee46d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:10.444636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:10.445479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:10.446306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:10.446306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:10.446306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:10.448354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 256/534] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:10.449330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efedf2-4268-475b-b192-11d1fee46d22 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:10.563338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6e2a3-f6fe-46c7-9f26-7351c5992cc0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:10.570794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:10.583327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efedf2-4268-475b-b192-11d1fee46d22 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:10.601215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fed25-3d9f-41a8-a819-53c5c2151f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:10.601959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fed25-3d9f-41a8-a819-53c5c2151f63 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:10.602338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fed25-3d9f-41a8-a819-53c5c2151f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:10.602863 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fed25-3d9f-41a8-a819-53c5c2151f63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:10.603597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fed25-3d9f-41a8-a819-53c5c2151f63 None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=c6639f15880c4c718f41cd84cb79c750) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:10.604005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fed25-3d9f-41a8-a819-53c5c2151f63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:10.605571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fed25-3d9f-41a8-a819-53c5c2151f63 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:10.619612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 279/535] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:10 2022] GET /identity/v3/role_assignments?user.id=c6639f15880c4c718f41cd84cb79c750&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:10.620751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fed25-3d9f-41a8-a819-53c5c2151f63 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:10.627056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b92823-64fa-4278-b44c-fd0654c3cd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:10.628074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b92823-64fa-4278-b44c-fd0654c3cd17 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:10.629567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b92823-64fa-4278-b44c-fd0654c3cd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:10.630023 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b92823-64fa-4278-b44c-fd0654c3cd17 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:10.630886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b92823-64fa-4278-b44c-fd0654c3cd17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:10.631356 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b92823-64fa-4278-b44c-fd0654c3cd17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:10.632933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b92823-64fa-4278-b44c-fd0654c3cd17 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:10.649266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 257/536] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:10.660906 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b92823-64fa-4278-b44c-fd0654c3cd17 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:10.753435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:10.806680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b92823-64fa-4278-b44c-fd0654c3cd17 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:10.854347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54e584-8789-41c6-af2b-e7076b7ce2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:10.855198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54e584-8789-41c6-af2b-e7076b7ce2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:10.855621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54e584-8789-41c6-af2b-e7076b7ce2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:10.856011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54e584-8789-41c6-af2b-e7076b7ce2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:10.856882 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54e584-8789-41c6-af2b-e7076b7ce2c7 None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=1cfe1875cce3436eac2ac8f4d6db88bc) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:10.857307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54e584-8789-41c6-af2b-e7076b7ce2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:10.858847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54e584-8789-41c6-af2b-e7076b7ce2c7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:10.866941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fed25-3d9f-41a8-a819-53c5c2151f63 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:10.878064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 258/537] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:10 2022] GET /identity/v3/role_assignments?user.id=1cfe1875cce3436eac2ac8f4d6db88bc&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:10.906161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546e496-6488-4952-a807-6fef95c6ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:10.907108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546e496-6488-4952-a807-6fef95c6ca68 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:10.907659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546e496-6488-4952-a807-6fef95c6ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:10.908075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546e496-6488-4952-a807-6fef95c6ca68 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:10.909533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546e496-6488-4952-a807-6fef95c6ca68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:10.909986 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546e496-6488-4952-a807-6fef95c6ca68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:10.911595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546e496-6488-4952-a807-6fef95c6ca68 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:10.925805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 280/538] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:10.931514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54e584-8789-41c6-af2b-e7076b7ce2c7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:11.022700 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e8095-40ba-4bb8-b976-8b06094db58d None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:11.023267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e8095-40ba-4bb8-b976-8b06094db58d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:11.023267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e8095-40ba-4bb8-b976-8b06094db58d None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:11.024727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 281/539] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:20:11.030408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980a963-21c1-4efe-b65b-a8cc774361d9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:11.031025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980a963-21c1-4efe-b65b-a8cc774361d9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:11.031538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980a963-21c1-4efe-b65b-a8cc774361d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:11.054261 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54e584-8789-41c6-af2b-e7076b7ce2c7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:11.055854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b980a963-21c1-4efe-b65b-a8cc774361d9 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:11.057402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b980a963-21c1-4efe-b65b-a8cc774361d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:11.070970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:11.099074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:11.110804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c838d-b805-4def-b837-af477444660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:11.111433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c838d-b805-4def-b837-af477444660f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:11.112273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c838d-b805-4def-b837-af477444660f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:11.112542 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c838d-b805-4def-b837-af477444660f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:11.130974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c838d-b805-4def-b837-af477444660f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:11.132473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c838d-b805-4def-b837-af477444660f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-537c838d-b805-4def-b837-af477444660f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:11.148657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:11.149537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:11.150586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:11.150586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:11.150586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:11.150586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:11.150586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:11.150586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:11.150586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:11.150586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:11.150586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 259/540] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:11.157662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c838d-b805-4def-b837-af477444660f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:11.177412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 282/541] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:20:11.213282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980a963-21c1-4efe-b65b-a8cc774361d9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:11.324783 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c838d-b805-4def-b837-af477444660f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:11.366588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82090fac-dd0c-432e-bf3a-de76ac447348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:11.367191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82090fac-dd0c-432e-bf3a-de76ac447348 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:11.367607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82090fac-dd0c-432e-bf3a-de76ac447348 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:11.367876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82090fac-dd0c-432e-bf3a-de76ac447348 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:11.368811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82090fac-dd0c-432e-bf3a-de76ac447348 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:11.369147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82090fac-dd0c-432e-bf3a-de76ac447348 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:11.370578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82090fac-dd0c-432e-bf3a-de76ac447348 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:11.385472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 260/542] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:11.393447 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82090fac-dd0c-432e-bf3a-de76ac447348 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:11.434749 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:11.463308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980a963-21c1-4efe-b65b-a8cc774361d9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:11.500736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae842f-8b95-4d4e-9f78-9248be486106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:11.501380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae842f-8b95-4d4e-9f78-9248be486106 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:11.501650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae842f-8b95-4d4e-9f78-9248be486106 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:11.501983 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae842f-8b95-4d4e-9f78-9248be486106 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:11.512897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae842f-8b95-4d4e-9f78-9248be486106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-33ae842f-8b95-4d4e-9f78-9248be486106 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:11.517525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:11.518450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:11.519255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 283/543] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:11.524809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae842f-8b95-4d4e-9f78-9248be486106 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:11.536405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82090fac-dd0c-432e-bf3a-de76ac447348 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:11.550607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:11.571973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee3e9d-a840-40be-ac95-2c2fee703cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:11.572574 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee3e9d-a840-40be-ac95-2c2fee703cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:11.572849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee3e9d-a840-40be-ac95-2c2fee703cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:11.573114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee3e9d-a840-40be-ac95-2c2fee703cf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:11.573836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee3e9d-a840-40be-ac95-2c2fee703cf4 None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=8c68d5fdc4a946499ae86cdff0149470) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:11.574137 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee3e9d-a840-40be-ac95-2c2fee703cf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:11.575586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee3e9d-a840-40be-ac95-2c2fee703cf4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:11.581569 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 261/544] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:11 2022] GET /identity/v3/role_assignments?user.id=8c68d5fdc4a946499ae86cdff0149470&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:11.699535 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae842f-8b95-4d4e-9f78-9248be486106 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:11.746151 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbc26e-6fd4-4334-a32f-73a32ac5cf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:11.746763 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbc26e-6fd4-4334-a32f-73a32ac5cf3a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:11.747056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbc26e-6fd4-4334-a32f-73a32ac5cf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:11.747329 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbc26e-6fd4-4334-a32f-73a32ac5cf3a None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:11.747994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbc26e-6fd4-4334-a32f-73a32ac5cf3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:11.748296 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbc26e-6fd4-4334-a32f-73a32ac5cf3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:11.749652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbc26e-6fd4-4334-a32f-73a32ac5cf3a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:11.759966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 284/545] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:11.765446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee3e9d-a840-40be-ac95-2c2fee703cf4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:11.880493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:11.886985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee3e9d-a840-40be-ac95-2c2fee703cf4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:11.935782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c514f0-1521-431f-b247-cc4fc80c187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:11.936433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c514f0-1521-431f-b247-cc4fc80c187c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:11.936672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c514f0-1521-431f-b247-cc4fc80c187c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:11.936940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c514f0-1521-431f-b247-cc4fc80c187c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:11.952318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c514f0-1521-431f-b247-cc4fc80c187c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:11.953688 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c514f0-1521-431f-b247-cc4fc80c187c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-88c514f0-1521-431f-b247-cc4fc80c187c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:11.970861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:11.971834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:11.972659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:11.972659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:11.972659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:11.972659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 262/546] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:11.977846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbc26e-6fd4-4334-a32f-73a32ac5cf3a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:12.087302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:12.096617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f783f6-31b3-491c-9be9-914ece492a5b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:12.096945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f783f6-31b3-491c-9be9-914ece492a5b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:12.097160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f783f6-31b3-491c-9be9-914ece492a5b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:12.098622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 263/547] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:12.104155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207b6f4-32c5-4031-9fb8-d340f9a093ea None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:12.104438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207b6f4-32c5-4031-9fb8-d340f9a093ea None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:12.104711 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207b6f4-32c5-4031-9fb8-d340f9a093ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:12.112845 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbc26e-6fd4-4334-a32f-73a32ac5cf3a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:12.140313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e207b6f4-32c5-4031-9fb8-d340f9a093ea None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:12.141566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e207b6f4-32c5-4031-9fb8-d340f9a093ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:12.159999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7ec1d-68d0-42f0-ac78-9a3059b80dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:12.161364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7ec1d-68d0-42f0-ac78-9a3059b80dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:12.162138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7ec1d-68d0-42f0-ac78-9a3059b80dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:12.162838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7ec1d-68d0-42f0-ac78-9a3059b80dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:12.166397 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7ec1d-68d0-42f0-ac78-9a3059b80dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:12.167046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7ec1d-68d0-42f0-ac78-9a3059b80dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:12.168640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7ec1d-68d0-42f0-ac78-9a3059b80dc0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:12.193066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 285/548] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:12.200103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7ec1d-68d0-42f0-ac78-9a3059b80dc0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:12.258841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 264/549] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:12.292887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207b6f4-32c5-4031-9fb8-d340f9a093ea None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:12.398809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7ec1d-68d0-42f0-ac78-9a3059b80dc0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:12.451492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:12.462397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207b6f4-32c5-4031-9fb8-d340f9a093ea None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:12.491927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad0a60-3f19-4263-a14f-6ed247ba6f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:12.492559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad0a60-3f19-4263-a14f-6ed247ba6f10 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:12.492838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad0a60-3f19-4263-a14f-6ed247ba6f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:12.493102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad0a60-3f19-4263-a14f-6ed247ba6f10 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:12.510321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad0a60-3f19-4263-a14f-6ed247ba6f10 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:12.511735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad0a60-3f19-4263-a14f-6ed247ba6f10 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-24ad0a60-3f19-4263-a14f-6ed247ba6f10 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:12.534595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:12.536071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:12.537138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:12.537138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:12.537138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:12.537138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:12.537138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:12.537138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:12.537138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:12.537138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:12.537138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 22:20:12.537138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:12.538406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425a516-537e-4c38-a165-9c812662e8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:12.539044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425a516-537e-4c38-a165-9c812662e8fe None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:12.539612 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425a516-537e-4c38-a165-9c812662e8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:12.539857 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425a516-537e-4c38-a165-9c812662e8fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:12.540331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 286/550] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:20:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:12.541590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad0a60-3f19-4263-a14f-6ed247ba6f10 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:12.563691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425a516-537e-4c38-a165-9c812662e8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e425a516-537e-4c38-a165-9c812662e8fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:12.570471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:12.572622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:12.574714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:12.574714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:12.574714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:12.574714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:12.574714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:12.574714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:12.574714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:12.574714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:12.574714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:12.574714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:12.574714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:12.574714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:12.576440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 265/551] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:12.583232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425a516-537e-4c38-a165-9c812662e8fe None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:12.585305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:12.772074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad0a60-3f19-4263-a14f-6ed247ba6f10 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:12.803646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425a516-537e-4c38-a165-9c812662e8fe None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:12.821941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96bc44-59e1-4c40-9e73-00ffbf6918ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:12.822995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96bc44-59e1-4c40-9e73-00ffbf6918ed None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:12.824660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96bc44-59e1-4c40-9e73-00ffbf6918ed None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:12.826651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96bc44-59e1-4c40-9e73-00ffbf6918ed None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:12.827685 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96bc44-59e1-4c40-9e73-00ffbf6918ed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:12.828196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96bc44-59e1-4c40-9e73-00ffbf6918ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:12.830794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96bc44-59e1-4c40-9e73-00ffbf6918ed None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:12.873273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00862a9d-5658-4441-b3d3-75c2250d6b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:12.874304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00862a9d-5658-4441-b3d3-75c2250d6b15 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:12.874782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00862a9d-5658-4441-b3d3-75c2250d6b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:12.875553 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00862a9d-5658-4441-b3d3-75c2250d6b15 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:12.876446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00862a9d-5658-4441-b3d3-75c2250d6b15 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:12.876964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00862a9d-5658-4441-b3d3-75c2250d6b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:12.880106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00862a9d-5658-4441-b3d3-75c2250d6b15 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:12.898077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 266/552] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:12.903559 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00862a9d-5658-4441-b3d3-75c2250d6b15 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:12.911299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 287/553] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Aug 7 22:20:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:12.911751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:12.912242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96bc44-59e1-4c40-9e73-00ffbf6918ed None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:13.038921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:13.103991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96bc44-59e1-4c40-9e73-00ffbf6918ed None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:13.112814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00862a9d-5658-4441-b3d3-75c2250d6b15 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:13.174479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912c313-b226-4803-8054-9ec9ccc549d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:13.175110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c313-b226-4803-8054-9ec9ccc549d9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.175396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c313-b226-4803-8054-9ec9ccc549d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.175756 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c313-b226-4803-8054-9ec9ccc549d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:13.176223 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6183c-545e-408d-86c4-a5321eb7dbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:13.176908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6183c-545e-408d-86c4-a5321eb7dbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.177185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6183c-545e-408d-86c4-a5321eb7dbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.177454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6183c-545e-408d-86c4-a5321eb7dbe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:13.188998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6183c-545e-408d-86c4-a5321eb7dbe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:13.190616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6183c-545e-408d-86c4-a5321eb7dbe9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-01e6183c-545e-408d-86c4-a5321eb7dbe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:13.206764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:13.207698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:13.208557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:13.208557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:13.208557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:13.208557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 267/554] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:13.213490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6619-3e10-4537-bfbc-dba6bbeae505 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.213490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6619-3e10-4537-bfbc-dba6bbeae505 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.213490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6619-3e10-4537-bfbc-dba6bbeae505 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:13.213490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 268/555] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:13.214374 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe6619-3e10-4537-bfbc-dba6bbeae505 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:13.249853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912c313-b226-4803-8054-9ec9ccc549d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:13.251727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912c313-b226-4803-8054-9ec9ccc549d9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:13.280573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:13.311821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:13.332826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe6619-3e10-4537-bfbc-dba6bbeae505 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:13.356802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 288/556] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:20:13.358459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f28fa7-4e41-44f7-8ec6-1b38abaef6f3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.358742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f28fa7-4e41-44f7-8ec6-1b38abaef6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.359011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f28fa7-4e41-44f7-8ec6-1b38abaef6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:13.373554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fc1c4-302c-429c-b3fb-c09af97132cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:13.374169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc1c4-302c-429c-b3fb-c09af97132cb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.374433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc1c4-302c-429c-b3fb-c09af97132cb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.374754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc1c4-302c-429c-b3fb-c09af97132cb None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:13.375635 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fc1c4-302c-429c-b3fb-c09af97132cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:13.375937 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fc1c4-302c-429c-b3fb-c09af97132cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:13.377348 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fc1c4-302c-429c-b3fb-c09af97132cb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:13.381197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b2f28fa7-4e41-44f7-8ec6-1b38abaef6f3 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:13.382391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b2f28fa7-4e41-44f7-8ec6-1b38abaef6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:13.395424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 269/557] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:13.395424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f05d4-579d-4ad2-93ed-7b1eaa2b2a0b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.395424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f05d4-579d-4ad2-93ed-7b1eaa2b2a0b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.395424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f05d4-579d-4ad2-93ed-7b1eaa2b2a0b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:13.395424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 270/558] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:13.395424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f05d4-579d-4ad2-93ed-7b1eaa2b2a0b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:13.467125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 289/559] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:13.467125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f28fa7-4e41-44f7-8ec6-1b38abaef6f3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:13.512368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f05d4-579d-4ad2-93ed-7b1eaa2b2a0b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:13.527003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:13.550926 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13040dc1-c584-44be-b299-dece335534ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:13.551622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13040dc1-c584-44be-b299-dece335534ac None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.551900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13040dc1-c584-44be-b299-dece335534ac None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.552405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13040dc1-c584-44be-b299-dece335534ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:13.563524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13040dc1-c584-44be-b299-dece335534ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:13.565094 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13040dc1-c584-44be-b299-dece335534ac None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:13.565489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:13.576703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f28fa7-4e41-44f7-8ec6-1b38abaef6f3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-13040dc1-c584-44be-b299-dece335534ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:13.581896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:13.582834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:13.584360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:13.584360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:13.584360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:13.584360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 271/560] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:13.584583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f247af-f6a1-402c-865c-f5400baa3f94 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.584795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f247af-f6a1-402c-865c-f5400baa3f94 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.585031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f247af-f6a1-402c-865c-f5400baa3f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:13.604177 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c4f247af-f6a1-402c-865c-f5400baa3f94 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:13.605355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c4f247af-f6a1-402c-865c-f5400baa3f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:13.620889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77643b3f-62b4-4d5c-a07b-3dcc2a1fbee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:13.621512 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77643b3f-62b4-4d5c-a07b-3dcc2a1fbee5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.621834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77643b3f-62b4-4d5c-a07b-3dcc2a1fbee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.622049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77643b3f-62b4-4d5c-a07b-3dcc2a1fbee5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:13.629491 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77643b3f-62b4-4d5c-a07b-3dcc2a1fbee5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:13.630982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77643b3f-62b4-4d5c-a07b-3dcc2a1fbee5 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-77643b3f-62b4-4d5c-a07b-3dcc2a1fbee5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:13.642505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:13.643825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:13.644781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:13.644781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:13.644781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:13.644781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:13.644781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:13.644781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:13.644781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:13.644781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:13.644781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:20:13.644781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:13.644781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 290/561] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 22:20:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:13.644781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77643b3f-62b4-4d5c-a07b-3dcc2a1fbee5 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:13.691109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 272/562] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:13.691109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f247af-f6a1-402c-865c-f5400baa3f94 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:13.759790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77643b3f-62b4-4d5c-a07b-3dcc2a1fbee5 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:13.793400 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:13.800230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de00208-eaee-4ff0-9dfa-c5f12f5ced63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:13.800516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f247af-f6a1-402c-865c-f5400baa3f94 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:13.800914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de00208-eaee-4ff0-9dfa-c5f12f5ced63 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.801199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de00208-eaee-4ff0-9dfa-c5f12f5ced63 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.801468 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de00208-eaee-4ff0-9dfa-c5f12f5ced63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:13.814229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de00208-eaee-4ff0-9dfa-c5f12f5ced63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-9de00208-eaee-4ff0-9dfa-c5f12f5ced63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:13.821353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:13.822340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:13.823504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 291/563] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:13.828295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de00208-eaee-4ff0-9dfa-c5f12f5ced63 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:13.840059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cac98-1794-40c7-8209-7f115b458b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:13.840889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cac98-1794-40c7-8209-7f115b458b2a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.841165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cac98-1794-40c7-8209-7f115b458b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.841429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cac98-1794-40c7-8209-7f115b458b2a None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:13.841991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:13.842103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cac98-1794-40c7-8209-7f115b458b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:13.842372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cac98-1794-40c7-8209-7f115b458b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:13.843761 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cac98-1794-40c7-8209-7f115b458b2a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:13.856086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 273/564] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:13.856995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cac98-1794-40c7-8209-7f115b458b2a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:13.938806 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de00208-eaee-4ff0-9dfa-c5f12f5ced63 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:13.959721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cac98-1794-40c7-8209-7f115b458b2a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:13.971437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f626fff-715a-439a-a01f-935115b1a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:13.972040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f626fff-715a-439a-a01f-935115b1a7ac None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.972309 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f626fff-715a-439a-a01f-935115b1a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.972579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f626fff-715a-439a-a01f-935115b1a7ac None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:13.973297 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f626fff-715a-439a-a01f-935115b1a7ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:13.973596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f626fff-715a-439a-a01f-935115b1a7ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:13.975071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f626fff-715a-439a-a01f-935115b1a7ac None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:13.993461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 292/565] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 22:20:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:13.994159 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f626fff-715a-439a-a01f-935115b1a7ac None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:13.995200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3f7ac-5725-42e7-9b1a-e42a2c4328ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:13.995820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3f7ac-5725-42e7-9b1a-e42a2c4328ba None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:13.996090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3f7ac-5725-42e7-9b1a-e42a2c4328ba None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:13.996352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3f7ac-5725-42e7-9b1a-e42a2c4328ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.008924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3f7ac-5725-42e7-9b1a-e42a2c4328ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-86b3f7ac-5725-42e7-9b1a-e42a2c4328ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:14.014052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:14.015123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 274/566] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:14.015975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3f7ac-5725-42e7-9b1a-e42a2c4328ba None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:14.036145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:14.063227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:14.097899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f626fff-715a-439a-a01f-935115b1a7ac None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:14.117055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3f7ac-5725-42e7-9b1a-e42a2c4328ba None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:14.131771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24440e-5414-4741-80e8-b2c273a48e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:14.132364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24440e-5414-4741-80e8-b2c273a48e42 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.132638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24440e-5414-4741-80e8-b2c273a48e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.132905 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24440e-5414-4741-80e8-b2c273a48e42 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.133555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24440e-5414-4741-80e8-b2c273a48e42 None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:14.133849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24440e-5414-4741-80e8-b2c273a48e42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:14.135232 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24440e-5414-4741-80e8-b2c273a48e42 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:14.142801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 293/567] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:14.144063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5688ac-dded-4966-86c3-cd8514b08005 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.144383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5688ac-dded-4966-86c3-cd8514b08005 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.144653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5688ac-dded-4966-86c3-cd8514b08005 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.145836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 294/568] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:14.146522 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5688ac-dded-4966-86c3-cd8514b08005 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:14.154604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde1599-64f6-446b-a50a-30be065000b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:14.155253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde1599-64f6-446b-a50a-30be065000b5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.155526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde1599-64f6-446b-a50a-30be065000b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.155795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde1599-64f6-446b-a50a-30be065000b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.162482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde1599-64f6-446b-a50a-30be065000b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:14.163933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde1599-64f6-446b-a50a-30be065000b5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-bfde1599-64f6-446b-a50a-30be065000b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:14.176092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:14.177156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:14.178077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:14.178077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:14.178077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:14.178077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:14.178077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:14.178077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:14.178077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:14.178077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:14.178077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 275/569] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:14.178077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde1599-64f6-446b-a50a-30be065000b5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:14.253406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5688ac-dded-4966-86c3-cd8514b08005 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:14.255215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:14.277728 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde1599-64f6-446b-a50a-30be065000b5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:14.280600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:14.287044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6284b-aa03-4361-84ff-6c28bd3564c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:14.287687 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6284b-aa03-4361-84ff-6c28bd3564c7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.287958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6284b-aa03-4361-84ff-6c28bd3564c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.288219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6284b-aa03-4361-84ff-6c28bd3564c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.299790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6284b-aa03-4361-84ff-6c28bd3564c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:14.301227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6284b-aa03-4361-84ff-6c28bd3564c7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:14.311932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbea7ab-bf7b-4b1c-b3d0-8ee202b14622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:14.312528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbea7ab-bf7b-4b1c-b3d0-8ee202b14622 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.312802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbea7ab-bf7b-4b1c-b3d0-8ee202b14622 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.313072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbea7ab-bf7b-4b1c-b3d0-8ee202b14622 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.313721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbea7ab-bf7b-4b1c-b3d0-8ee202b14622 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:14.314020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbea7ab-bf7b-4b1c-b3d0-8ee202b14622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-6cd6284b-aa03-4361-84ff-6c28bd3564c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:14.314622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:14.315635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:14.316564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:14.316564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:14.316564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:14.316733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbea7ab-bf7b-4b1c-b3d0-8ee202b14622 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:14.316803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 295/570] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:14.316871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6284b-aa03-4361-84ff-6c28bd3564c7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:14.324784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 276/571] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:14.326011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb50c1-d0d8-42f9-9027-c640caf0a6b7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.326293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb50c1-d0d8-42f9-9027-c640caf0a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.326567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb50c1-d0d8-42f9-9027-c640caf0a6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.343796 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a6bb50c1-d0d8-42f9-9027-c640caf0a6b7 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:14.344963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a6bb50c1-d0d8-42f9-9027-c640caf0a6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:14.412166 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 277/572] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:14.412904 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb50c1-d0d8-42f9-9027-c640caf0a6b7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:14.415593 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6284b-aa03-4361-84ff-6c28bd3564c7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:14.448939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dfb06-5eac-46b5-ace7-639a2549eb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:14.449553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dfb06-5eac-46b5-ace7-639a2549eb05 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.449830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dfb06-5eac-46b5-ace7-639a2549eb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.450095 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dfb06-5eac-46b5-ace7-639a2549eb05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.460352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dfb06-5eac-46b5-ace7-639a2549eb05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:14.461860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dfb06-5eac-46b5-ace7-639a2549eb05 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-ce8dfb06-5eac-46b5-ace7-639a2549eb05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:14.475712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:14.476682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:14.477573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:14.477573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:14.477573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:14.477573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 296/573] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:14.477573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dfb06-5eac-46b5-ace7-639a2549eb05 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:14.494810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:14.511403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:14.527721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb50c1-d0d8-42f9-9027-c640caf0a6b7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:14.561927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd5d5c-dd5b-485b-8497-c8c6cbf6df12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:14.562520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd5d5c-dd5b-485b-8497-c8c6cbf6df12 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.562793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd5d5c-dd5b-485b-8497-c8c6cbf6df12 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.563061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd5d5c-dd5b-485b-8497-c8c6cbf6df12 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.563764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd5d5c-dd5b-485b-8497-c8c6cbf6df12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:14.564078 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd5d5c-dd5b-485b-8497-c8c6cbf6df12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:14.565477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd5d5c-dd5b-485b-8497-c8c6cbf6df12 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:14.575903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dfb06-5eac-46b5-ace7-639a2549eb05 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:14.576900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 278/574] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:14.577676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd5d5c-dd5b-485b-8497-c8c6cbf6df12 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:14.610950 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1251fb-7fd7-4a42-819d-a8b794a6ef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:14.611574 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1251fb-7fd7-4a42-819d-a8b794a6ef76 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.612520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1251fb-7fd7-4a42-819d-a8b794a6ef76 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.612788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1251fb-7fd7-4a42-819d-a8b794a6ef76 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.613411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1251fb-7fd7-4a42-819d-a8b794a6ef76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:14.613703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1251fb-7fd7-4a42-819d-a8b794a6ef76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:14.615037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1251fb-7fd7-4a42-819d-a8b794a6ef76 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:14.626557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 297/575] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:14.627407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1251fb-7fd7-4a42-819d-a8b794a6ef76 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:14.681669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd5d5c-dd5b-485b-8497-c8c6cbf6df12 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:14.707962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:14.715769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39e9a-a9d2-40bc-bb71-a0384cc044a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:14.716389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39e9a-a9d2-40bc-bb71-a0384cc044a2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.716664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39e9a-a9d2-40bc-bb71-a0384cc044a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.716934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39e9a-a9d2-40bc-bb71-a0384cc044a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.717887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:14.725218 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1251fb-7fd7-4a42-819d-a8b794a6ef76 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:14.728034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d39e9a-a9d2-40bc-bb71-a0384cc044a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:14.729465 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d39e9a-a9d2-40bc-bb71-a0384cc044a2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-c9d39e9a-a9d2-40bc-bb71-a0384cc044a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:14.743126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:14.744095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:14.744956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:14.744956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:14.744956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:14.744956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 279/576] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:14.744956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39e9a-a9d2-40bc-bb71-a0384cc044a2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:14.761093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef20259-d518-4e74-a086-baef2f3f904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:14.761723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef20259-d518-4e74-a086-baef2f3f904f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.761996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef20259-d518-4e74-a086-baef2f3f904f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.762264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef20259-d518-4e74-a086-baef2f3f904f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.772776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef20259-d518-4e74-a086-baef2f3f904f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-fef20259-d518-4e74-a086-baef2f3f904f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:14.777585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:14.778471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:14.779323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 298/577] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:14.780007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef20259-d518-4e74-a086-baef2f3f904f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:14.848820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39e9a-a9d2-40bc-bb71-a0384cc044a2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:14.881284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef20259-d518-4e74-a086-baef2f3f904f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:14.882081 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f0dbb-8993-49c5-a84f-5376f8cbdcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:14.882679 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f0dbb-8993-49c5-a84f-5376f8cbdcea None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.882947 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f0dbb-8993-49c5-a84f-5376f8cbdcea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.883245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f0dbb-8993-49c5-a84f-5376f8cbdcea None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.883887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f0dbb-8993-49c5-a84f-5376f8cbdcea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:14.884187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f0dbb-8993-49c5-a84f-5376f8cbdcea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:14.885523 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f0dbb-8993-49c5-a84f-5376f8cbdcea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:14.896827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 280/578] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:14.897607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f0dbb-8993-49c5-a84f-5376f8cbdcea None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:14.914756 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca82ad6-a755-49bb-b497-392ce9241124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:14.915380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca82ad6-a755-49bb-b497-392ce9241124 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:14.915652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca82ad6-a755-49bb-b497-392ce9241124 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:14.915915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca82ad6-a755-49bb-b497-392ce9241124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:14.916624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca82ad6-a755-49bb-b497-392ce9241124 None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=c30e49a1967e48c9b45f56454ffc1297) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:14.916922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca82ad6-a755-49bb-b497-392ce9241124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:14.918319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca82ad6-a755-49bb-b497-392ce9241124 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:14.923543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 299/579] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:14 2022] GET /identity/v3/role_assignments?user.id=c30e49a1967e48c9b45f56454ffc1297&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:14.924883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca82ad6-a755-49bb-b497-392ce9241124 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:14.947710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:14.948485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:15.018397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f0dbb-8993-49c5-a84f-5376f8cbdcea None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:15.047179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca82ad6-a755-49bb-b497-392ce9241124 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:15.058103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f806161-bb5d-4ee4-8662-49c0928d96c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:15.059836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f806161-bb5d-4ee4-8662-49c0928d96c2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:15.059836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f806161-bb5d-4ee4-8662-49c0928d96c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:15.060103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f806161-bb5d-4ee4-8662-49c0928d96c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:15.067456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f806161-bb5d-4ee4-8662-49c0928d96c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:15.068946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f806161-bb5d-4ee4-8662-49c0928d96c2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-8f806161-bb5d-4ee4-8662-49c0928d96c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:15.080883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:15.081792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:15.082768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:15.082768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:15.082768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:15.082768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:15.082768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:15.082768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:15.082768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:15.082768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:15.082768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 281/580] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:15.082768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f806161-bb5d-4ee4-8662-49c0928d96c2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:15.088713 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a4fdd-f94a-4594-a5d1-65a504cfe5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:15.089480 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a4fdd-f94a-4594-a5d1-65a504cfe5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:15.089582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a4fdd-f94a-4594-a5d1-65a504cfe5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:15.089827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a4fdd-f94a-4594-a5d1-65a504cfe5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:15.090465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a4fdd-f94a-4594-a5d1-65a504cfe5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:15.090761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a4fdd-f94a-4594-a5d1-65a504cfe5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:15.092182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a4fdd-f94a-4594-a5d1-65a504cfe5b3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:15.109395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 300/581] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:15.109395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a4fdd-f94a-4594-a5d1-65a504cfe5b3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:15.189306 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:15.192572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:15.195945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f806161-bb5d-4ee4-8662-49c0928d96c2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:15.215177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a4fdd-f94a-4594-a5d1-65a504cfe5b3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:15.229664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fd6b8-a493-45d1-9faa-b1cebb4a10c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:15.230261 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fd6b8-a493-45d1-9faa-b1cebb4a10c6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:15.230533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fd6b8-a493-45d1-9faa-b1cebb4a10c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:15.230797 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fd6b8-a493-45d1-9faa-b1cebb4a10c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:15.231475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fd6b8-a493-45d1-9faa-b1cebb4a10c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:15.231769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fd6b8-a493-45d1-9faa-b1cebb4a10c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:15.233127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fd6b8-a493-45d1-9faa-b1cebb4a10c6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:15.246005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 282/582] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:15.246005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fd6b8-a493-45d1-9faa-b1cebb4a10c6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:15.257966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52d106-04b9-4103-9f9a-1a5de42ef31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:15.258894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52d106-04b9-4103-9f9a-1a5de42ef31f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:15.259381 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52d106-04b9-4103-9f9a-1a5de42ef31f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:15.259644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52d106-04b9-4103-9f9a-1a5de42ef31f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:15.267196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52d106-04b9-4103-9f9a-1a5de42ef31f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:15.269276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52d106-04b9-4103-9f9a-1a5de42ef31f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-3e52d106-04b9-4103-9f9a-1a5de42ef31f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:15.281305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:15.282258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:15.283657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:15.283657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:15.283657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:15.283657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:15.283657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:15.283657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:15.283657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:15.283657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:15.283657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 22:20:15.283657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:15.283657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 301/583] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:15.283657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52d106-04b9-4103-9f9a-1a5de42ef31f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:15.347216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fd6b8-a493-45d1-9faa-b1cebb4a10c6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:15.382563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa787a43-90d3-4e93-93c7-cbb52cfc23a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:15.383197 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa787a43-90d3-4e93-93c7-cbb52cfc23a9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:15.383483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa787a43-90d3-4e93-93c7-cbb52cfc23a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:15.383734 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa787a43-90d3-4e93-93c7-cbb52cfc23a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:15.384414 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa787a43-90d3-4e93-93c7-cbb52cfc23a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:15.384765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa787a43-90d3-4e93-93c7-cbb52cfc23a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:15.385995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52d106-04b9-4103-9f9a-1a5de42ef31f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:15.386207 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa787a43-90d3-4e93-93c7-cbb52cfc23a9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:15.403664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 283/584] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:15.403664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa787a43-90d3-4e93-93c7-cbb52cfc23a9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:15.425510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278dfcb-bf3e-4f66-bea9-ab61d40e4bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:15.426271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278dfcb-bf3e-4f66-bea9-ab61d40e4bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:15.426387 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278dfcb-bf3e-4f66-bea9-ab61d40e4bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:15.426639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278dfcb-bf3e-4f66-bea9-ab61d40e4bf0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:15.429786 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:15.435019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278dfcb-bf3e-4f66-bea9-ab61d40e4bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:15.436479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278dfcb-bf3e-4f66-bea9-ab61d40e4bf0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:15.438316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a278dfcb-bf3e-4f66-bea9-ab61d40e4bf0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:15.449734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:15.450657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:15.451660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:15.451660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:15.451660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:15.451660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:15.451660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:15.451660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:15.451660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:15.451660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:15.451660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 22:20:15.451660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:15.455668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 302/585] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:15.456498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278dfcb-bf3e-4f66-bea9-ab61d40e4bf0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:15.511502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa787a43-90d3-4e93-93c7-cbb52cfc23a9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:15.546680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59d12a-3d9b-472c-ade3-18dc7f6cfa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:15.547332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59d12a-3d9b-472c-ade3-18dc7f6cfa1e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:15.547603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59d12a-3d9b-472c-ade3-18dc7f6cfa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:15.547868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59d12a-3d9b-472c-ade3-18dc7f6cfa1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:15.556032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278dfcb-bf3e-4f66-bea9-ab61d40e4bf0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:15.558377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59d12a-3d9b-472c-ade3-18dc7f6cfa1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:15.559833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59d12a-3d9b-472c-ade3-18dc7f6cfa1e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9d59d12a-3d9b-472c-ade3-18dc7f6cfa1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:15.574582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:15.575560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:15.581678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:15.581678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:15.581678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:15.581678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 284/586] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:15.581678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59d12a-3d9b-472c-ade3-18dc7f6cfa1e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:15.597220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc479d-2eb3-4cbf-99e3-1ddfc62aef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:15.597820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc479d-2eb3-4cbf-99e3-1ddfc62aef6d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:15.598098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc479d-2eb3-4cbf-99e3-1ddfc62aef6d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:15.598352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc479d-2eb3-4cbf-99e3-1ddfc62aef6d None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:15.599070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc479d-2eb3-4cbf-99e3-1ddfc62aef6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:15.599389 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc479d-2eb3-4cbf-99e3-1ddfc62aef6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:15.600800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc479d-2eb3-4cbf-99e3-1ddfc62aef6d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:15.618677 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 303/587] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Aug 7 22:20:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:15.620015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc479d-2eb3-4cbf-99e3-1ddfc62aef6d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:15.658366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:15.680557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:15.685202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59d12a-3d9b-472c-ade3-18dc7f6cfa1e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:15.719378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1a211-28c0-42ea-aa0a-9e15b9d96615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:15.720107 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a211-28c0-42ea-aa0a-9e15b9d96615 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:15.720455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a211-28c0-42ea-aa0a-9e15b9d96615 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:15.720796 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a211-28c0-42ea-aa0a-9e15b9d96615 None admin] PATH_INFO: `/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/cc8bf701e94c403ab70fcffaeb81b65b/roles/e2ec52fbc4a74d6086f0649d8cb3f51e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:15.727935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc479d-2eb3-4cbf-99e3-1ddfc62aef6d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:15.735574 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1a211-28c0-42ea-aa0a-9e15b9d96615 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c5638056cea4e5397c6a25d434e5324, user_id=cc8bf701e94c403ab70fcffaeb81b65b, role_id=e2ec52fbc4a74d6086f0649d8cb3f51e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:15.737602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1a211-28c0-42ea-aa0a-9e15b9d96615 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:15.755178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 285/588] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:20:15 2022] PUT /identity/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/cc8bf701e94c403ab70fcffaeb81b65b/roles/e2ec52fbc4a74d6086f0649d8cb3f51e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:20:15.756127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1a211-28c0-42ea-aa0a-9e15b9d96615 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:15.780530 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883edba-0331-4a5b-b416-754e11f78c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:15.781561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883edba-0331-4a5b-b416-754e11f78c39 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:15.784047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883edba-0331-4a5b-b416-754e11f78c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:15.786331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883edba-0331-4a5b-b416-754e11f78c39 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:15.787322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883edba-0331-4a5b-b416-754e11f78c39 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:15.787895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883edba-0331-4a5b-b416-754e11f78c39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:15.789505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883edba-0331-4a5b-b416-754e11f78c39 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:15.816741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 304/589] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Aug 7 22:20:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:15.818091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883edba-0331-4a5b-b416-754e11f78c39 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:15.908086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1a211-28c0-42ea-aa0a-9e15b9d96615 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:15.937523 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:15.940540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883edba-0331-4a5b-b416-754e11f78c39 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:15.951274 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e3414-c834-4976-99c0-7bcd7c858900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:15.951877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e3414-c834-4976-99c0-7bcd7c858900 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:15.952148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e3414-c834-4976-99c0-7bcd7c858900 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:15.952419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e3414-c834-4976-99c0-7bcd7c858900 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:15.953054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e3414-c834-4976-99c0-7bcd7c858900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:15.953375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e3414-c834-4976-99c0-7bcd7c858900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:15.954741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e3414-c834-4976-99c0-7bcd7c858900 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:15.958787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:15.968247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 286/590] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:15.969092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e3414-c834-4976-99c0-7bcd7c858900 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:15.982542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382abada-3465-4586-a00f-90d9eda2061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:15.983755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382abada-3465-4586-a00f-90d9eda2061f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:15.984295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382abada-3465-4586-a00f-90d9eda2061f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:15.984563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382abada-3465-4586-a00f-90d9eda2061f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:16.002025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382abada-3465-4586-a00f-90d9eda2061f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:16.004088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382abada-3465-4586-a00f-90d9eda2061f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-382abada-3465-4586-a00f-90d9eda2061f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:16.020153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:16.021352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:16.022478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:16.022478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:16.022478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:16.024395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 305/591] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:16.025442 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382abada-3465-4586-a00f-90d9eda2061f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:16.102093 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e3414-c834-4976-99c0-7bcd7c858900 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:16.141579 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94314a21-8846-4d29-9bcf-17d9ceb8e36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:16.143666 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94314a21-8846-4d29-9bcf-17d9ceb8e36e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:16.144234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94314a21-8846-4d29-9bcf-17d9ceb8e36e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:16.144753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94314a21-8846-4d29-9bcf-17d9ceb8e36e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:16.146473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382abada-3465-4586-a00f-90d9eda2061f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:16.160248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94314a21-8846-4d29-9bcf-17d9ceb8e36e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:16.161697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94314a21-8846-4d29-9bcf-17d9ceb8e36e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-94314a21-8846-4d29-9bcf-17d9ceb8e36e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:16.181153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:16.182272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:16.183467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:16.183467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:16.183467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:16.187561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 287/592] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:16.188517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94314a21-8846-4d29-9bcf-17d9ceb8e36e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:16.191723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59faf8d4-21fb-4795-b857-403a711ab60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:16.192845 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faf8d4-21fb-4795-b857-403a711ab60e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:16.193264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faf8d4-21fb-4795-b857-403a711ab60e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:16.193692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faf8d4-21fb-4795-b857-403a711ab60e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:16.201949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59faf8d4-21fb-4795-b857-403a711ab60e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:16.203563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59faf8d4-21fb-4795-b857-403a711ab60e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-59faf8d4-21fb-4795-b857-403a711ab60e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:16.214652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:16.215780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:16.216767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:16.216767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:16.216767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:16.216767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:16.216767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:16.216767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:16.216767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:16.216767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:16.216767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 22:20:16.216767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:16.223449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 306/593] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:16.224487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59faf8d4-21fb-4795-b857-403a711ab60e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:16.225687 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:16.253951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:16.299771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94314a21-8846-4d29-9bcf-17d9ceb8e36e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:16.329078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59faf8d4-21fb-4795-b857-403a711ab60e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:16.340203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced774a-049d-41e3-8696-eeafa37c26c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:16.341311 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced774a-049d-41e3-8696-eeafa37c26c1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:16.341733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced774a-049d-41e3-8696-eeafa37c26c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:16.342168 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced774a-049d-41e3-8696-eeafa37c26c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:16.343188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced774a-049d-41e3-8696-eeafa37c26c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:16.344064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced774a-049d-41e3-8696-eeafa37c26c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:16.346218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced774a-049d-41e3-8696-eeafa37c26c1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:16.366169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 288/594] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:16.366169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced774a-049d-41e3-8696-eeafa37c26c1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:16.379006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ffc2a-f795-49e1-9436-d306e859f886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:16.379906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ffc2a-f795-49e1-9436-d306e859f886 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:16.380189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ffc2a-f795-49e1-9436-d306e859f886 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:16.380530 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ffc2a-f795-49e1-9436-d306e859f886 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:16.381769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ffc2a-f795-49e1-9436-d306e859f886 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:16.382295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ffc2a-f795-49e1-9436-d306e859f886 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:16.384175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ffc2a-f795-49e1-9436-d306e859f886 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:16.403158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 307/595] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:16.403158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ffc2a-f795-49e1-9436-d306e859f886 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:16.474254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:16.481720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced774a-049d-41e3-8696-eeafa37c26c1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:16.520025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:16.523002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fa6c8-ef37-4a03-87a4-84428d5380bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:16.523950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fa6c8-ef37-4a03-87a4-84428d5380bb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:16.524370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fa6c8-ef37-4a03-87a4-84428d5380bb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:16.524779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fa6c8-ef37-4a03-87a4-84428d5380bb None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:16.525811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fa6c8-ef37-4a03-87a4-84428d5380bb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:16.526253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fa6c8-ef37-4a03-87a4-84428d5380bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:16.528748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fa6c8-ef37-4a03-87a4-84428d5380bb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:16.540469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ffc2a-f795-49e1-9436-d306e859f886 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:16.548496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 289/596] 10.222.0.15 () {56 vars in 1139 bytes} [Sun Aug 7 22:20:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:16.550361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fa6c8-ef37-4a03-87a4-84428d5380bb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:16.584809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084e029-7ffb-48c0-97cd-dc11850bd660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:16.585595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084e029-7ffb-48c0-97cd-dc11850bd660 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:16.585966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084e029-7ffb-48c0-97cd-dc11850bd660 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:16.586330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084e029-7ffb-48c0-97cd-dc11850bd660 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:16.595314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084e029-7ffb-48c0-97cd-dc11850bd660 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:16.597845 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084e029-7ffb-48c0-97cd-dc11850bd660 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-8084e029-7ffb-48c0-97cd-dc11850bd660 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:16.614032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:16.615122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:16.616012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:16.616012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:16.616012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:16.616012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:16.616012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:16.616012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:16.616012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:16.616012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:16.619212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 308/597] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:16.620214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084e029-7ffb-48c0-97cd-dc11850bd660 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:16.667917 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fa6c8-ef37-4a03-87a4-84428d5380bb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:16.706944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bab76-b3b0-4999-ba15-dcac07bff27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:16.707604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bab76-b3b0-4999-ba15-dcac07bff27c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:16.707881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bab76-b3b0-4999-ba15-dcac07bff27c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:16.708155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bab76-b3b0-4999-ba15-dcac07bff27c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:16.715606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bab76-b3b0-4999-ba15-dcac07bff27c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:16.717041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bab76-b3b0-4999-ba15-dcac07bff27c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-835bab76-b3b0-4999-ba15-dcac07bff27c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:16.730528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:16.731454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:16.732339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:16.732339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:16.732339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:16.732339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:16.732339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:16.732339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:16.732339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:16.732339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:16.736424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 290/598] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:16.737851 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bab76-b3b0-4999-ba15-dcac07bff27c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:16.740156 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084e029-7ffb-48c0-97cd-dc11850bd660 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:16.754801 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:16.775078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc464c90-3d05-4f10-81ce-c70da1bf8fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:16.776118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc464c90-3d05-4f10-81ce-c70da1bf8fed None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:16.776618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc464c90-3d05-4f10-81ce-c70da1bf8fed None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:16.777082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc464c90-3d05-4f10-81ce-c70da1bf8fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:16.790231 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc464c90-3d05-4f10-81ce-c70da1bf8fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:16.792307 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc464c90-3d05-4f10-81ce-c70da1bf8fed None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:16.801274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-cc464c90-3d05-4f10-81ce-c70da1bf8fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:16.810104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:16.811060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:16.811957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:16.811957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:16.811957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:16.814163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 309/599] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:16.815329 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc464c90-3d05-4f10-81ce-c70da1bf8fed None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:16.856804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bab76-b3b0-4999-ba15-dcac07bff27c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:16.894523 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad3f10-8aa1-4066-93a3-6feeff53d94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:16.895457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad3f10-8aa1-4066-93a3-6feeff53d94b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:16.895907 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad3f10-8aa1-4066-93a3-6feeff53d94b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:16.896342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad3f10-8aa1-4066-93a3-6feeff53d94b None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:16.897196 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad3f10-8aa1-4066-93a3-6feeff53d94b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:16.897700 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad3f10-8aa1-4066-93a3-6feeff53d94b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:16.903120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad3f10-8aa1-4066-93a3-6feeff53d94b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:16.914584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 291/600] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:16.915520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad3f10-8aa1-4066-93a3-6feeff53d94b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:16.935472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc464c90-3d05-4f10-81ce-c70da1bf8fed None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:16.972042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979d859-daab-4a72-8c2b-6df3af9ca683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:16.972750 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979d859-daab-4a72-8c2b-6df3af9ca683 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:16.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979d859-daab-4a72-8c2b-6df3af9ca683 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:16.973425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979d859-daab-4a72-8c2b-6df3af9ca683 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:16.974106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979d859-daab-4a72-8c2b-6df3af9ca683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:16.974420 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979d859-daab-4a72-8c2b-6df3af9ca683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:16.975825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979d859-daab-4a72-8c2b-6df3af9ca683 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:16.999062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 310/601] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:16.999062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979d859-daab-4a72-8c2b-6df3af9ca683 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:16.999325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:17.028266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad3f10-8aa1-4066-93a3-6feeff53d94b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:17.060482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:17.065774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c2954-9427-45f0-82d3-d3de7013b599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:17.066698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c2954-9427-45f0-82d3-d3de7013b599 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:17.066976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c2954-9427-45f0-82d3-d3de7013b599 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:17.067268 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c2954-9427-45f0-82d3-d3de7013b599 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:17.067928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c2954-9427-45f0-82d3-d3de7013b599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:17.068226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c2954-9427-45f0-82d3-d3de7013b599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:17.069692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c2954-9427-45f0-82d3-d3de7013b599 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:17.086531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 292/602] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:17.086531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef3524-4a4c-49b1-bcf7-e9a2136b78a2 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:17.086531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef3524-4a4c-49b1-bcf7-e9a2136b78a2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:17.086531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef3524-4a4c-49b1-bcf7-e9a2136b78a2 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:17.086531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 293/603] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:17.086531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef3524-4a4c-49b1-bcf7-e9a2136b78a2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:17.115796 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979d859-daab-4a72-8c2b-6df3af9ca683 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:17.151604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef962b-7148-4019-8093-89600e5b3295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:17.152176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef962b-7148-4019-8093-89600e5b3295 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:17.152447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef962b-7148-4019-8093-89600e5b3295 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:17.152713 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef962b-7148-4019-8093-89600e5b3295 None admin] PATH_INFO: `/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/c6639f15880c4c718f41cd84cb79c750/roles/e2ec52fbc4a74d6086f0649d8cb3f51e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:17.167830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef962b-7148-4019-8093-89600e5b3295 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c5638056cea4e5397c6a25d434e5324, user_id=c6639f15880c4c718f41cd84cb79c750, role_id=e2ec52fbc4a74d6086f0649d8cb3f51e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:17.169692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef962b-7148-4019-8093-89600e5b3295 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:17.187163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 311/604] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:20:16 2022] PUT /identity/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/c6639f15880c4c718f41cd84cb79c750/roles/e2ec52fbc4a74d6086f0649d8cb3f51e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:20:17.188109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef962b-7148-4019-8093-89600e5b3295 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:17.211840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef3524-4a4c-49b1-bcf7-e9a2136b78a2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:17.265783 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1a857-00b6-4d85-939d-504c0ac9690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:17.267527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1a857-00b6-4d85-939d-504c0ac9690b None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:17.268616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1a857-00b6-4d85-939d-504c0ac9690b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:17.269050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1a857-00b6-4d85-939d-504c0ac9690b None admin] PATH_INFO: `/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/1cfe1875cce3436eac2ac8f4d6db88bc/roles/e2ec52fbc4a74d6086f0649d8cb3f51e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:17.273530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:17.293825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1a857-00b6-4d85-939d-504c0ac9690b None admin] RBAC: Authorizing `identity:create_grant(project_id=6c5638056cea4e5397c6a25d434e5324, user_id=1cfe1875cce3436eac2ac8f4d6db88bc, role_id=e2ec52fbc4a74d6086f0649d8cb3f51e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:17.296092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1a857-00b6-4d85-939d-504c0ac9690b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:17.310523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef962b-7148-4019-8093-89600e5b3295 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:17.327679 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 294/605] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:20:17 2022] PUT /identity/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/1cfe1875cce3436eac2ac8f4d6db88bc/roles/e2ec52fbc4a74d6086f0649d8cb3f51e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:20:17.329998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b70170-dcef-4f59-9ea7-a4074551428d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:17.331625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b70170-dcef-4f59-9ea7-a4074551428d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:17.331901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b70170-dcef-4f59-9ea7-a4074551428d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:17.332320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:17.361529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d0b70170-dcef-4f59-9ea7-a4074551428d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:17.363547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d0b70170-dcef-4f59-9ea7-a4074551428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:17.378631 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8dc95-7f1d-47d5-b0c1-fbacc53c7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:17.379338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8dc95-7f1d-47d5-b0c1-fbacc53c7d50 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:17.379783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8dc95-7f1d-47d5-b0c1-fbacc53c7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:17.380118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8dc95-7f1d-47d5-b0c1-fbacc53c7d50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:17.388919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8dc95-7f1d-47d5-b0c1-fbacc53c7d50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:17.390996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8dc95-7f1d-47d5-b0c1-fbacc53c7d50 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-e6d8dc95-7f1d-47d5-b0c1-fbacc53c7d50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:17.405091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:17.406033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:17.406954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:17.406954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:17.406954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:17.406954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:17.406954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:17.406954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:17.406954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:17.406954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:17.406954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 312/606] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:17.416411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8dc95-7f1d-47d5-b0c1-fbacc53c7d50 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:17.458678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 295/607] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:17.488774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b70170-dcef-4f59-9ea7-a4074551428d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:17.564517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8dc95-7f1d-47d5-b0c1-fbacc53c7d50 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:17.605431 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73833d-95a0-4c89-a8d6-4c404ac0b911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:17.606065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73833d-95a0-4c89-a8d6-4c404ac0b911 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:17.606341 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73833d-95a0-4c89-a8d6-4c404ac0b911 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:17.606611 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73833d-95a0-4c89-a8d6-4c404ac0b911 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:17.607409 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73833d-95a0-4c89-a8d6-4c404ac0b911 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:17.607720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73833d-95a0-4c89-a8d6-4c404ac0b911 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:17.609136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73833d-95a0-4c89-a8d6-4c404ac0b911 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:17.621925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b70170-dcef-4f59-9ea7-a4074551428d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:17.622203 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 313/608] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:17.628070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73833d-95a0-4c89-a8d6-4c404ac0b911 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:17.639032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:17.679592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:17.693405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527a50c-047d-4afa-8256-1bd7c5b640c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:17.694288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527a50c-047d-4afa-8256-1bd7c5b640c3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:17.695482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527a50c-047d-4afa-8256-1bd7c5b640c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:17.695752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527a50c-047d-4afa-8256-1bd7c5b640c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:17.717667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527a50c-047d-4afa-8256-1bd7c5b640c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-8527a50c-047d-4afa-8256-1bd7c5b640c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:17.724739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:17.725643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:17.726461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:17.726461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:17.726461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:17.726461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:17.726461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:17.726461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:17.726461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:17.726461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:17.726461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:17.726461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:17.726461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:17.726461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:17.728695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 296/609] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:17.733330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527a50c-047d-4afa-8256-1bd7c5b640c3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:17.799413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73833d-95a0-4c89-a8d6-4c404ac0b911 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:17.864883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b74b8-4bb8-4309-9f20-6ef390e6433c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:17.865538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b74b8-4bb8-4309-9f20-6ef390e6433c None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:17.865810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b74b8-4bb8-4309-9f20-6ef390e6433c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:17.866078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b74b8-4bb8-4309-9f20-6ef390e6433c None admin] PATH_INFO: `/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/8c68d5fdc4a946499ae86cdff0149470/roles/e2ec52fbc4a74d6086f0649d8cb3f51e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:17.896489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b74b8-4bb8-4309-9f20-6ef390e6433c None admin] RBAC: Authorizing `identity:create_grant(project_id=6c5638056cea4e5397c6a25d434e5324, user_id=8c68d5fdc4a946499ae86cdff0149470, role_id=e2ec52fbc4a74d6086f0649d8cb3f51e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:17.897939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b74b8-4bb8-4309-9f20-6ef390e6433c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:17.919173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527a50c-047d-4afa-8256-1bd7c5b640c3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:17.920475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 314/610] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:20:17 2022] PUT /identity/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/8c68d5fdc4a946499ae86cdff0149470/roles/e2ec52fbc4a74d6086f0649d8cb3f51e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:20:17.974421 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc90872-40f9-493e-83b0-77fd1f50eb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:17.974943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc90872-40f9-493e-83b0-77fd1f50eb51 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:17.975242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc90872-40f9-493e-83b0-77fd1f50eb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:17.975510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc90872-40f9-493e-83b0-77fd1f50eb51 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:17.976178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc90872-40f9-493e-83b0-77fd1f50eb51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:17.976471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc90872-40f9-493e-83b0-77fd1f50eb51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:17.977869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc90872-40f9-493e-83b0-77fd1f50eb51 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:17.987670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 297/611] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:17.994290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b74b8-4bb8-4309-9f20-6ef390e6433c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:18.126948 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:18.139350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe3fb0-2176-48b9-80ef-8152790854cd None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:18.139709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe3fb0-2176-48b9-80ef-8152790854cd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:18.139895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe3fb0-2176-48b9-80ef-8152790854cd None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:18.141417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 298/612] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:18.146774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77d970-b1e2-4a9b-b9b7-de9139ca534a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:18.147055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77d970-b1e2-4a9b-b9b7-de9139ca534a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:18.147478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77d970-b1e2-4a9b-b9b7-de9139ca534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:18.152514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b74b8-4bb8-4309-9f20-6ef390e6433c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:18.171928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2c77d970-b1e2-4a9b-b9b7-de9139ca534a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:18.173208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2c77d970-b1e2-4a9b-b9b7-de9139ca534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:18.190740 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f24c7-4426-4a69-9f59-6b571c7ba7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:18.191694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f24c7-4426-4a69-9f59-6b571c7ba7da None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:18.192180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f24c7-4426-4a69-9f59-6b571c7ba7da None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:18.192656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f24c7-4426-4a69-9f59-6b571c7ba7da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:18.207155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f24c7-4426-4a69-9f59-6b571c7ba7da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:18.209070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f24c7-4426-4a69-9f59-6b571c7ba7da None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:18.217320 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-ce1f24c7-4426-4a69-9f59-6b571c7ba7da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:18.230809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:18.231973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:18.233083 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:18.233083 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:18.233083 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:18.235322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 315/613] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:18.242613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f24c7-4426-4a69-9f59-6b571c7ba7da None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:18.266741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 299/614] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:18.293178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77d970-b1e2-4a9b-b9b7-de9139ca534a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:18.365548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f24c7-4426-4a69-9f59-6b571c7ba7da None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:18.401716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77d970-b1e2-4a9b-b9b7-de9139ca534a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:18.402486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:18.410200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c9742-4f5f-4c69-8ed3-faab0bbca138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:18.410800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c9742-4f5f-4c69-8ed3-faab0bbca138 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:18.411070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c9742-4f5f-4c69-8ed3-faab0bbca138 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:18.411376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c9742-4f5f-4c69-8ed3-faab0bbca138 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:18.412009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c9742-4f5f-4c69-8ed3-faab0bbca138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:18.412303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c9742-4f5f-4c69-8ed3-faab0bbca138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:18.414164 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c9742-4f5f-4c69-8ed3-faab0bbca138 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:18.430065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 316/615] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:18.438629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c9742-4f5f-4c69-8ed3-faab0bbca138 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:18.464282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d8f7d-421e-4b0a-be60-8a24e1dc618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:18.465153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d8f7d-421e-4b0a-be60-8a24e1dc618e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:18.465572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d8f7d-421e-4b0a-be60-8a24e1dc618e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:18.466097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d8f7d-421e-4b0a-be60-8a24e1dc618e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:18.488750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d8f7d-421e-4b0a-be60-8a24e1dc618e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-d49d8f7d-421e-4b0a-be60-8a24e1dc618e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:18.495394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:18.496527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:18.497434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:18.497434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:18.497434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:18.497434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:18.497434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:18.497434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:18.497434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:18.497434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:18.497434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:18.497434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:18.497434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:18.497434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:18.506939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 300/616] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:18.509815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d8f7d-421e-4b0a-be60-8a24e1dc618e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:18.571466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:18.645011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c9742-4f5f-4c69-8ed3-faab0bbca138 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:18.659205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d8f7d-421e-4b0a-be60-8a24e1dc618e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:18.699942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566f07b-f44f-4f7c-874c-afaaa36ca33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:18.700620 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f07b-f44f-4f7c-874c-afaaa36ca33b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:18.701051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f07b-f44f-4f7c-874c-afaaa36ca33b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:18.701210 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f07b-f44f-4f7c-874c-afaaa36ca33b None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:18.701883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566f07b-f44f-4f7c-874c-afaaa36ca33b None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:18.702219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566f07b-f44f-4f7c-874c-afaaa36ca33b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:18.703928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566f07b-f44f-4f7c-874c-afaaa36ca33b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:18.713793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 301/617] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:18.719597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566f07b-f44f-4f7c-874c-afaaa36ca33b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:18.768002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca2067-5634-4265-bc6d-6fae953e921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:18.768568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca2067-5634-4265-bc6d-6fae953e921c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:18.768842 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca2067-5634-4265-bc6d-6fae953e921c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:18.769107 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca2067-5634-4265-bc6d-6fae953e921c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:18.795903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca2067-5634-4265-bc6d-6fae953e921c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:18.797341 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca2067-5634-4265-bc6d-6fae953e921c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:18.819524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-38ca2067-5634-4265-bc6d-6fae953e921c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:18.832071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:18.833037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:18.834070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:18.834070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:18.834070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:18.834070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:18.834070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:18.834070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:18.834070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:18.834070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:18.834070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 22:20:18.834070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:18.834070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 317/618] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:20:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:18.835484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566f07b-f44f-4f7c-874c-afaaa36ca33b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:18.840038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca2067-5634-4265-bc6d-6fae953e921c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:18.874298 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23933920-5ce6-4902-8518-f4b2e7bffb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:18.875733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23933920-5ce6-4902-8518-f4b2e7bffb79 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:18.876256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23933920-5ce6-4902-8518-f4b2e7bffb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:18.876709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23933920-5ce6-4902-8518-f4b2e7bffb79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:18.889361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23933920-5ce6-4902-8518-f4b2e7bffb79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:18.891209 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23933920-5ce6-4902-8518-f4b2e7bffb79 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-23933920-5ce6-4902-8518-f4b2e7bffb79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:18.907102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:18.908066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:18.909868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:18.909868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:18.909868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:18.911952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 302/619] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:18.917287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23933920-5ce6-4902-8518-f4b2e7bffb79 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:18.963456 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:19.013348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca2067-5634-4265-bc6d-6fae953e921c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:19.048265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147e758-aa5f-4f02-beb1-0648632448ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:19.049839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147e758-aa5f-4f02-beb1-0648632448ae None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:19.050267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147e758-aa5f-4f02-beb1-0648632448ae None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:19.050694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147e758-aa5f-4f02-beb1-0648632448ae None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:19.051593 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147e758-aa5f-4f02-beb1-0648632448ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:19.052038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147e758-aa5f-4f02-beb1-0648632448ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:19.053602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147e758-aa5f-4f02-beb1-0648632448ae None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:19.072631 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 318/620] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Aug 7 22:20:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:19.077789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147e758-aa5f-4f02-beb1-0648632448ae None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:19.159754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23933920-5ce6-4902-8518-f4b2e7bffb79 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:19.198444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f59d9-fc15-42de-a363-a58bfe9682b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:19.199638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f59d9-fc15-42de-a363-a58bfe9682b5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:19.200269 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f59d9-fc15-42de-a363-a58bfe9682b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:19.200753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f59d9-fc15-42de-a363-a58bfe9682b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:19.201737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f59d9-fc15-42de-a363-a58bfe9682b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:19.202235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f59d9-fc15-42de-a363-a58bfe9682b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:19.204922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f59d9-fc15-42de-a363-a58bfe9682b5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:19.227633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:19.233788 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 303/621] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:19.240778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f59d9-fc15-42de-a363-a58bfe9682b5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:19.328217 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147e758-aa5f-4f02-beb1-0648632448ae None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:19.351438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:19.408148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e761-1e54-426a-b8b6-84e95803c960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:19.409485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e761-1e54-426a-b8b6-84e95803c960 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:19.409916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e761-1e54-426a-b8b6-84e95803c960 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:19.410315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e761-1e54-426a-b8b6-84e95803c960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:19.426584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f59d9-fc15-42de-a363-a58bfe9682b5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:19.434040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7e761-1e54-426a-b8b6-84e95803c960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:19.436525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7e761-1e54-426a-b8b6-84e95803c960 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-8ef7e761-1e54-426a-b8b6-84e95803c960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:19.468009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:19.469205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:19.470280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:19.470280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:19.470280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:19.478816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 319/622] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:19.480513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e761-1e54-426a-b8b6-84e95803c960 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:19.505584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473e9fc-2c56-4a19-b183-b91f49abf406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:19.505584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473e9fc-2c56-4a19-b183-b91f49abf406 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:19.505584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473e9fc-2c56-4a19-b183-b91f49abf406 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:19.505584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473e9fc-2c56-4a19-b183-b91f49abf406 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:19.513858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473e9fc-2c56-4a19-b183-b91f49abf406 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:19.515749 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473e9fc-2c56-4a19-b183-b91f49abf406 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e473e9fc-2c56-4a19-b183-b91f49abf406 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:19.528936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:19.529900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:19.530835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:19.530835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:19.530835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:19.530835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:19.530835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:19.530835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:19.530835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:19.530835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:19.530835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:20:19.530835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:19.530835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 304/623] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 22:20:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:19.535588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473e9fc-2c56-4a19-b183-b91f49abf406 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:19.647519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:19.679599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e761-1e54-426a-b8b6-84e95803c960 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:19.703232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473e9fc-2c56-4a19-b183-b91f49abf406 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:19.721868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a4866-1d3d-4cd9-a61e-48ee3839e14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:19.722606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a4866-1d3d-4cd9-a61e-48ee3839e14a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:19.722974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a4866-1d3d-4cd9-a61e-48ee3839e14a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:19.723355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a4866-1d3d-4cd9-a61e-48ee3839e14a None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:19.724113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a4866-1d3d-4cd9-a61e-48ee3839e14a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:19.724508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a4866-1d3d-4cd9-a61e-48ee3839e14a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:19.725953 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a4866-1d3d-4cd9-a61e-48ee3839e14a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:19.739137 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 320/624] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:19.740565 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29185c3f-eab2-4e18-b584-be0783c428a4 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:19.741051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29185c3f-eab2-4e18-b584-be0783c428a4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:19.741512 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29185c3f-eab2-4e18-b584-be0783c428a4 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:19.743567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 321/625] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:19.744212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e5507-5185-44c3-a57c-f9be82ce8df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:19.744526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29185c3f-eab2-4e18-b584-be0783c428a4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:19.744877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5507-5185-44c3-a57c-f9be82ce8df2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:19.745159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5507-5185-44c3-a57c-f9be82ce8df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:19.745424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5507-5185-44c3-a57c-f9be82ce8df2 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:19.746233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e5507-5185-44c3-a57c-f9be82ce8df2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:19.746542 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e5507-5185-44c3-a57c-f9be82ce8df2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:19.748275 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e5507-5185-44c3-a57c-f9be82ce8df2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:19.767142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 305/626] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 22:20:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:19.768425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02984f4f-36e3-4e5c-8e44-e0d97d084698 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:19.768714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02984f4f-36e3-4e5c-8e44-e0d97d084698 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:19.768982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02984f4f-36e3-4e5c-8e44-e0d97d084698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:19.772872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:19.788595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-02984f4f-36e3-4e5c-8e44-e0d97d084698 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:19.789929 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-02984f4f-36e3-4e5c-8e44-e0d97d084698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:19.861763 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29185c3f-eab2-4e18-b584-be0783c428a4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:19.867252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 306/627] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:19.868243 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02984f4f-36e3-4e5c-8e44-e0d97d084698 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:19.899015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a1635-8c5c-48be-a8a9-43a0bd98a944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:19.899590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1635-8c5c-48be-a8a9-43a0bd98a944 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:19.899868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1635-8c5c-48be-a8a9-43a0bd98a944 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:19.900133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1635-8c5c-48be-a8a9-43a0bd98a944 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:19.907166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a1635-8c5c-48be-a8a9-43a0bd98a944 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:19.908688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a1635-8c5c-48be-a8a9-43a0bd98a944 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-2e2a1635-8c5c-48be-a8a9-43a0bd98a944 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:19.921401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:19.922640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:19.924369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:19.924369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:19.924369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:19.924369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:19.924369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:19.924369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:19.924369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:19.924369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:19.926927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:19.927243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 322/628] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:19.928479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf576-4bb5-44b1-82a5-4ddf9a7b625c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:19.928765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf576-4bb5-44b1-82a5-4ddf9a7b625c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:19.929158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf576-4bb5-44b1-82a5-4ddf9a7b625c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:19.935128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 323/629] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:19.935128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faf576-4bb5-44b1-82a5-4ddf9a7b625c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:19.985170 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02984f4f-36e3-4e5c-8e44-e0d97d084698 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:20.023018 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:20.024119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d024d9-63c3-48a2-ad6b-a9c0440e7640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:20.024914 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d024d9-63c3-48a2-ad6b-a9c0440e7640 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.024914 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d024d9-63c3-48a2-ad6b-a9c0440e7640 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.025281 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d024d9-63c3-48a2-ad6b-a9c0440e7640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.044624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faf576-4bb5-44b1-82a5-4ddf9a7b625c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:20.079640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721ecca-28a4-44b9-9dd0-e38c0fd378f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:20.080316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721ecca-28a4-44b9-9dd0-e38c0fd378f2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.081060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721ecca-28a4-44b9-9dd0-e38c0fd378f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.081333 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721ecca-28a4-44b9-9dd0-e38c0fd378f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.091913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721ecca-28a4-44b9-9dd0-e38c0fd378f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-9721ecca-28a4-44b9-9dd0-e38c0fd378f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:20.097094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:20.098034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:20.098859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:20.098859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:20.098859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:20.098859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:20.098859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:20.098859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:20.098859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:20.098859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:20.098859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:20.098859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:20.098859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:20.098859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:20.099532 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d024d9-63c3-48a2-ad6b-a9c0440e7640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:20.099614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 324/630] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:20.099614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721ecca-28a4-44b9-9dd0-e38c0fd378f2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:20.103741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d024d9-63c3-48a2-ad6b-a9c0440e7640 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:20.154161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:20.204585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721ecca-28a4-44b9-9dd0-e38c0fd378f2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:20.213140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 307/631] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:20:20.218943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da454f-2542-4e98-9927-f8e7ac55ebc5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.219256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da454f-2542-4e98-9927-f8e7ac55ebc5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.219527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da454f-2542-4e98-9927-f8e7ac55ebc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.237060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d0da454f-2542-4e98-9927-f8e7ac55ebc5 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:20.238235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d0da454f-2542-4e98-9927-f8e7ac55ebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:20.240598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101ddc5-057f-4bdf-b168-f68f7bda94b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:20.241189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101ddc5-057f-4bdf-b168-f68f7bda94b9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.241460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101ddc5-057f-4bdf-b168-f68f7bda94b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.241722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101ddc5-057f-4bdf-b168-f68f7bda94b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.242393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101ddc5-057f-4bdf-b168-f68f7bda94b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:20.242687 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101ddc5-057f-4bdf-b168-f68f7bda94b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:20.244110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101ddc5-057f-4bdf-b168-f68f7bda94b9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:20.253772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:20.257116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 325/632] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:20.258209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101ddc5-057f-4bdf-b168-f68f7bda94b9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:20.307850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 308/633] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:20.308763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da454f-2542-4e98-9927-f8e7ac55ebc5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:20.357690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101ddc5-057f-4bdf-b168-f68f7bda94b9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:20.390692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479dd9-1744-45d3-87c6-436a211af43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:20.391262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:20.391381 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479dd9-1744-45d3-87c6-436a211af43f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.391571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479dd9-1744-45d3-87c6-436a211af43f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.391836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479dd9-1744-45d3-87c6-436a211af43f None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.392485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55479dd9-1744-45d3-87c6-436a211af43f None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:20.392785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55479dd9-1744-45d3-87c6-436a211af43f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:20.394735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55479dd9-1744-45d3-87c6-436a211af43f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:20.403177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 326/634] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:20.404368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aba5c-7806-4796-9098-d91a9e9f1919 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.404590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aba5c-7806-4796-9098-d91a9e9f1919 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.404876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aba5c-7806-4796-9098-d91a9e9f1919 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.406194 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 327/635] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:20.406700 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aba5c-7806-4796-9098-d91a9e9f1919 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:20.417563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da454f-2542-4e98-9927-f8e7ac55ebc5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:20.450758 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84728-41a9-46de-98dc-6916e128b9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:20.451407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84728-41a9-46de-98dc-6916e128b9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.451680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84728-41a9-46de-98dc-6916e128b9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.451949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84728-41a9-46de-98dc-6916e128b9a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.462066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba84728-41a9-46de-98dc-6916e128b9a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:20.463526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba84728-41a9-46de-98dc-6916e128b9a2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:20.467160 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-bba84728-41a9-46de-98dc-6916e128b9a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:20.477709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:20.478866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:20.479974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:20.479974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:20.479974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:20.479974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 309/636] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:20.479974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84728-41a9-46de-98dc-6916e128b9a2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:20.507642 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aba5c-7806-4796-9098-d91a9e9f1919 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:20.541195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf70f27-2580-4875-a36f-a58c49b2f028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:20.541839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf70f27-2580-4875-a36f-a58c49b2f028 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.542117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf70f27-2580-4875-a36f-a58c49b2f028 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.542386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf70f27-2580-4875-a36f-a58c49b2f028 None admin] PATH_INFO: `/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/c30e49a1967e48c9b45f56454ffc1297/roles/e2ec52fbc4a74d6086f0649d8cb3f51e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.556172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf70f27-2580-4875-a36f-a58c49b2f028 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c5638056cea4e5397c6a25d434e5324, user_id=c30e49a1967e48c9b45f56454ffc1297, role_id=e2ec52fbc4a74d6086f0649d8cb3f51e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:20.557606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf70f27-2580-4875-a36f-a58c49b2f028 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:20.569881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 328/637] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:20:20 2022] PUT /identity/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/c30e49a1967e48c9b45f56454ffc1297/roles/e2ec52fbc4a74d6086f0649d8cb3f51e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:20:20.570657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf70f27-2580-4875-a36f-a58c49b2f028 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:20.577259 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84728-41a9-46de-98dc-6916e128b9a2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:20.610143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:20.617411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd66225-c277-445d-ab30-fe75ae3b05e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:20.618058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd66225-c277-445d-ab30-fe75ae3b05e1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.618333 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd66225-c277-445d-ab30-fe75ae3b05e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.618599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd66225-c277-445d-ab30-fe75ae3b05e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.631174 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd66225-c277-445d-ab30-fe75ae3b05e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-6cd66225-c277-445d-ab30-fe75ae3b05e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:20.637202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:20.638482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:20.639506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 310/638] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:20.640375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004b5bd-f765-4192-a7e0-1aa36cda0825 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.640375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004b5bd-f765-4192-a7e0-1aa36cda0825 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.640608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004b5bd-f765-4192-a7e0-1aa36cda0825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.659827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2004b5bd-f765-4192-a7e0-1aa36cda0825 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:20.660975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2004b5bd-f765-4192-a7e0-1aa36cda0825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:20.701163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf70f27-2580-4875-a36f-a58c49b2f028 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:20.715240 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:20.741133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 311/639] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:20.742289 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004b5bd-f765-4192-a7e0-1aa36cda0825 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:20.742578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedecdaa-33b7-490a-b5f0-f0c130c494da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:20.743249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedecdaa-33b7-490a-b5f0-f0c130c494da None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.743526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedecdaa-33b7-490a-b5f0-f0c130c494da None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.743796 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedecdaa-33b7-490a-b5f0-f0c130c494da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.761885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedecdaa-33b7-490a-b5f0-f0c130c494da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:20.763985 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedecdaa-33b7-490a-b5f0-f0c130c494da None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-bedecdaa-33b7-490a-b5f0-f0c130c494da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:20.780375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:20.781342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:20.782231 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:20.782231 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:20.782231 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:20.782231 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 329/640] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:20.782453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedecdaa-33b7-490a-b5f0-f0c130c494da None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:20.851272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004b5bd-f765-4192-a7e0-1aa36cda0825 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:20.871752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:20.888106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49cac8-2fce-4654-83a1-568a9243b84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:20.888819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49cac8-2fce-4654-83a1-568a9243b84c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.889093 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49cac8-2fce-4654-83a1-568a9243b84c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.889368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49cac8-2fce-4654-83a1-568a9243b84c None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.890006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49cac8-2fce-4654-83a1-568a9243b84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:20.890307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49cac8-2fce-4654-83a1-568a9243b84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:20.891591 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedecdaa-33b7-490a-b5f0-f0c130c494da None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:20.891718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49cac8-2fce-4654-83a1-568a9243b84c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:20.909180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 312/641] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:20.909180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49cac8-2fce-4654-83a1-568a9243b84c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:20.933004 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d538d-1ab4-47bb-85b4-e2fa8cf91b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:20.933522 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d538d-1ab4-47bb-85b4-e2fa8cf91b1c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:20.933799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d538d-1ab4-47bb-85b4-e2fa8cf91b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:20.934070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d538d-1ab4-47bb-85b4-e2fa8cf91b1c None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:20.934728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d538d-1ab4-47bb-85b4-e2fa8cf91b1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:20.935027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d538d-1ab4-47bb-85b4-e2fa8cf91b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:20.936394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d538d-1ab4-47bb-85b4-e2fa8cf91b1c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:20.949588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 330/642] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:20.949588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d538d-1ab4-47bb-85b4-e2fa8cf91b1c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:20.975874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:21.024164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49cac8-2fce-4654-83a1-568a9243b84c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:21.058770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d538d-1ab4-47bb-85b4-e2fa8cf91b1c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:21.060240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e859f4-59b1-4a74-b689-c128f7464f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:21.060867 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e859f4-59b1-4a74-b689-c128f7464f9b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:21.061141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e859f4-59b1-4a74-b689-c128f7464f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:21.061407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e859f4-59b1-4a74-b689-c128f7464f9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:21.072351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e859f4-59b1-4a74-b689-c128f7464f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-66e859f4-59b1-4a74-b689-c128f7464f9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:21.077489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:21.078676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:21.079580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 313/643] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:21.080280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e859f4-59b1-4a74-b689-c128f7464f9b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:21.103594 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbc51a-89d4-4a5b-a8df-1d5a8c58b638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:21.104197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbc51a-89d4-4a5b-a8df-1d5a8c58b638 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:21.104492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbc51a-89d4-4a5b-a8df-1d5a8c58b638 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:21.104757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbc51a-89d4-4a5b-a8df-1d5a8c58b638 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:21.105393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbc51a-89d4-4a5b-a8df-1d5a8c58b638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:21.105687 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbc51a-89d4-4a5b-a8df-1d5a8c58b638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:21.107047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbc51a-89d4-4a5b-a8df-1d5a8c58b638 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:21.119456 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 331/644] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:21.120060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbc51a-89d4-4a5b-a8df-1d5a8c58b638 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:21.132760 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:21.193950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e859f4-59b1-4a74-b689-c128f7464f9b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:21.213332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:21.230000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbc51a-89d4-4a5b-a8df-1d5a8c58b638 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:21.230904 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999dd51-c7ef-4386-99a6-81851c7d6633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:21.231571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999dd51-c7ef-4386-99a6-81851c7d6633 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:21.231850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999dd51-c7ef-4386-99a6-81851c7d6633 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:21.232118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999dd51-c7ef-4386-99a6-81851c7d6633 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:21.238945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999dd51-c7ef-4386-99a6-81851c7d6633 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:21.240433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999dd51-c7ef-4386-99a6-81851c7d6633 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2999dd51-c7ef-4386-99a6-81851c7d6633 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:21.252218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:21.253675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:21.254716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:21.254716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:21.254716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:21.254716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:21.254716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:21.254716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:21.254716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:21.254716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:21.254716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 314/645] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:21.254716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999dd51-c7ef-4386-99a6-81851c7d6633 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:21.272644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e940a3-2591-41b6-9e90-79982132f200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:21.273268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e940a3-2591-41b6-9e90-79982132f200 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:21.273541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e940a3-2591-41b6-9e90-79982132f200 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:21.273806 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e940a3-2591-41b6-9e90-79982132f200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:21.283764 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e940a3-2591-41b6-9e90-79982132f200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:21.285179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e940a3-2591-41b6-9e90-79982132f200 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-34e940a3-2591-41b6-9e90-79982132f200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:21.299752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:21.300710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:21.301588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:21.301588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:21.301588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:21.301588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 332/646] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:21.301588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e940a3-2591-41b6-9e90-79982132f200 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:21.362252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:21.365714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999dd51-c7ef-4386-99a6-81851c7d6633 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:21.402022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf4bc-928e-41ba-9478-e4d9da5d293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:21.402615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf4bc-928e-41ba-9478-e4d9da5d293d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:21.402891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf4bc-928e-41ba-9478-e4d9da5d293d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:21.403190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf4bc-928e-41ba-9478-e4d9da5d293d None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:21.403847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adf4bc-928e-41ba-9478-e4d9da5d293d None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:21.404146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adf4bc-928e-41ba-9478-e4d9da5d293d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:21.404388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e940a3-2591-41b6-9e90-79982132f200 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:21.405631 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adf4bc-928e-41ba-9478-e4d9da5d293d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:21.414674 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 315/647] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:21.415407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf4bc-928e-41ba-9478-e4d9da5d293d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:21.444582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b8682-298e-4433-acca-6e7ee9e0bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:21.445135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b8682-298e-4433-acca-6e7ee9e0bee6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:21.445415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b8682-298e-4433-acca-6e7ee9e0bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:21.445687 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b8682-298e-4433-acca-6e7ee9e0bee6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:21.453718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b8682-298e-4433-acca-6e7ee9e0bee6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:21.455178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b8682-298e-4433-acca-6e7ee9e0bee6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:21.456907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-6b5b8682-298e-4433-acca-6e7ee9e0bee6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:21.467870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:21.469470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:21.470489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:21.470489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:21.470489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:21.470489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:21.470489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:21.470489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:21.470489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:21.470489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:21.470489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 22:20:21.470489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:21.470489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 333/648] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:21.470489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b8682-298e-4433-acca-6e7ee9e0bee6 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:21.523420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf4bc-928e-41ba-9478-e4d9da5d293d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:21.557452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63827-b5c5-4649-9fd4-82ba8f449d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:21.558050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63827-b5c5-4649-9fd4-82ba8f449d06 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:21.558322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63827-b5c5-4649-9fd4-82ba8f449d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:21.558583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63827-b5c5-4649-9fd4-82ba8f449d06 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:21.559299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63827-b5c5-4649-9fd4-82ba8f449d06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:21.559596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63827-b5c5-4649-9fd4-82ba8f449d06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:21.560984 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63827-b5c5-4649-9fd4-82ba8f449d06 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:21.573633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 316/649] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:21.577628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b8682-298e-4433-acca-6e7ee9e0bee6 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:21.578950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63827-b5c5-4649-9fd4-82ba8f449d06 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:21.603324 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:21.617972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd7354-d0e3-4a5f-a7b5-5d2cb3f1e1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:21.618570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd7354-d0e3-4a5f-a7b5-5d2cb3f1e1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:21.618840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd7354-d0e3-4a5f-a7b5-5d2cb3f1e1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:21.619137 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd7354-d0e3-4a5f-a7b5-5d2cb3f1e1d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:21.619759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd7354-d0e3-4a5f-a7b5-5d2cb3f1e1d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:21.620057 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd7354-d0e3-4a5f-a7b5-5d2cb3f1e1d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:21.621808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd7354-d0e3-4a5f-a7b5-5d2cb3f1e1d1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:21.635618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 334/650] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:21.636420 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd7354-d0e3-4a5f-a7b5-5d2cb3f1e1d1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:21.692372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63827-b5c5-4649-9fd4-82ba8f449d06 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:21.700115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:21.729277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d30f0-97f7-41bf-986d-9d1d78019649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:21.729905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d30f0-97f7-41bf-986d-9d1d78019649 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:21.730182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d30f0-97f7-41bf-986d-9d1d78019649 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:21.730709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d30f0-97f7-41bf-986d-9d1d78019649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:21.743588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d30f0-97f7-41bf-986d-9d1d78019649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:21.744357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd7354-d0e3-4a5f-a7b5-5d2cb3f1e1d1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:21.745042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d30f0-97f7-41bf-986d-9d1d78019649 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-cc5d30f0-97f7-41bf-986d-9d1d78019649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:21.761930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:21.762945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:21.763870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:21.763870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:21.763870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:21.763870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 317/651] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:21.763870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d30f0-97f7-41bf-986d-9d1d78019649 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:21.791878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c986042-5beb-410e-9a9f-e7dcfbd748b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:21.792820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c986042-5beb-410e-9a9f-e7dcfbd748b4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:21.793335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c986042-5beb-410e-9a9f-e7dcfbd748b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:21.793732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c986042-5beb-410e-9a9f-e7dcfbd748b4 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:21.794469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c986042-5beb-410e-9a9f-e7dcfbd748b4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:21.794776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c986042-5beb-410e-9a9f-e7dcfbd748b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:21.796583 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c986042-5beb-410e-9a9f-e7dcfbd748b4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:21.819152 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 335/652] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Aug 7 22:20:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:21.819443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c986042-5beb-410e-9a9f-e7dcfbd748b4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:21.853612 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:21.885027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d30f0-97f7-41bf-986d-9d1d78019649 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:21.922758 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1c029-d8f3-40e9-a1e5-873c6e347f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:21.923376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1c029-d8f3-40e9-a1e5-873c6e347f62 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:21.923651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1c029-d8f3-40e9-a1e5-873c6e347f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:21.923913 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1c029-d8f3-40e9-a1e5-873c6e347f62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:21.925244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1c029-d8f3-40e9-a1e5-873c6e347f62 None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=cc8bf701e94c403ab70fcffaeb81b65b) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:21.925646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1c029-d8f3-40e9-a1e5-873c6e347f62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:21.927200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1c029-d8f3-40e9-a1e5-873c6e347f62 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:21.929126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c986042-5beb-410e-9a9f-e7dcfbd748b4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:21.939507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 318/653] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:21 2022] GET /identity/v3/role_assignments?user.id=cc8bf701e94c403ab70fcffaeb81b65b&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:21.939507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1c029-d8f3-40e9-a1e5-873c6e347f62 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:21.954163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:21.977229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c11c79-54de-4393-8c55-141dddad2480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:21.977868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c11c79-54de-4393-8c55-141dddad2480 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:21.978187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c11c79-54de-4393-8c55-141dddad2480 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:21.978459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c11c79-54de-4393-8c55-141dddad2480 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:21.989132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c11c79-54de-4393-8c55-141dddad2480 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:21.989132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c11c79-54de-4393-8c55-141dddad2480 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-88c11c79-54de-4393-8c55-141dddad2480 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:22.005249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:22.006138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:22.007104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:22.007104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:22.007104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:22.007104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:22.007104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:22.007104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:22.007104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:22.007104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:22.007104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 22:20:22.007104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:22.007104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 336/654] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:22.007104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c11c79-54de-4393-8c55-141dddad2480 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:22.054790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1c029-d8f3-40e9-a1e5-873c6e347f62 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:22.092667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53516a75-fe98-40fe-8c79-24501e4aff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:22.093303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53516a75-fe98-40fe-8c79-24501e4aff17 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:22.093573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53516a75-fe98-40fe-8c79-24501e4aff17 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:22.093842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53516a75-fe98-40fe-8c79-24501e4aff17 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:22.094491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53516a75-fe98-40fe-8c79-24501e4aff17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:22.094893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53516a75-fe98-40fe-8c79-24501e4aff17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:22.096929 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53516a75-fe98-40fe-8c79-24501e4aff17 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:22.105165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:22.115145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 319/655] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:22.115145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53516a75-fe98-40fe-8c79-24501e4aff17 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:22.130990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c11c79-54de-4393-8c55-141dddad2480 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:22.170403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407badb-e337-446d-b776-1dd4f91d7589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:22.171062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407badb-e337-446d-b776-1dd4f91d7589 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:22.171364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407badb-e337-446d-b776-1dd4f91d7589 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:22.171624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407badb-e337-446d-b776-1dd4f91d7589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:22.224859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:22.239382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53516a75-fe98-40fe-8c79-24501e4aff17 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:22.255928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407badb-e337-446d-b776-1dd4f91d7589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:22.258117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407badb-e337-446d-b776-1dd4f91d7589 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:22.278030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a82b97-80e5-484b-ba65-35c0f0babe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:22.278949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a82b97-80e5-484b-ba65-35c0f0babe39 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:22.279384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a82b97-80e5-484b-ba65-35c0f0babe39 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:22.279791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a82b97-80e5-484b-ba65-35c0f0babe39 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:22.280702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a82b97-80e5-484b-ba65-35c0f0babe39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:22.281137 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a82b97-80e5-484b-ba65-35c0f0babe39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:22.282709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a82b97-80e5-484b-ba65-35c0f0babe39 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:22.301712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 320/656] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Aug 7 22:20:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:22.302755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a82b97-80e5-484b-ba65-35c0f0babe39 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:22.367562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:22.396181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 337/657] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:20:22.399615 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407badb-e337-446d-b776-1dd4f91d7589 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:22.428743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a82b97-80e5-484b-ba65-35c0f0babe39 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:22.476767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c04c-6a15-449f-a04c-65764955d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:22.477455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c04c-6a15-449f-a04c-65764955d7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:22.477849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c04c-6a15-449f-a04c-65764955d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:22.478213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c04c-6a15-449f-a04c-65764955d7e7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:22.481234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:22.490366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231c04c-6a15-449f-a04c-65764955d7e7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:22.492655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231c04c-6a15-449f-a04c-65764955d7e7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1231c04c-6a15-449f-a04c-65764955d7e7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:22.506090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:22.507285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:22.508440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:22.508440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:22.508440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:22.508440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:22.508440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:22.508440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:22.508440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:22.508440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:22.508440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 22:20:22.508440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:22.511205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407badb-e337-446d-b776-1dd4f91d7589 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:22.514875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 321/658] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:22.515845 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c04c-6a15-449f-a04c-65764955d7e7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:22.549663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111efff0-2b87-45dc-9dd7-cd8ac506dc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:22.550511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111efff0-2b87-45dc-9dd7-cd8ac506dc80 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:22.550926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111efff0-2b87-45dc-9dd7-cd8ac506dc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:22.551388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111efff0-2b87-45dc-9dd7-cd8ac506dc80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:22.621787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111efff0-2b87-45dc-9dd7-cd8ac506dc80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:22.623244 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111efff0-2b87-45dc-9dd7-cd8ac506dc80 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:22.634313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c04c-6a15-449f-a04c-65764955d7e7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:22.651739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:22.671771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb002d-bb91-48a2-8dc0-4e02338fee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:22.672507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb002d-bb91-48a2-8dc0-4e02338fee38 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:22.672896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb002d-bb91-48a2-8dc0-4e02338fee38 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:22.673262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb002d-bb91-48a2-8dc0-4e02338fee38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:22.684942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb002d-bb91-48a2-8dc0-4e02338fee38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:22.686441 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb002d-bb91-48a2-8dc0-4e02338fee38 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-85cb002d-bb91-48a2-8dc0-4e02338fee38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:22.700879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:22.702046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:22.703076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:22.703076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:22.703076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:22.703076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 322/659] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:22.703076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb002d-bb91-48a2-8dc0-4e02338fee38 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:22.709361 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:22.736513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 338/660] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:20:22.738190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1cfd8-853e-47b5-98a3-ff996fbebe08 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:22.738466 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1cfd8-853e-47b5-98a3-ff996fbebe08 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:22.738735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1cfd8-853e-47b5-98a3-ff996fbebe08 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:22.743824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 339/661] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:22.743824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1cfd8-853e-47b5-98a3-ff996fbebe08 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:22.820477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb002d-bb91-48a2-8dc0-4e02338fee38 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:22.852271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1cfd8-853e-47b5-98a3-ff996fbebe08 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:22.857777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ef4fb-1021-4821-bf02-cf96cc98c2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:22.858373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ef4fb-1021-4821-bf02-cf96cc98c2da None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:22.858643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ef4fb-1021-4821-bf02-cf96cc98c2da None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:22.858910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ef4fb-1021-4821-bf02-cf96cc98c2da None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:22.859660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ef4fb-1021-4821-bf02-cf96cc98c2da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:22.859959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ef4fb-1021-4821-bf02-cf96cc98c2da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:22.861370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ef4fb-1021-4821-bf02-cf96cc98c2da None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:22.879479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 323/662] 10.222.0.15 () {56 vars in 1139 bytes} [Sun Aug 7 22:20:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:22.880263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ef4fb-1021-4821-bf02-cf96cc98c2da None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:22.896484 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7683b-ecd7-48bd-a152-621887a62c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:22.897088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7683b-ecd7-48bd-a152-621887a62c26 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:22.897367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7683b-ecd7-48bd-a152-621887a62c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:22.897637 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7683b-ecd7-48bd-a152-621887a62c26 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:22.898271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7683b-ecd7-48bd-a152-621887a62c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:22.898576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7683b-ecd7-48bd-a152-621887a62c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:22.900016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7683b-ecd7-48bd-a152-621887a62c26 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:22.909181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:22.917175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 340/663] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:22.917175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce729706-45c9-46d0-b540-38b55546ce88 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:22.917175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce729706-45c9-46d0-b540-38b55546ce88 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:22.917175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce729706-45c9-46d0-b540-38b55546ce88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:22.933731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ce729706-45c9-46d0-b540-38b55546ce88 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:22.934917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ce729706-45c9-46d0-b540-38b55546ce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:22.965421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:22.991835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ef4fb-1021-4821-bf02-cf96cc98c2da None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:23.027103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 341/664] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:23.027103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce729706-45c9-46d0-b540-38b55546ce88 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:23.027606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3578c6-ff67-439a-a0ab-455ee23648c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:23.028264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3578c6-ff67-439a-a0ab-455ee23648c3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:23.028817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3578c6-ff67-439a-a0ab-455ee23648c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:23.029149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3578c6-ff67-439a-a0ab-455ee23648c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:23.040040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3578c6-ff67-439a-a0ab-455ee23648c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:23.041625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3578c6-ff67-439a-a0ab-455ee23648c3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-bf3578c6-ff67-439a-a0ab-455ee23648c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:23.057720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:23.058718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:23.059648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:23.059648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:23.059648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:23.063380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 324/665] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:23.063998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3578c6-ff67-439a-a0ab-455ee23648c3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:23.139276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce729706-45c9-46d0-b540-38b55546ce88 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:23.146606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:23.169064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3578c6-ff67-439a-a0ab-455ee23648c3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:23.177917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e75a7-5c8e-4df3-bab2-5c1feeecf542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:23.178528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e75a7-5c8e-4df3-bab2-5c1feeecf542 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:23.178805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e75a7-5c8e-4df3-bab2-5c1feeecf542 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:23.179077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e75a7-5c8e-4df3-bab2-5c1feeecf542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:23.208106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032ef28-024f-4eb0-9c6d-8c18c04c42fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:23.209127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032ef28-024f-4eb0-9c6d-8c18c04c42fa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:23.209410 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032ef28-024f-4eb0-9c6d-8c18c04c42fa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:23.209956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032ef28-024f-4eb0-9c6d-8c18c04c42fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:23.214667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:23.219276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032ef28-024f-4eb0-9c6d-8c18c04c42fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:23.221213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032ef28-024f-4eb0-9c6d-8c18c04c42fa None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-3032ef28-024f-4eb0-9c6d-8c18c04c42fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:23.235765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:23.237171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:23.238059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:23.238059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:23.238059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:23.238059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:23.238059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:23.238059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:23.238059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:23.238059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:23.238469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 325/666] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:23.239187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032ef28-024f-4eb0-9c6d-8c18c04c42fa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:23.255727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e75a7-5c8e-4df3-bab2-5c1feeecf542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:23.257093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e75a7-5c8e-4df3-bab2-5c1feeecf542 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:23.344382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032ef28-024f-4eb0-9c6d-8c18c04c42fa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:23.357532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 342/667] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:20:23.359978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e75a7-5c8e-4df3-bab2-5c1feeecf542 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:23.382427 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293235e7-70a0-4d31-ae10-13a1b441ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:23.383052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293235e7-70a0-4d31-ae10-13a1b441ecfd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:23.383388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293235e7-70a0-4d31-ae10-13a1b441ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:23.383659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293235e7-70a0-4d31-ae10-13a1b441ecfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:23.390872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:23.395482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293235e7-70a0-4d31-ae10-13a1b441ecfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-293235e7-70a0-4d31-ae10-13a1b441ecfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:23.400586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:23.401518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 326/668] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:23.407779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293235e7-70a0-4d31-ae10-13a1b441ecfd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:23.434561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:23.471763 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e75a7-5c8e-4df3-bab2-5c1feeecf542 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:23.507010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca7f1e-9a8b-4d1f-9fe6-101fa8cee220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:23.507646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca7f1e-9a8b-4d1f-9fe6-101fa8cee220 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:23.507872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca7f1e-9a8b-4d1f-9fe6-101fa8cee220 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:23.508029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293235e7-70a0-4d31-ae10-13a1b441ecfd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:23.508190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca7f1e-9a8b-4d1f-9fe6-101fa8cee220 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:23.508761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca7f1e-9a8b-4d1f-9fe6-101fa8cee220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:23.509055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca7f1e-9a8b-4d1f-9fe6-101fa8cee220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:23.510389 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca7f1e-9a8b-4d1f-9fe6-101fa8cee220 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:23.522297 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 343/669] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:23.523127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca7f1e-9a8b-4d1f-9fe6-101fa8cee220 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:23.551778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9899f58-20d5-4257-8c76-10dc1e24d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:23.553308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899f58-20d5-4257-8c76-10dc1e24d224 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:23.553737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899f58-20d5-4257-8c76-10dc1e24d224 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:23.554461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899f58-20d5-4257-8c76-10dc1e24d224 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:23.555601 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9899f58-20d5-4257-8c76-10dc1e24d224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:23.555908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9899f58-20d5-4257-8c76-10dc1e24d224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:23.557340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9899f58-20d5-4257-8c76-10dc1e24d224 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:23.569902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 327/670] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:23.573079 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9899f58-20d5-4257-8c76-10dc1e24d224 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:23.635936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:23.641942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca7f1e-9a8b-4d1f-9fe6-101fa8cee220 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:23.670679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:23.680292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd4a7b-9d21-4b26-9d34-81d1f83d19ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:23.680953 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd4a7b-9d21-4b26-9d34-81d1f83d19ad None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:23.681239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd4a7b-9d21-4b26-9d34-81d1f83d19ad None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:23.681495 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd4a7b-9d21-4b26-9d34-81d1f83d19ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:23.684031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9899f58-20d5-4257-8c76-10dc1e24d224 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:23.693457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd4a7b-9d21-4b26-9d34-81d1f83d19ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:23.694942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd4a7b-9d21-4b26-9d34-81d1f83d19ad None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-effd4a7b-9d21-4b26-9d34-81d1f83d19ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:23.709679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:23.710618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:23.711567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:23.711567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:23.711567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:23.711567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 344/671] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:23.711567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd4a7b-9d21-4b26-9d34-81d1f83d19ad None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:23.726014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e70ec8-4fe3-4c38-9b68-02dd8d2ba39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:23.726619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e70ec8-4fe3-4c38-9b68-02dd8d2ba39d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:23.726896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e70ec8-4fe3-4c38-9b68-02dd8d2ba39d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:23.727199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e70ec8-4fe3-4c38-9b68-02dd8d2ba39d None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:23.727866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e70ec8-4fe3-4c38-9b68-02dd8d2ba39d None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:23.728171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e70ec8-4fe3-4c38-9b68-02dd8d2ba39d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:23.729540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e70ec8-4fe3-4c38-9b68-02dd8d2ba39d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:23.742293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 328/672] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:23.742293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e70ec8-4fe3-4c38-9b68-02dd8d2ba39d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:23.820271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd4a7b-9d21-4b26-9d34-81d1f83d19ad None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:23.850241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e70ec8-4fe3-4c38-9b68-02dd8d2ba39d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:23.856267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b40f26-c739-4968-a94c-9f1c9ce73b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:23.856890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b40f26-c739-4968-a94c-9f1c9ce73b45 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:23.857568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b40f26-c739-4968-a94c-9f1c9ce73b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:23.857835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b40f26-c739-4968-a94c-9f1c9ce73b45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:23.865433 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b40f26-c739-4968-a94c-9f1c9ce73b45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:23.866849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b40f26-c739-4968-a94c-9f1c9ce73b45 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:23.870529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-f4b40f26-c739-4968-a94c-9f1c9ce73b45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:23.878952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:23.879880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:23.880748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:23.880748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:23.880748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:23.880748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:23.880748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:23.880748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:23.880748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:23.880748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:23.880748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 345/673] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:23.881223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b40f26-c739-4968-a94c-9f1c9ce73b45 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:23.890427 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e060c3f-cf22-4879-b340-b843f83b903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:23.891031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e060c3f-cf22-4879-b340-b843f83b903c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:23.894777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e060c3f-cf22-4879-b340-b843f83b903c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:23.895058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e060c3f-cf22-4879-b340-b843f83b903c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:23.895818 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e060c3f-cf22-4879-b340-b843f83b903c None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=1cfe1875cce3436eac2ac8f4d6db88bc) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:23.896127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e060c3f-cf22-4879-b340-b843f83b903c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:23.897554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e060c3f-cf22-4879-b340-b843f83b903c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:23.911110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 329/674] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:23 2022] GET /identity/v3/role_assignments?user.id=1cfe1875cce3436eac2ac8f4d6db88bc&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:23.911110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e060c3f-cf22-4879-b340-b843f83b903c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:23.944661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:24.029080 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b40f26-c739-4968-a94c-9f1c9ce73b45 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:24.049852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e060c3f-cf22-4879-b340-b843f83b903c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:24.069056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7588ac8-aa7f-47ce-ba20-5b156d14e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:24.069666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7588ac8-aa7f-47ce-ba20-5b156d14e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:24.069944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7588ac8-aa7f-47ce-ba20-5b156d14e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:24.070213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7588ac8-aa7f-47ce-ba20-5b156d14e5b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:24.070909 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7588ac8-aa7f-47ce-ba20-5b156d14e5b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:24.071195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7588ac8-aa7f-47ce-ba20-5b156d14e5b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:24.072558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7588ac8-aa7f-47ce-ba20-5b156d14e5b8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:24.088222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 346/675] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:24.089744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7588ac8-aa7f-47ce-ba20-5b156d14e5b8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:24.097825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a10f44-686a-4d6c-a6e5-9491353a96af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:24.098454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a10f44-686a-4d6c-a6e5-9491353a96af None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:24.098726 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a10f44-686a-4d6c-a6e5-9491353a96af None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:24.098992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a10f44-686a-4d6c-a6e5-9491353a96af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:24.112389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a10f44-686a-4d6c-a6e5-9491353a96af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:24.113856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a10f44-686a-4d6c-a6e5-9491353a96af None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-98a10f44-686a-4d6c-a6e5-9491353a96af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:24.129508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:24.130485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:24.131398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:24.131398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:24.131398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:24.131398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 330/676] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:24.132331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a10f44-686a-4d6c-a6e5-9491353a96af None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:24.168790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:24.201848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:24.206125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7588ac8-aa7f-47ce-ba20-5b156d14e5b8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:24.242088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c56eeb-a066-449f-a683-d056af8bc27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:24.242511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a10f44-686a-4d6c-a6e5-9491353a96af None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:24.242689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c56eeb-a066-449f-a683-d056af8bc27d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:24.242959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c56eeb-a066-449f-a683-d056af8bc27d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:24.243255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c56eeb-a066-449f-a683-d056af8bc27d None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:24.243940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c56eeb-a066-449f-a683-d056af8bc27d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:24.244237 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c56eeb-a066-449f-a683-d056af8bc27d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:24.245645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c56eeb-a066-449f-a683-d056af8bc27d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:24.263006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 347/677] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:24.264091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4da473-95cb-4650-a389-eef7345dd827 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:24.264375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4da473-95cb-4650-a389-eef7345dd827 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:24.264646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4da473-95cb-4650-a389-eef7345dd827 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:24.267214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 348/678] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:24.267214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4da473-95cb-4650-a389-eef7345dd827 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:24.279209 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d656e-77b6-40f3-8fad-06806f7c49e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:24.279833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d656e-77b6-40f3-8fad-06806f7c49e3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:24.280103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d656e-77b6-40f3-8fad-06806f7c49e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:24.280479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d656e-77b6-40f3-8fad-06806f7c49e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:24.287752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d656e-77b6-40f3-8fad-06806f7c49e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:24.289293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d656e-77b6-40f3-8fad-06806f7c49e3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-143d656e-77b6-40f3-8fad-06806f7c49e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:24.301050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:24.301927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:24.302833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:24.302833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:24.302833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:24.302833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:24.302833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:24.302833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:24.302833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:24.302833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:24.306881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 331/679] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:24.307711 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d656e-77b6-40f3-8fad-06806f7c49e3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:24.371795 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4da473-95cb-4650-a389-eef7345dd827 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:24.406202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67e367-9638-44c2-9241-a688c305aa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:24.406405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:24.406793 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67e367-9638-44c2-9241-a688c305aa83 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:24.407065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67e367-9638-44c2-9241-a688c305aa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:24.407415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67e367-9638-44c2-9241-a688c305aa83 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:24.408002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67e367-9638-44c2-9241-a688c305aa83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:24.408295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67e367-9638-44c2-9241-a688c305aa83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:24.409701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67e367-9638-44c2-9241-a688c305aa83 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:24.414509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d656e-77b6-40f3-8fad-06806f7c49e3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:24.422508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 349/680] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:24.423729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe88665-0d05-48c0-86e0-aa728b3b7d38 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:24.424006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe88665-0d05-48c0-86e0-aa728b3b7d38 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:24.424841 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe88665-0d05-48c0-86e0-aa728b3b7d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:24.443769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-cfe88665-0d05-48c0-86e0-aa728b3b7d38 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:24.444939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cfe88665-0d05-48c0-86e0-aa728b3b7d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:24.456058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8259d4-46fe-463f-a784-61730737766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:24.456835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8259d4-46fe-463f-a784-61730737766b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:24.457274 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8259d4-46fe-463f-a784-61730737766b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:24.457683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8259d4-46fe-463f-a784-61730737766b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:24.457934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:24.458697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8259d4-46fe-463f-a784-61730737766b None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=c6639f15880c4c718f41cd84cb79c750) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:24.459175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8259d4-46fe-463f-a784-61730737766b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:24.461027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8259d4-46fe-463f-a784-61730737766b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:24.466975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 332/681] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:24 2022] GET /identity/v3/role_assignments?user.id=c6639f15880c4c718f41cd84cb79c750&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:24.467996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8259d4-46fe-463f-a784-61730737766b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:24.535192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 350/682] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:24.536117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe88665-0d05-48c0-86e0-aa728b3b7d38 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:24.618047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8259d4-46fe-463f-a784-61730737766b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:24.657435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff800c-7111-472c-9a70-f967c5417226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:24.658050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff800c-7111-472c-9a70-f967c5417226 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:24.658296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff800c-7111-472c-9a70-f967c5417226 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:24.658545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff800c-7111-472c-9a70-f967c5417226 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:24.660072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff800c-7111-472c-9a70-f967c5417226 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:24.660344 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff800c-7111-472c-9a70-f967c5417226 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:24.661770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff800c-7111-472c-9a70-f967c5417226 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:24.675057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 333/683] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:24.675889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff800c-7111-472c-9a70-f967c5417226 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:24.685063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe88665-0d05-48c0-86e0-aa728b3b7d38 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:24.702740 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:24.730901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048836f-cfde-48e2-8351-e97e36533b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:24.731669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048836f-cfde-48e2-8351-e97e36533b00 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:24.731852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048836f-cfde-48e2-8351-e97e36533b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:24.732120 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048836f-cfde-48e2-8351-e97e36533b00 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:24.740978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048836f-cfde-48e2-8351-e97e36533b00 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:24.742830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048836f-cfde-48e2-8351-e97e36533b00 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-b048836f-cfde-48e2-8351-e97e36533b00 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:24.756265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:24.757291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:24.758471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:24.758471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:24.758471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:24.758471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:24.758471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:24.758471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:24.758471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:24.758471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:24.758471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 22:20:24.758471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:24.758471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 351/684] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:20:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:24.758471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048836f-cfde-48e2-8351-e97e36533b00 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:24.771548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:24.813564 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff800c-7111-472c-9a70-f967c5417226 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:24.853708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808a50-2c08-47d6-8add-c79f73188215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:24.854335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808a50-2c08-47d6-8add-c79f73188215 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:24.854616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808a50-2c08-47d6-8add-c79f73188215 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:24.855340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808a50-2c08-47d6-8add-c79f73188215 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:24.868644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52808a50-2c08-47d6-8add-c79f73188215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-52808a50-2c08-47d6-8add-c79f73188215 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:24.875208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:24.876376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:24.877287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 334/685] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:20:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:24.877982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808a50-2c08-47d6-8add-c79f73188215 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:24.883789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048836f-cfde-48e2-8351-e97e36533b00 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:24.929222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54717f5-77b3-40b2-a01e-96c46ef17409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:24.930613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54717f5-77b3-40b2-a01e-96c46ef17409 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:24.931111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54717f5-77b3-40b2-a01e-96c46ef17409 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:24.931984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54717f5-77b3-40b2-a01e-96c46ef17409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:24.933340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54717f5-77b3-40b2-a01e-96c46ef17409 None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=8c68d5fdc4a946499ae86cdff0149470) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:24.933875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54717f5-77b3-40b2-a01e-96c46ef17409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:24.936479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54717f5-77b3-40b2-a01e-96c46ef17409 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:24.944301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 352/686] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:24 2022] GET /identity/v3/role_assignments?user.id=8c68d5fdc4a946499ae86cdff0149470&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:24.945616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54717f5-77b3-40b2-a01e-96c46ef17409 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:25.010507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:25.052966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808a50-2c08-47d6-8add-c79f73188215 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:25.097538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:25.110188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e7e56-791c-41b1-a5f9-454ce46298b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:25.110884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e7e56-791c-41b1-a5f9-454ce46298b8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:25.111106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e7e56-791c-41b1-a5f9-454ce46298b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:25.111424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e7e56-791c-41b1-a5f9-454ce46298b8 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:25.112740 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e7e56-791c-41b1-a5f9-454ce46298b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:25.113043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e7e56-791c-41b1-a5f9-454ce46298b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:25.114498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e7e56-791c-41b1-a5f9-454ce46298b8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:25.144844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 335/687] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Aug 7 22:20:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:25.154602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54717f5-77b3-40b2-a01e-96c46ef17409 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:25.155155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e7e56-791c-41b1-a5f9-454ce46298b8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:25.192117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9329c-ab24-439a-b4ca-86a61d1c25e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:25.192848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9329c-ab24-439a-b4ca-86a61d1c25e1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:25.193885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9329c-ab24-439a-b4ca-86a61d1c25e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:25.193885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9329c-ab24-439a-b4ca-86a61d1c25e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:25.194053 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9329c-ab24-439a-b4ca-86a61d1c25e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:25.194322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9329c-ab24-439a-b4ca-86a61d1c25e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:25.196423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9329c-ab24-439a-b4ca-86a61d1c25e1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:25.205767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 353/688] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:25.211195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9329c-ab24-439a-b4ca-86a61d1c25e1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:25.281622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e7e56-791c-41b1-a5f9-454ce46298b8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:25.325208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9329c-ab24-439a-b4ca-86a61d1c25e1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:25.329695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfa98b-1f86-4b60-ac9b-37349dc86df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:25.330903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfa98b-1f86-4b60-ac9b-37349dc86df4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:25.331285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfa98b-1f86-4b60-ac9b-37349dc86df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:25.331623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfa98b-1f86-4b60-ac9b-37349dc86df4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:25.363600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628e6bc-9c6a-4d0e-8095-cd01e4b4ef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:25.364530 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628e6bc-9c6a-4d0e-8095-cd01e4b4ef56 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:25.364996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628e6bc-9c6a-4d0e-8095-cd01e4b4ef56 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:25.365484 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628e6bc-9c6a-4d0e-8095-cd01e4b4ef56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:25.367584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:25.368406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:25.379934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628e6bc-9c6a-4d0e-8095-cd01e4b4ef56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:25.381911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628e6bc-9c6a-4d0e-8095-cd01e4b4ef56 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-8628e6bc-9c6a-4d0e-8095-cd01e4b4ef56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:25.397815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:25.398859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:25.399848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:25.399848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:25.399848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:25.401906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 354/689] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:25.409753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfa98b-1f86-4b60-ac9b-37349dc86df4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:25.410266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628e6bc-9c6a-4d0e-8095-cd01e4b4ef56 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:25.411312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfa98b-1f86-4b60-ac9b-37349dc86df4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:25.517242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 336/690] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:20:25.518979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628e6bc-9c6a-4d0e-8095-cd01e4b4ef56 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:25.533969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfa98b-1f86-4b60-ac9b-37349dc86df4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:25.568535 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab25d-d28c-416e-bf40-d53ee525c71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:25.569211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab25d-d28c-416e-bf40-d53ee525c71f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:25.569400 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab25d-d28c-416e-bf40-d53ee525c71f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:25.570000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab25d-d28c-416e-bf40-d53ee525c71f None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:25.570405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaab25d-d28c-416e-bf40-d53ee525c71f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:25.570701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaab25d-d28c-416e-bf40-d53ee525c71f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:25.572079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaab25d-d28c-416e-bf40-d53ee525c71f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:25.584839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:25.594246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 355/691] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:25.599975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab25d-d28c-416e-bf40-d53ee525c71f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:25.656889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:25.678352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfa98b-1f86-4b60-ac9b-37349dc86df4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:25.715868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab25d-d28c-416e-bf40-d53ee525c71f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:25.752036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635529a8-659c-4cba-82fb-a1e133869fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:25.752036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635529a8-659c-4cba-82fb-a1e133869fbb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:25.752036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635529a8-659c-4cba-82fb-a1e133869fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:25.752036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635529a8-659c-4cba-82fb-a1e133869fbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:25.765314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ef66e-6369-446c-ae7e-bc5dd57370e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:25.766355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ef66e-6369-446c-ae7e-bc5dd57370e9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:25.767733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ef66e-6369-446c-ae7e-bc5dd57370e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:25.772461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ef66e-6369-446c-ae7e-bc5dd57370e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:25.780657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ef66e-6369-446c-ae7e-bc5dd57370e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:25.784790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ef66e-6369-446c-ae7e-bc5dd57370e9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:25.786339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635529a8-659c-4cba-82fb-a1e133869fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:25.788010 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635529a8-659c-4cba-82fb-a1e133869fbb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-390ef66e-6369-446c-ae7e-bc5dd57370e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:25.808981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:25.809960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:25.810884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:25.810884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:25.810884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:25.810884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:25.810884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:25.810884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:25.810884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:25.810884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:25.810884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:20:25.810884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:25.813287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 356/692] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 22:20:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-635529a8-659c-4cba-82fb-a1e133869fbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:25.818992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:25.819921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:25.820778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:25.820778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:25.820778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:25.822177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ef66e-6369-446c-ae7e-bc5dd57370e9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:25.823895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 337/693] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:25.832045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635529a8-659c-4cba-82fb-a1e133869fbb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:25.932544 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ef66e-6369-446c-ae7e-bc5dd57370e9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:25.941285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:25.973744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f5007-6850-418b-ac41-65338d8932b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:25.974351 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f5007-6850-418b-ac41-65338d8932b3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:25.974628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f5007-6850-418b-ac41-65338d8932b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:25.974901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f5007-6850-418b-ac41-65338d8932b3 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:25.975661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f5007-6850-418b-ac41-65338d8932b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:25.975966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f5007-6850-418b-ac41-65338d8932b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:25.977383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f5007-6850-418b-ac41-65338d8932b3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:26.028801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 357/694] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 22:20:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:26.030172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f5007-6850-418b-ac41-65338d8932b3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:26.048434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:26.067521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635529a8-659c-4cba-82fb-a1e133869fbb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:26.104994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb148f33-5940-44f6-850e-6feb96e03ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:26.105526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb148f33-5940-44f6-850e-6feb96e03ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:26.105799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb148f33-5940-44f6-850e-6feb96e03ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:26.106068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb148f33-5940-44f6-850e-6feb96e03ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:26.106724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb148f33-5940-44f6-850e-6feb96e03ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:26.106995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb148f33-5940-44f6-850e-6feb96e03ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:26.108382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb148f33-5940-44f6-850e-6feb96e03ed9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:26.120894 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 338/695] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:26.122128 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0c5da-3283-4520-932c-883c1e00646f None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:26.122340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0c5da-3283-4520-932c-883c1e00646f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:26.122612 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0c5da-3283-4520-932c-883c1e00646f None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:26.128692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 339/696] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:26.132804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0c5da-3283-4520-932c-883c1e00646f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:26.183395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f5007-6850-418b-ac41-65338d8932b3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:26.229990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae7fd2-42f2-4597-8a04-8ab5ebdf2309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:26.230589 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae7fd2-42f2-4597-8a04-8ab5ebdf2309 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:26.230870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae7fd2-42f2-4597-8a04-8ab5ebdf2309 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:26.231173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae7fd2-42f2-4597-8a04-8ab5ebdf2309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:26.255010 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0c5da-3283-4520-932c-883c1e00646f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:26.266422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:26.295824 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a865dc-9c8c-4a71-b6c4-ab5bb6c78086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:26.296362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a865dc-9c8c-4a71-b6c4-ab5bb6c78086 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:26.296634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a865dc-9c8c-4a71-b6c4-ab5bb6c78086 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:26.296902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a865dc-9c8c-4a71-b6c4-ab5bb6c78086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:26.305678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a865dc-9c8c-4a71-b6c4-ab5bb6c78086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:26.307833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a865dc-9c8c-4a71-b6c4-ab5bb6c78086 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:26.313572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae7fd2-42f2-4597-8a04-8ab5ebdf2309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:26.316041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae7fd2-42f2-4597-8a04-8ab5ebdf2309 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b0a865dc-9c8c-4a71-b6c4-ab5bb6c78086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:26.323195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:26.324115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:26.325012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:26.325012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:26.325012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:26.325012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:26.325012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:26.325012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:26.325012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:26.325012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:26.325012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 340/697] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:26.331192 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ef4a7-0e6e-4d4f-98c2-05a466510b6c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:26.331477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ef4a7-0e6e-4d4f-98c2-05a466510b6c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:26.331744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ef4a7-0e6e-4d4f-98c2-05a466510b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:26.353828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-410ef4a7-0e6e-4d4f-98c2-05a466510b6c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:26.355615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-410ef4a7-0e6e-4d4f-98c2-05a466510b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:26.359256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:26.442177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 358/698] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:20:26.442922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 341/699] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:26.443399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae7fd2-42f2-4597-8a04-8ab5ebdf2309 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:26.444344 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ef4a7-0e6e-4d4f-98c2-05a466510b6c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:26.510179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:26.551516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae7fd2-42f2-4597-8a04-8ab5ebdf2309 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:26.571272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ef4a7-0e6e-4d4f-98c2-05a466510b6c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:26.589413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d21b3f-7c41-4d46-b869-3aa55c4c777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:26.590079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d21b3f-7c41-4d46-b869-3aa55c4c777f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:26.590290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d21b3f-7c41-4d46-b869-3aa55c4c777f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:26.590560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d21b3f-7c41-4d46-b869-3aa55c4c777f None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:26.591281 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d21b3f-7c41-4d46-b869-3aa55c4c777f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:26.591583 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d21b3f-7c41-4d46-b869-3aa55c4c777f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:26.593308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d21b3f-7c41-4d46-b869-3aa55c4c777f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:26.612270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 359/700] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:26.612270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d21b3f-7c41-4d46-b869-3aa55c4c777f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:26.616359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98044db4-42d8-4506-8d48-979afed3888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:26.617244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98044db4-42d8-4506-8d48-979afed3888e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:26.617809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98044db4-42d8-4506-8d48-979afed3888e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:26.618287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98044db4-42d8-4506-8d48-979afed3888e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:26.628495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:26.631029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98044db4-42d8-4506-8d48-979afed3888e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:26.632721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98044db4-42d8-4506-8d48-979afed3888e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-98044db4-42d8-4506-8d48-979afed3888e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:26.649393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:26.650377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:26.651295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:26.651295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:26.651295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:26.653468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 342/701] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:26.654439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98044db4-42d8-4506-8d48-979afed3888e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:26.728227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d21b3f-7c41-4d46-b869-3aa55c4c777f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:26.757524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:26.771727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ff143-f316-4bca-8563-1fbc32d5a348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:26.772855 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ff143-f316-4bca-8563-1fbc32d5a348 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:26.773644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ff143-f316-4bca-8563-1fbc32d5a348 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:26.774368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ff143-f316-4bca-8563-1fbc32d5a348 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:26.775332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ff143-f316-4bca-8563-1fbc32d5a348 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:26.777479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ff143-f316-4bca-8563-1fbc32d5a348 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:26.782583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98044db4-42d8-4506-8d48-979afed3888e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-0f1ff143-f316-4bca-8563-1fbc32d5a348 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:26.791791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:26.792833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 22:20:26.793678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:26.801823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 360/702] 10.222.0.15 () {56 vars in 1129 bytes} [Sun Aug 7 22:20:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:26.801823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ff143-f316-4bca-8563-1fbc32d5a348 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:26.828825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ab5e5-6f32-44dd-a1df-264059d2c2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:26.830041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ab5e5-6f32-44dd-a1df-264059d2c2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:26.830563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ab5e5-6f32-44dd-a1df-264059d2c2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:26.831371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ab5e5-6f32-44dd-a1df-264059d2c2c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:26.832990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ab5e5-6f32-44dd-a1df-264059d2c2c0 None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=c30e49a1967e48c9b45f56454ffc1297) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:26.833533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ab5e5-6f32-44dd-a1df-264059d2c2c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:26.836105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ab5e5-6f32-44dd-a1df-264059d2c2c0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:26.851120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 343/703] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:26 2022] GET /identity/v3/role_assignments?user.id=c30e49a1967e48c9b45f56454ffc1297&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:26.851120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ab5e5-6f32-44dd-a1df-264059d2c2c0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:26.971799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:26.977996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ff143-f316-4bca-8563-1fbc32d5a348 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:27.041140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb60d4-ddd7-43a5-9298-e0abf26ba7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:27.041754 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb60d4-ddd7-43a5-9298-e0abf26ba7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.042034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb60d4-ddd7-43a5-9298-e0abf26ba7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.042314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb60d4-ddd7-43a5-9298-e0abf26ba7e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.043077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb60d4-ddd7-43a5-9298-e0abf26ba7e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:27.043406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb60d4-ddd7-43a5-9298-e0abf26ba7e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:27.044903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb60d4-ddd7-43a5-9298-e0abf26ba7e0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:27.051617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ab5e5-6f32-44dd-a1df-264059d2c2c0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:27.058183 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 361/704] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:27.059800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b7f14-1165-44cf-bb03-5a2f9e3deaf2 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.059800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b7f14-1165-44cf-bb03-5a2f9e3deaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.060061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b7f14-1165-44cf-bb03-5a2f9e3deaf2 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.065133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 362/705] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:27.066272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b7f14-1165-44cf-bb03-5a2f9e3deaf2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:27.091385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d655cb-62bf-43df-bba0-4b248fdb4389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:27.092407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d655cb-62bf-43df-bba0-4b248fdb4389 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.092894 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d655cb-62bf-43df-bba0-4b248fdb4389 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.093371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d655cb-62bf-43df-bba0-4b248fdb4389 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.094102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d655cb-62bf-43df-bba0-4b248fdb4389 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:27.094408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d655cb-62bf-43df-bba0-4b248fdb4389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:27.095792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d655cb-62bf-43df-bba0-4b248fdb4389 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:27.101443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 344/706] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Aug 7 22:20:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:27.102717 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3e46-0cee-49b4-bbc4-28da8990d3f6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.103027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3e46-0cee-49b4-bbc4-28da8990d3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.103405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3e46-0cee-49b4-bbc4-28da8990d3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.123782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c4fd3e46-0cee-49b4-bbc4-28da8990d3f6 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:27.125060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c4fd3e46-0cee-49b4-bbc4-28da8990d3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:27.126177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:27.194585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b7f14-1165-44cf-bb03-5a2f9e3deaf2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:27.211853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 345/707] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:27.213083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd3e46-0cee-49b4-bbc4-28da8990d3f6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:27.235859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58d4af-7331-4d20-8793-70e120f54bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:27.236574 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58d4af-7331-4d20-8793-70e120f54bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.237481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58d4af-7331-4d20-8793-70e120f54bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.237825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58d4af-7331-4d20-8793-70e120f54bf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.247536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58d4af-7331-4d20-8793-70e120f54bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:27.249411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58d4af-7331-4d20-8793-70e120f54bf1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-cf58d4af-7331-4d20-8793-70e120f54bf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:27.267833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:27.269469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:27.270394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:27.270394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:27.270394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:27.270394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:27.270394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:27.270394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:27.270394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:27.270394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:27.270394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 363/708] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:27.270897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58d4af-7331-4d20-8793-70e120f54bf1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:27.285970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:27.345618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd3e46-0cee-49b4-bbc4-28da8990d3f6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:27.383137 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58d4af-7331-4d20-8793-70e120f54bf1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:27.383738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942b8c5-1885-43ba-93ac-b998b2eda712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:27.384341 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942b8c5-1885-43ba-93ac-b998b2eda712 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.384617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942b8c5-1885-43ba-93ac-b998b2eda712 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.384941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942b8c5-1885-43ba-93ac-b998b2eda712 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.385499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942b8c5-1885-43ba-93ac-b998b2eda712 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:27.385798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942b8c5-1885-43ba-93ac-b998b2eda712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:27.387200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942b8c5-1885-43ba-93ac-b998b2eda712 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:27.392848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 346/709] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Aug 7 22:20:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:27.394175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942b8c5-1885-43ba-93ac-b998b2eda712 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:27.395067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:27.443872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc7fb7-c03f-44f3-9d17-1d7a12efadc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:27.444876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc7fb7-c03f-44f3-9d17-1d7a12efadc0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.445219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc7fb7-c03f-44f3-9d17-1d7a12efadc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.445603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc7fb7-c03f-44f3-9d17-1d7a12efadc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.461392 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc7fb7-c03f-44f3-9d17-1d7a12efadc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:27.463828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc7fb7-c03f-44f3-9d17-1d7a12efadc0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d6bc7fb7-c03f-44f3-9d17-1d7a12efadc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:27.484374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:27.485644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:27.486562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:27.486562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:27.486562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:27.491252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 364/710] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:27.492914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a11ae-0f9e-43e1-8d33-7a3bce26fb00 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.493195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a11ae-0f9e-43e1-8d33-7a3bce26fb00 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.493463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a11ae-0f9e-43e1-8d33-7a3bce26fb00 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.494896 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 365/711] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:27.495947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a11ae-0f9e-43e1-8d33-7a3bce26fb00 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:27.540319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942b8c5-1885-43ba-93ac-b998b2eda712 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:27.559281 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:27.587568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d468939-6480-485e-8f28-3fab944547bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:27.588113 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d468939-6480-485e-8f28-3fab944547bc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.588378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d468939-6480-485e-8f28-3fab944547bc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.588656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d468939-6480-485e-8f28-3fab944547bc None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.589329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d468939-6480-485e-8f28-3fab944547bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:27.589630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d468939-6480-485e-8f28-3fab944547bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:27.591164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d468939-6480-485e-8f28-3fab944547bc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:27.617478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 347/712] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:27.617478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b029de-86dc-4a62-9a39-42d762c10715 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.617478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b029de-86dc-4a62-9a39-42d762c10715 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.617478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b029de-86dc-4a62-9a39-42d762c10715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.630776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a11ae-0f9e-43e1-8d33-7a3bce26fb00 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:27.638324 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-43b029de-86dc-4a62-9a39-42d762c10715 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:27.639540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-43b029de-86dc-4a62-9a39-42d762c10715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:27.674937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62adc2-db1d-430e-811c-1e31f097b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:27.676539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62adc2-db1d-430e-811c-1e31f097b813 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.677073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62adc2-db1d-430e-811c-1e31f097b813 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.677557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62adc2-db1d-430e-811c-1e31f097b813 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.678398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62adc2-db1d-430e-811c-1e31f097b813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:27.678961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62adc2-db1d-430e-811c-1e31f097b813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:27.681942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62adc2-db1d-430e-811c-1e31f097b813 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:27.699695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 366/713] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:27.701085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62adc2-db1d-430e-811c-1e31f097b813 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:27.719606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 348/714] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:27.720567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b029de-86dc-4a62-9a39-42d762c10715 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:27.728587 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:27.831248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62adc2-db1d-430e-811c-1e31f097b813 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:27.838518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b029de-86dc-4a62-9a39-42d762c10715 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:27.841591 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:27.873900 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b58948-03c2-4738-b8f5-250fe7b41195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:27.874419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b58948-03c2-4738-b8f5-250fe7b41195 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.874901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b58948-03c2-4738-b8f5-250fe7b41195 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.875205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b58948-03c2-4738-b8f5-250fe7b41195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.876540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b58948-03c2-4738-b8f5-250fe7b41195 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=cc8bf701e94c403ab70fcffaeb81b65b) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:27.876859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b58948-03c2-4738-b8f5-250fe7b41195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:27.878570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b58948-03c2-4738-b8f5-250fe7b41195 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:27.886106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1047b-fd9c-4f5f-b7d2-ea0f771bdcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:27.886994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1047b-fd9c-4f5f-b7d2-ea0f771bdcaf None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:27.887506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1047b-fd9c-4f5f-b7d2-ea0f771bdcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:27.887971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1047b-fd9c-4f5f-b7d2-ea0f771bdcaf None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:27.888805 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1047b-fd9c-4f5f-b7d2-ea0f771bdcaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:27.890467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1047b-fd9c-4f5f-b7d2-ea0f771bdcaf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:27.891548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 367/715] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:27 2022] GET /identity/v3/role_assignments?user.id=cc8bf701e94c403ab70fcffaeb81b65b&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:27.892561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b58948-03c2-4738-b8f5-250fe7b41195 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:27.920244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 349/716] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:20:27 2022] POST /identity/v3/users => generated 254 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:28.007077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:28.028277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b58948-03c2-4738-b8f5-250fe7b41195 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:28.069287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02a609-6e7e-4b0f-a5b1-3102d880b7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:28.069979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02a609-6e7e-4b0f-a5b1-3102d880b7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:28.070259 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02a609-6e7e-4b0f-a5b1-3102d880b7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:28.070525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02a609-6e7e-4b0f-a5b1-3102d880b7e0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:28.071125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02a609-6e7e-4b0f-a5b1-3102d880b7e0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:28.072555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02a609-6e7e-4b0f-a5b1-3102d880b7e0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-ce02a609-6e7e-4b0f-a5b1-3102d880b7e0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:28.082161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:28.083214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:28.084025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 368/717] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:27 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:28.092986 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1047b-fd9c-4f5f-b7d2-ea0f771bdcaf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:28.220156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1047b-fd9c-4f5f-b7d2-ea0f771bdcaf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:28.257334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb9aff-c986-4845-a572-e84e929c1866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:28.258261 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb9aff-c986-4845-a572-e84e929c1866 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:28.258761 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb9aff-c986-4845-a572-e84e929c1866 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:28.259239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb9aff-c986-4845-a572-e84e929c1866 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:28.260087 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb9aff-c986-4845-a572-e84e929c1866 None admin] RBAC: Adding query filter params (name=network) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:28.260557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb9aff-c986-4845-a572-e84e929c1866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:28.262077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb9aff-c986-4845-a572-e84e929c1866 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:28.267075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 350/718] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:20:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:28.273576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02a609-6e7e-4b0f-a5b1-3102d880b7e0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:28.384766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02a609-6e7e-4b0f-a5b1-3102d880b7e0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:28.419279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed636f-1b63-4db6-b8ef-5d353146a9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:28.420195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed636f-1b63-4db6-b8ef-5d353146a9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:28.420642 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed636f-1b63-4db6-b8ef-5d353146a9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:28.421122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed636f-1b63-4db6-b8ef-5d353146a9c3 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:28.421934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed636f-1b63-4db6-b8ef-5d353146a9c3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:28.422403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed636f-1b63-4db6-b8ef-5d353146a9c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:28.423943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed636f-1b63-4db6-b8ef-5d353146a9c3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:28.430027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 369/719] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:20:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:29.261142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a2d31-fe0e-4cf7-a057-faeaf46cbfa5 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:29.261635 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a2d31-fe0e-4cf7-a057-faeaf46cbfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:29.261635 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a2d31-fe0e-4cf7-a057-faeaf46cbfa5 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:29.263183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 351/720] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:29.268527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a2e95-b5c0-4255-8cfb-706c3c17eb06 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:29.268943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a2e95-b5c0-4255-8cfb-706c3c17eb06 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:29.269119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a2e95-b5c0-4255-8cfb-706c3c17eb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:29.403770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-412a2e95-b5c0-4255-8cfb-706c3c17eb06 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:29.404998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-412a2e95-b5c0-4255-8cfb-706c3c17eb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:29.414118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:29.476050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 370/721] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 22:20:29.499392 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a2d31-fe0e-4cf7-a057-faeaf46cbfa5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:29.535533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:29.630176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a2d31-fe0e-4cf7-a057-faeaf46cbfa5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:29.676872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d11aa5-7913-4cdb-9412-f1a6fe6c216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:29.677499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d11aa5-7913-4cdb-9412-f1a6fe6c216f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:29.677775 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d11aa5-7913-4cdb-9412-f1a6fe6c216f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:29.678047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d11aa5-7913-4cdb-9412-f1a6fe6c216f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:29.699498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d11aa5-7913-4cdb-9412-f1a6fe6c216f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b5d11aa5-7913-4cdb-9412-f1a6fe6c216f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:29.704470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:29.705874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:29.707484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 352/722] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:20:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:29.716230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a2e95-b5c0-4255-8cfb-706c3c17eb06 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:29.850621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a2e95-b5c0-4255-8cfb-706c3c17eb06 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:29.885000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5d445-c220-45b5-9b0b-28f752e25bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:29.885602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5d445-c220-45b5-9b0b-28f752e25bdb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:29.885874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5d445-c220-45b5-9b0b-28f752e25bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:29.886142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5d445-c220-45b5-9b0b-28f752e25bdb None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:29.886572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4decb3-4568-47d0-9fce-051446c4e941 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:29.886797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5d445-c220-45b5-9b0b-28f752e25bdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:29.887047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4decb3-4568-47d0-9fce-051446c4e941 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:29.887178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5d445-c220-45b5-9b0b-28f752e25bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:29.887522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4decb3-4568-47d0-9fce-051446c4e941 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:29.888523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5d445-c220-45b5-9b0b-28f752e25bdb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:29.893374 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 353/723] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:29.897964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264fe0f-aaac-4fd2-93e8-1f0682c3ac69 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:29.898220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 371/724] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:29.898491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264fe0f-aaac-4fd2-93e8-1f0682c3ac69 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:29.898863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264fe0f-aaac-4fd2-93e8-1f0682c3ac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:29.903671 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5d445-c220-45b5-9b0b-28f752e25bdb None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:29.907381 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:29.940697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a264fe0f-aaac-4fd2-93e8-1f0682c3ac69 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:29.943889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a264fe0f-aaac-4fd2-93e8-1f0682c3ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:30.008125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5d445-c220-45b5-9b0b-28f752e25bdb None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:30.047775 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf14b9-0413-4d61-88d2-6a817764bd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:30.048399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf14b9-0413-4d61-88d2-6a817764bd7e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:30.048670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf14b9-0413-4d61-88d2-6a817764bd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:30.050026 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf14b9-0413-4d61-88d2-6a817764bd7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:30.071231 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf14b9-0413-4d61-88d2-6a817764bd7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:30.072689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf14b9-0413-4d61-88d2-6a817764bd7e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-bdaf14b9-0413-4d61-88d2-6a817764bd7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:30.106048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:30.107282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:30.108337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:30.108337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:30.108337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:30.108337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 372/725] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:30.113848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf14b9-0413-4d61-88d2-6a817764bd7e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:30.187144 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:30.230247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf14b9-0413-4d61-88d2-6a817764bd7e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:30.266825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17f9bd-9c08-45eb-a9bc-13cc69713f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:30.267470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17f9bd-9c08-45eb-a9bc-13cc69713f52 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:30.267755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17f9bd-9c08-45eb-a9bc-13cc69713f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:30.268568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17f9bd-9c08-45eb-a9bc-13cc69713f52 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:30.269226 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17f9bd-9c08-45eb-a9bc-13cc69713f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:30.269529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17f9bd-9c08-45eb-a9bc-13cc69713f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:30.270916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17f9bd-9c08-45eb-a9bc-13cc69713f52 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:30.284986 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 373/726] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:30.290415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17f9bd-9c08-45eb-a9bc-13cc69713f52 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:30.346025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 354/727] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:30.381242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264fe0f-aaac-4fd2-93e8-1f0682c3ac69 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:30.423462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:30.442464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17f9bd-9c08-45eb-a9bc-13cc69713f52 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:30.496457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3aa2f-f726-40d2-8fc3-ea5fc3ce8ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:30.497148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3aa2f-f726-40d2-8fc3-ea5fc3ce8ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:30.497428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3aa2f-f726-40d2-8fc3-ea5fc3ce8ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:30.497698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3aa2f-f726-40d2-8fc3-ea5fc3ce8ed3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:30.505878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3aa2f-f726-40d2-8fc3-ea5fc3ce8ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:30.506358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:30.511707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3aa2f-f726-40d2-8fc3-ea5fc3ce8ed3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-cdc3aa2f-f726-40d2-8fc3-ea5fc3ce8ed3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:30.525299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:30.526277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:30.527223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:30.527223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:30.527223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:30.527223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:30.527223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:30.527223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:30.527223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:30.527223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:30.527223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 22:20:30.527223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:30.527223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 374/728] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:20:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:30.532668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777575d7-e21d-4b64-a4de-f9cf6bdffe5d None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:30.533428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777575d7-e21d-4b64-a4de-f9cf6bdffe5d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:30.533798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777575d7-e21d-4b64-a4de-f9cf6bdffe5d None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:30.539228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 375/729] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:30.539228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777575d7-e21d-4b64-a4de-f9cf6bdffe5d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:30.554579 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264fe0f-aaac-4fd2-93e8-1f0682c3ac69 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:30.612360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22a50d-75e9-42e7-a770-38894d001513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:30.612986 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22a50d-75e9-42e7-a770-38894d001513 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:30.613276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22a50d-75e9-42e7-a770-38894d001513 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:30.613547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22a50d-75e9-42e7-a770-38894d001513 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:30.614198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22a50d-75e9-42e7-a770-38894d001513 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:30.615613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22a50d-75e9-42e7-a770-38894d001513 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:30.662606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777575d7-e21d-4b64-a4de-f9cf6bdffe5d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:30.680630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 355/730] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:20:30 2022] POST /identity/v3/services => generated 251 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:30.682047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6f23e-d696-47b2-9de7-f893af243705 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:30.682339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6f23e-d696-47b2-9de7-f893af243705 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:30.682619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6f23e-d696-47b2-9de7-f893af243705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:30.723299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4aaa5-0d15-4135-97ad-b593de40406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:30.723936 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4aaa5-0d15-4135-97ad-b593de40406f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:30.726438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4aaa5-0d15-4135-97ad-b593de40406f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:30.726747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4aaa5-0d15-4135-97ad-b593de40406f None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:30.727634 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4aaa5-0d15-4135-97ad-b593de40406f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:30.727951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4aaa5-0d15-4135-97ad-b593de40406f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:30.729441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4aaa5-0d15-4135-97ad-b593de40406f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:30.744166 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-71b6f23e-d696-47b2-9de7-f893af243705 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:30.751303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-71b6f23e-d696-47b2-9de7-f893af243705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:30.766796 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 376/731] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Aug 7 22:20:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:30.768358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecb5b0-b5b1-4cb1-b5be-65391594e92b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:30.768646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecb5b0-b5b1-4cb1-b5be-65391594e92b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:30.768921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecb5b0-b5b1-4cb1-b5be-65391594e92b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:30.774368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 377/732] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:30.774368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecb5b0-b5b1-4cb1-b5be-65391594e92b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:30.805744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:30.925484 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecb5b0-b5b1-4cb1-b5be-65391594e92b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:30.926497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 356/733] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:30.929146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e655ba-5d77-44a2-920e-29d5f396ec5d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:30.929727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e655ba-5d77-44a2-920e-29d5f396ec5d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:30.930195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e655ba-5d77-44a2-920e-29d5f396ec5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:30.939417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:30.959995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c9e655ba-5d77-44a2-920e-29d5f396ec5d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:30.962141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c9e655ba-5d77-44a2-920e-29d5f396ec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:30.968222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68293ace-53f5-471a-8b25-e00a611fd646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:30.969094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68293ace-53f5-471a-8b25-e00a611fd646 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:30.969369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68293ace-53f5-471a-8b25-e00a611fd646 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:30.969631 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68293ace-53f5-471a-8b25-e00a611fd646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:31.054197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68293ace-53f5-471a-8b25-e00a611fd646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:31.056144 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68293ace-53f5-471a-8b25-e00a611fd646 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:31.106127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:31.112849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 357/734] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:31.113709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e655ba-5d77-44a2-920e-29d5f396ec5d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:31.178328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 378/735] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:30 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 22:20:31.179844 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb52094-de19-430a-9e79-5ddaa1331820 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:31.180128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb52094-de19-430a-9e79-5ddaa1331820 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:31.180399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb52094-de19-430a-9e79-5ddaa1331820 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:31.181755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 379/736] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:31.182315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb52094-de19-430a-9e79-5ddaa1331820 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:31.233127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e655ba-5d77-44a2-920e-29d5f396ec5d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:31.267453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c24a53-3b3e-4035-95e5-983833718c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:31.268636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c24a53-3b3e-4035-95e5-983833718c89 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:31.269006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c24a53-3b3e-4035-95e5-983833718c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:31.269179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c24a53-3b3e-4035-95e5-983833718c89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:31.271236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:31.283097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c24a53-3b3e-4035-95e5-983833718c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-76c24a53-3b3e-4035-95e5-983833718c89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:31.288518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:31.289424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:31.290254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 358/737] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:20:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:31.290939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c24a53-3b3e-4035-95e5-983833718c89 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:31.298742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb52094-de19-430a-9e79-5ddaa1331820 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:31.332732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:31.339990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b7620-38af-4c02-bdbf-f1c1572e23f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:31.340755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b7620-38af-4c02-bdbf-f1c1572e23f8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:31.341032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b7620-38af-4c02-bdbf-f1c1572e23f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:31.341303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b7620-38af-4c02-bdbf-f1c1572e23f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:31.353780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b7620-38af-4c02-bdbf-f1c1572e23f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-3c9b7620-38af-4c02-bdbf-f1c1572e23f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:31.358510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:31.359450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:31.360273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 380/738] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:31.360956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200adbbf-15c1-489c-a659-8b6527271350 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:31.362229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200adbbf-15c1-489c-a659-8b6527271350 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:31.362229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200adbbf-15c1-489c-a659-8b6527271350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:31.380184 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-200adbbf-15c1-489c-a659-8b6527271350 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:31.381449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-200adbbf-15c1-489c-a659-8b6527271350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:31.425293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c24a53-3b3e-4035-95e5-983833718c89 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:31.454440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 381/739] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 22:20:31.455543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200adbbf-15c1-489c-a659-8b6527271350 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:31.470027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c72006-2af9-4efd-b558-26b786c9548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:31.471314 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c72006-2af9-4efd-b558-26b786c9548e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:31.471821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c72006-2af9-4efd-b558-26b786c9548e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:31.472312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c72006-2af9-4efd-b558-26b786c9548e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:31.484244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c72006-2af9-4efd-b558-26b786c9548e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:31.485682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c72006-2af9-4efd-b558-26b786c9548e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f9c72006-2af9-4efd-b558-26b786c9548e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:31.501522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:31.503149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:31.504044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:31.504044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:31.504044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:31.507919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 359/740] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:31.508359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c72006-2af9-4efd-b558-26b786c9548e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:31.554828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:31.561685 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200adbbf-15c1-489c-a659-8b6527271350 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:31.582167 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:31.599070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c502b4-94f6-4e6f-b757-22757e80e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:31.599835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c502b4-94f6-4e6f-b757-22757e80e64e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:31.600237 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c502b4-94f6-4e6f-b757-22757e80e64e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:31.600505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c502b4-94f6-4e6f-b757-22757e80e64e None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:31.601311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c502b4-94f6-4e6f-b757-22757e80e64e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:31.601613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c502b4-94f6-4e6f-b757-22757e80e64e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:31.603558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c502b4-94f6-4e6f-b757-22757e80e64e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:31.610295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c72006-2af9-4efd-b558-26b786c9548e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:31.615321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 382/741] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:31.616276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c502b4-94f6-4e6f-b757-22757e80e64e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:31.647809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659c170-498b-43ec-bc0d-da8ac9ed3b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:31.648406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659c170-498b-43ec-bc0d-da8ac9ed3b7b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:31.648670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659c170-498b-43ec-bc0d-da8ac9ed3b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:31.649117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659c170-498b-43ec-bc0d-da8ac9ed3b7b None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:31.649591 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659c170-498b-43ec-bc0d-da8ac9ed3b7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:31.649891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659c170-498b-43ec-bc0d-da8ac9ed3b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:31.651269 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659c170-498b-43ec-bc0d-da8ac9ed3b7b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:31.659619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 360/742] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:31.664545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659c170-498b-43ec-bc0d-da8ac9ed3b7b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:31.733047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c502b4-94f6-4e6f-b757-22757e80e64e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:31.769385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b67ee0-30f8-4f5b-9ef4-98e6bc3c01a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:31.769983 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b67ee0-30f8-4f5b-9ef4-98e6bc3c01a4 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:31.770254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b67ee0-30f8-4f5b-9ef4-98e6bc3c01a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:31.770517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b67ee0-30f8-4f5b-9ef4-98e6bc3c01a4 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:31.771169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b67ee0-30f8-4f5b-9ef4-98e6bc3c01a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:31.772514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b67ee0-30f8-4f5b-9ef4-98e6bc3c01a4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:31.784686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659c170-498b-43ec-bc0d-da8ac9ed3b7b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:31.798803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 383/743] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:20:31 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:31.798803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b67ee0-30f8-4f5b-9ef4-98e6bc3c01a4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:31.804217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:31.850664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:31.860385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970cbf8-6724-43b1-8404-39935eba5916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:31.862450 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970cbf8-6724-43b1-8404-39935eba5916 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:31.863712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970cbf8-6724-43b1-8404-39935eba5916 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:31.864210 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970cbf8-6724-43b1-8404-39935eba5916 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:31.865164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970cbf8-6724-43b1-8404-39935eba5916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:31.865684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970cbf8-6724-43b1-8404-39935eba5916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:31.868572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970cbf8-6724-43b1-8404-39935eba5916 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:31.891627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 361/744] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:31.892388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970cbf8-6724-43b1-8404-39935eba5916 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:31.937602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b67ee0-30f8-4f5b-9ef4-98e6bc3c01a4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:31.977576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb0c2c-37c0-4c0e-8c1f-4987699a2daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:31.978223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb0c2c-37c0-4c0e-8c1f-4987699a2daa None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:31.978497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb0c2c-37c0-4c0e-8c1f-4987699a2daa None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:31.978759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb0c2c-37c0-4c0e-8c1f-4987699a2daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:31.995816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb0c2c-37c0-4c0e-8c1f-4987699a2daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:31.997254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb0c2c-37c0-4c0e-8c1f-4987699a2daa None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-1edb0c2c-37c0-4c0e-8c1f-4987699a2daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:32.015377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:32.016355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:32.017220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:32.017220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:32.017220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:32.019386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 384/745] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:32.020477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb0c2c-37c0-4c0e-8c1f-4987699a2daa None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:32.033388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970cbf8-6724-43b1-8404-39935eba5916 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:32.080565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37811181-0555-44de-bd98-038700d6fc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:32.081449 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37811181-0555-44de-bd98-038700d6fc38 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:32.081719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37811181-0555-44de-bd98-038700d6fc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:32.081984 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37811181-0555-44de-bd98-038700d6fc38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:32.095355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37811181-0555-44de-bd98-038700d6fc38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:32.097150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37811181-0555-44de-bd98-038700d6fc38 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-37811181-0555-44de-bd98-038700d6fc38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:32.117238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:32.118215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:32.119276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:32.119276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:32.119276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:32.119276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 362/746] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:32.120045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37811181-0555-44de-bd98-038700d6fc38 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:32.141986 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:32.145147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:32.152283 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb0c2c-37c0-4c0e-8c1f-4987699a2daa None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:32.191673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da489b9-e4f7-4672-81ff-0f7d9a40b880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:32.192632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da489b9-e4f7-4672-81ff-0f7d9a40b880 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:32.193046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da489b9-e4f7-4672-81ff-0f7d9a40b880 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:32.193556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da489b9-e4f7-4672-81ff-0f7d9a40b880 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:32.201187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da489b9-e4f7-4672-81ff-0f7d9a40b880 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:32.202896 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da489b9-e4f7-4672-81ff-0f7d9a40b880 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-9da489b9-e4f7-4672-81ff-0f7d9a40b880 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:32.215058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:32.216162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:32.217139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:32.217139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:32.217139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:32.217139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:32.217139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:32.217139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:32.217139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:32.217139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:32.219136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 385/747] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:32.220038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da489b9-e4f7-4672-81ff-0f7d9a40b880 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:32.235855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37811181-0555-44de-bd98-038700d6fc38 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:32.281208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3883e9-00eb-47b1-b7c2-7b2b025a9b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:32.281981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3883e9-00eb-47b1-b7c2-7b2b025a9b2b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:32.282145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3883e9-00eb-47b1-b7c2-7b2b025a9b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:32.282419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3883e9-00eb-47b1-b7c2-7b2b025a9b2b None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:32.283056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3883e9-00eb-47b1-b7c2-7b2b025a9b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:32.283394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3883e9-00eb-47b1-b7c2-7b2b025a9b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:32.285457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3883e9-00eb-47b1-b7c2-7b2b025a9b2b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:32.302452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 363/748] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:32.303546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3883e9-00eb-47b1-b7c2-7b2b025a9b2b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:32.348093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da489b9-e4f7-4672-81ff-0f7d9a40b880 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:32.389199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:32.395974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86a90b-552e-45cd-99d5-9bef8479d072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:32.396578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86a90b-552e-45cd-99d5-9bef8479d072 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:32.396856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86a90b-552e-45cd-99d5-9bef8479d072 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:32.397124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86a90b-552e-45cd-99d5-9bef8479d072 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:32.397800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86a90b-552e-45cd-99d5-9bef8479d072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:32.398051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86a90b-552e-45cd-99d5-9bef8479d072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:32.399491 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86a90b-552e-45cd-99d5-9bef8479d072 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:32.420093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 386/749] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:32.420275 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86a90b-552e-45cd-99d5-9bef8479d072 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:32.423680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3883e9-00eb-47b1-b7c2-7b2b025a9b2b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:32.438616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:32.468556 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d4e6c-8007-477e-b41b-fe21115419dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:32.470003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4e6c-8007-477e-b41b-fe21115419dd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:32.470685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4e6c-8007-477e-b41b-fe21115419dd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:32.471701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4e6c-8007-477e-b41b-fe21115419dd None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:32.472675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d4e6c-8007-477e-b41b-fe21115419dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:32.473120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d4e6c-8007-477e-b41b-fe21115419dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:32.475455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d4e6c-8007-477e-b41b-fe21115419dd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:32.492116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 364/750] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:32.493233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d4e6c-8007-477e-b41b-fe21115419dd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:32.535480 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86a90b-552e-45cd-99d5-9bef8479d072 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:32.571203 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128f498-4d60-415c-822a-bd7959fd4a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:32.571971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128f498-4d60-415c-822a-bd7959fd4a8d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:32.572341 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128f498-4d60-415c-822a-bd7959fd4a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:32.572704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128f498-4d60-415c-822a-bd7959fd4a8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:32.580653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128f498-4d60-415c-822a-bd7959fd4a8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:32.582401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128f498-4d60-415c-822a-bd7959fd4a8d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d128f498-4d60-415c-822a-bd7959fd4a8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:32.599850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:32.601031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:32.601978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:32.601978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:32.601978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:32.601978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:32.601978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:32.601978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:32.601978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:32.601978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:32.601978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:20:32.601978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:32.601978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 387/751] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 22:20:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:32.602546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128f498-4d60-415c-822a-bd7959fd4a8d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:32.618991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d4e6c-8007-477e-b41b-fe21115419dd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:32.663176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a4c86-d3cf-4235-a894-b23865036065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:32.664324 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a4c86-d3cf-4235-a894-b23865036065 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:32.665151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a4c86-d3cf-4235-a894-b23865036065 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:32.666089 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a4c86-d3cf-4235-a894-b23865036065 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:32.671670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:32.682034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a4c86-d3cf-4235-a894-b23865036065 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:32.683996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a4c86-d3cf-4235-a894-b23865036065 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:32.691529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-dc9a4c86-d3cf-4235-a894-b23865036065 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:32.700682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:32.701922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:32.703283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:32.703283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:32.703283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:32.703283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:32.703283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:32.703283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:32.703283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:32.703283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:32.703283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 22:20:32.703283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:32.706190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 365/752] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 22:20:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:32.707481 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a4c86-d3cf-4235-a894-b23865036065 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:32.719441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128f498-4d60-415c-822a-bd7959fd4a8d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:32.754464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed94f57-b5c3-489f-841c-acb6e61a72b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:32.755258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94f57-b5c3-489f-841c-acb6e61a72b9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:32.755652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94f57-b5c3-489f-841c-acb6e61a72b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:32.756020 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94f57-b5c3-489f-841c-acb6e61a72b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:32.756898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed94f57-b5c3-489f-841c-acb6e61a72b9 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=c30e49a1967e48c9b45f56454ffc1297) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:32.757304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed94f57-b5c3-489f-841c-acb6e61a72b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:32.758999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed94f57-b5c3-489f-841c-acb6e61a72b9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:32.765083 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 388/753] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:32 2022] GET /identity/v3/role_assignments?user.id=c30e49a1967e48c9b45f56454ffc1297&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:32.769865 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed94f57-b5c3-489f-841c-acb6e61a72b9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:32.885775 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a4c86-d3cf-4235-a894-b23865036065 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:32.933067 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d46c40-30be-49c1-962a-406bd8825b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:32.933861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d46c40-30be-49c1-962a-406bd8825b14 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:32.934389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d46c40-30be-49c1-962a-406bd8825b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:32.934754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d46c40-30be-49c1-962a-406bd8825b14 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:32.936229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d46c40-30be-49c1-962a-406bd8825b14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:32.936538 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d46c40-30be-49c1-962a-406bd8825b14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:32.937947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed94f57-b5c3-489f-841c-acb6e61a72b9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:32.938080 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d46c40-30be-49c1-962a-406bd8825b14 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:32.962103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 366/754] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 22:20:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:32.963699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724f1b5-af5b-4267-9443-8a1955a65da0 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:32.964215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724f1b5-af5b-4267-9443-8a1955a65da0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:32.964677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724f1b5-af5b-4267-9443-8a1955a65da0 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:32.966647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 367/755] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:32.967578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724f1b5-af5b-4267-9443-8a1955a65da0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:32.980789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f85c0-6ec9-455e-9a73-86997e66300b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:32.981626 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f85c0-6ec9-455e-9a73-86997e66300b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:32.981738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f85c0-6ec9-455e-9a73-86997e66300b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:32.982017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f85c0-6ec9-455e-9a73-86997e66300b None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:32.982787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f85c0-6ec9-455e-9a73-86997e66300b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:32.983113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f85c0-6ec9-455e-9a73-86997e66300b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:32.987142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f85c0-6ec9-455e-9a73-86997e66300b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:33.001608 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:33.009620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 389/756] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Aug 7 22:20:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:33.012609 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96360be0-12e9-48d4-becf-f97062b10a17 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:33.012891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96360be0-12e9-48d4-becf-f97062b10a17 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:33.013135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96360be0-12e9-48d4-becf-f97062b10a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:33.035429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-96360be0-12e9-48d4-becf-f97062b10a17 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:33.036619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-96360be0-12e9-48d4-becf-f97062b10a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:33.055030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:33.112995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724f1b5-af5b-4267-9443-8a1955a65da0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:33.131338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 390/757] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:33.132743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96360be0-12e9-48d4-becf-f97062b10a17 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:33.150069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71030e-4a07-41fe-b755-a862b4886778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:33.150629 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71030e-4a07-41fe-b755-a862b4886778 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:33.151181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71030e-4a07-41fe-b755-a862b4886778 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:33.151545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71030e-4a07-41fe-b755-a862b4886778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:33.167108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71030e-4a07-41fe-b755-a862b4886778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:33.167108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71030e-4a07-41fe-b755-a862b4886778 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0e71030e-4a07-41fe-b755-a862b4886778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:33.179924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:33.180930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:33.181816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:33.181816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:33.181816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:33.181816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 368/758] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:33.182741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71030e-4a07-41fe-b755-a862b4886778 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:33.258492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96360be0-12e9-48d4-becf-f97062b10a17 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:33.288661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:33.302159 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e035d93-4e38-4f2a-9b1b-83f4e0ca145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:33.302760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e035d93-4e38-4f2a-9b1b-83f4e0ca145a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:33.303032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e035d93-4e38-4f2a-9b1b-83f4e0ca145a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:33.303332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e035d93-4e38-4f2a-9b1b-83f4e0ca145a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:33.311119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71030e-4a07-41fe-b755-a862b4886778 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:33.321238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:33.359612 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9c413-ca10-4aad-bfe2-ececf184dd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:33.361004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9c413-ca10-4aad-bfe2-ececf184dd20 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:33.362335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9c413-ca10-4aad-bfe2-ececf184dd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:33.362793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9c413-ca10-4aad-bfe2-ececf184dd20 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:33.363844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9c413-ca10-4aad-bfe2-ececf184dd20 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:33.366075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9c413-ca10-4aad-bfe2-ececf184dd20 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:33.377543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e035d93-4e38-4f2a-9b1b-83f4e0ca145a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:33.379092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e035d93-4e38-4f2a-9b1b-83f4e0ca145a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-23f9c413-ca10-4aad-bfe2-ececf184dd20 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:33.382732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:33.383820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 22:20:33.384649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:33.387295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 369/759] 10.222.0.15 () {56 vars in 1129 bytes} [Sun Aug 7 22:20:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:33.388320 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9c413-ca10-4aad-bfe2-ececf184dd20 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:33.514702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 391/760] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:20:33.514702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e035d93-4e38-4f2a-9b1b-83f4e0ca145a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:33.517161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9c413-ca10-4aad-bfe2-ececf184dd20 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:33.552303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:33.554902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecb837-e3c1-4020-9302-a9e78a9f4465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:33.555820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecb837-e3c1-4020-9302-a9e78a9f4465 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:33.556127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecb837-e3c1-4020-9302-a9e78a9f4465 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:33.556370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecb837-e3c1-4020-9302-a9e78a9f4465 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:33.557015 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecb837-e3c1-4020-9302-a9e78a9f4465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:33.557388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecb837-e3c1-4020-9302-a9e78a9f4465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:33.558858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecb837-e3c1-4020-9302-a9e78a9f4465 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:33.573784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 370/761] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:33.574706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecb837-e3c1-4020-9302-a9e78a9f4465 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:33.611514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:33.655439 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e035d93-4e38-4f2a-9b1b-83f4e0ca145a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:33.701342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecb837-e3c1-4020-9302-a9e78a9f4465 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:33.704980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f196fa-e7d7-4b6f-aefd-8a5555d08fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:33.705957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f196fa-e7d7-4b6f-aefd-8a5555d08fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:33.706441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f196fa-e7d7-4b6f-aefd-8a5555d08fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:33.706987 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f196fa-e7d7-4b6f-aefd-8a5555d08fd1 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:33.707932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f196fa-e7d7-4b6f-aefd-8a5555d08fd1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:33.708426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f196fa-e7d7-4b6f-aefd-8a5555d08fd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:33.710537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f196fa-e7d7-4b6f-aefd-8a5555d08fd1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:33.717829 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 392/762] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Aug 7 22:20:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:33.718818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f196fa-e7d7-4b6f-aefd-8a5555d08fd1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:33.745607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f157c-2168-43b3-b07c-070ef7bb9cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:33.746233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f157c-2168-43b3-b07c-070ef7bb9cbf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:33.746507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f157c-2168-43b3-b07c-070ef7bb9cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:33.746775 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f157c-2168-43b3-b07c-070ef7bb9cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:33.761416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f157c-2168-43b3-b07c-070ef7bb9cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:33.763013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f157c-2168-43b3-b07c-070ef7bb9cbf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-598f157c-2168-43b3-b07c-070ef7bb9cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:33.780389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:33.781375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:33.782242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:33.782242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:33.782242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:33.786673 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 371/763] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:33.787893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f157c-2168-43b3-b07c-070ef7bb9cbf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:33.840018 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:33.854629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f196fa-e7d7-4b6f-aefd-8a5555d08fd1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:33.893472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:33.902315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa9729-4c14-4bf0-bcd7-fb9b714aff78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:33.903568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa9729-4c14-4bf0-bcd7-fb9b714aff78 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:33.904515 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa9729-4c14-4bf0-bcd7-fb9b714aff78 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:33.905018 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa9729-4c14-4bf0-bcd7-fb9b714aff78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:33.916526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa9729-4c14-4bf0-bcd7-fb9b714aff78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:33.916769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f157c-2168-43b3-b07c-070ef7bb9cbf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:33.918851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa9729-4c14-4bf0-bcd7-fb9b714aff78 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a1aa9729-4c14-4bf0-bcd7-fb9b714aff78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:33.935116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:33.936042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:33.936893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:33.936893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:33.936893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:33.936893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:33.936893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:33.936893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:33.936893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:33.936893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:33.938520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 393/764] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:33.939652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa9729-4c14-4bf0-bcd7-fb9b714aff78 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:33.959637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88702a-76b4-4443-bdd4-928960da81b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:33.960244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88702a-76b4-4443-bdd4-928960da81b9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:33.960515 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88702a-76b4-4443-bdd4-928960da81b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:33.960783 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88702a-76b4-4443-bdd4-928960da81b9 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:33.961822 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88702a-76b4-4443-bdd4-928960da81b9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:33.962261 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88702a-76b4-4443-bdd4-928960da81b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:33.963922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88702a-76b4-4443-bdd4-928960da81b9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:33.969844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 372/765] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Aug 7 22:20:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:33.973084 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a163-7aa1-46e0-816f-3cf1ca176bfe None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:33.973084 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a163-7aa1-46e0-816f-3cf1ca176bfe None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:33.973084 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a163-7aa1-46e0-816f-3cf1ca176bfe None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:33.974575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 373/766] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:33.975308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a163-7aa1-46e0-816f-3cf1ca176bfe None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:34.046105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa9729-4c14-4bf0-bcd7-fb9b714aff78 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:34.080886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0e800-508d-4b5e-be95-cf1f06a22fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:34.081614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0e800-508d-4b5e-be95-cf1f06a22fec None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.081904 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0e800-508d-4b5e-be95-cf1f06a22fec None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.082173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0e800-508d-4b5e-be95-cf1f06a22fec None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:34.082808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0e800-508d-4b5e-be95-cf1f06a22fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:34.083130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0e800-508d-4b5e-be95-cf1f06a22fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:34.084483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0e800-508d-4b5e-be95-cf1f06a22fec None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:34.085888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a163-7aa1-46e0-816f-3cf1ca176bfe None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:34.096867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 394/767] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:34.098020 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25519e82-77f1-41fa-885c-5f46fdbf8096 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.098303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25519e82-77f1-41fa-885c-5f46fdbf8096 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.098574 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25519e82-77f1-41fa-885c-5f46fdbf8096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:34.116777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-25519e82-77f1-41fa-885c-5f46fdbf8096 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:34.117947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-25519e82-77f1-41fa-885c-5f46fdbf8096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:34.120698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:34.129788 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50e38f-e7cf-4667-9a4a-1d128c9bf9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:34.130688 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50e38f-e7cf-4667-9a4a-1d128c9bf9ac None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.131142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50e38f-e7cf-4667-9a4a-1d128c9bf9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.131412 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50e38f-e7cf-4667-9a4a-1d128c9bf9ac None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:34.132128 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50e38f-e7cf-4667-9a4a-1d128c9bf9ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:34.132491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50e38f-e7cf-4667-9a4a-1d128c9bf9ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:34.133861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50e38f-e7cf-4667-9a4a-1d128c9bf9ac None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:34.152654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 374/768] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:34.152654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50e38f-e7cf-4667-9a4a-1d128c9bf9ac None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:34.159329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:34.199132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 395/769] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:34.199132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25519e82-77f1-41fa-885c-5f46fdbf8096 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:34.268088 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50e38f-e7cf-4667-9a4a-1d128c9bf9ac None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:34.302606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1334a-22f7-4683-bab9-5de16d268201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:34.303171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1334a-22f7-4683-bab9-5de16d268201 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.303452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1334a-22f7-4683-bab9-5de16d268201 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.303719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1334a-22f7-4683-bab9-5de16d268201 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:34.304439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1334a-22f7-4683-bab9-5de16d268201 None admin] RBAC: Adding query filter params (interface=public, service_id=b24c4371a39745b8b3ace865ce4a516f, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:34.304748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1334a-22f7-4683-bab9-5de16d268201 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:34.305944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25519e82-77f1-41fa-885c-5f46fdbf8096 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:34.306111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1334a-22f7-4683-bab9-5de16d268201 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:34.313432 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 375/770] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 22:20:34 2022] GET /identity/v3/endpoints?service_id=b24c4371a39745b8b3ace865ce4a516f&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:34.313432 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1334a-22f7-4683-bab9-5de16d268201 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:34.344788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fb258-ca3f-4c48-855d-ae69c0c0cba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:34.345449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fb258-ca3f-4c48-855d-ae69c0c0cba5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.345674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fb258-ca3f-4c48-855d-ae69c0c0cba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.345943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fb258-ca3f-4c48-855d-ae69c0c0cba5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:34.352526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fb258-ca3f-4c48-855d-ae69c0c0cba5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:34.353939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fb258-ca3f-4c48-855d-ae69c0c0cba5 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:34.356447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a71fb258-ca3f-4c48-855d-ae69c0c0cba5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:34.367268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:34.368347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:34.369252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:34.369252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:34.369252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:34.369252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:34.369252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:34.369252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:34.369252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:34.369252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:34.369252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 396/771] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:34.369713 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fb258-ca3f-4c48-855d-ae69c0c0cba5 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:34.396922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:34.429401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1334a-22f7-4683-bab9-5de16d268201 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:34.462956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee2f3a-9485-4675-a370-7fdc62a5e697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:34.463633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee2f3a-9485-4675-a370-7fdc62a5e697 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.463909 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee2f3a-9485-4675-a370-7fdc62a5e697 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.464179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee2f3a-9485-4675-a370-7fdc62a5e697 None admin] PATH_INFO: `/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/cc8bf701e94c403ab70fcffaeb81b65b/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:34.466084 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee2f3a-9485-4675-a370-7fdc62a5e697 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c5638056cea4e5397c6a25d434e5324, user_id=cc8bf701e94c403ab70fcffaeb81b65b, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:34.467537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee2f3a-9485-4675-a370-7fdc62a5e697 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:34.480487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fb258-ca3f-4c48-855d-ae69c0c0cba5 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:34.481728 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 376/772] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:20:34 2022] PUT /identity/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/cc8bf701e94c403ab70fcffaeb81b65b/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:20:34.482518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee2f3a-9485-4675-a370-7fdc62a5e697 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:34.535410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7e8a9-3005-4f28-853d-0e844f8e7e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:34.536229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7e8a9-3005-4f28-853d-0e844f8e7e7d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.536577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7e8a9-3005-4f28-853d-0e844f8e7e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.536913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7e8a9-3005-4f28-853d-0e844f8e7e7d None admin] PATH_INFO: `/v3/services/network` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:34.537564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7e8a9-3005-4f28-853d-0e844f8e7e7d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:34.539033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7e8a9-3005-4f28-853d-0e844f8e7e7d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-3ae7e8a9-3005-4f28-853d-0e844f8e7e7d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:34.549967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:34.551060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 22:20:34.551957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:34.556630 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 397/773] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:34 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:34.557699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7e8a9-3005-4f28-853d-0e844f8e7e7d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:34.614192 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee2f3a-9485-4675-a370-7fdc62a5e697 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:34.631820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:34.649876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:34.656936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43155949-5a34-4cb2-88d7-e7dfb057fcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:34.658012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43155949-5a34-4cb2-88d7-e7dfb057fcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.659112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43155949-5a34-4cb2-88d7-e7dfb057fcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.659666 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43155949-5a34-4cb2-88d7-e7dfb057fcf3 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:34.660505 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43155949-5a34-4cb2-88d7-e7dfb057fcf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:34.662373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43155949-5a34-4cb2-88d7-e7dfb057fcf3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:34.668931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 377/774] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 22:20:34 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:34.670176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43155949-5a34-4cb2-88d7-e7dfb057fcf3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:34.683686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7e8a9-3005-4f28-853d-0e844f8e7e7d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:34.736066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661454cc-7fc7-4289-b15e-2f55e6853566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:34.737690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661454cc-7fc7-4289-b15e-2f55e6853566 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.738712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661454cc-7fc7-4289-b15e-2f55e6853566 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.739273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661454cc-7fc7-4289-b15e-2f55e6853566 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:34.740539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661454cc-7fc7-4289-b15e-2f55e6853566 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:34.741248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661454cc-7fc7-4289-b15e-2f55e6853566 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:34.743797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661454cc-7fc7-4289-b15e-2f55e6853566 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:34.761376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 398/775] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:34.768830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661454cc-7fc7-4289-b15e-2f55e6853566 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:34.801744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43155949-5a34-4cb2-88d7-e7dfb057fcf3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:34.856564 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf6f62-4933-400e-a33e-06c5cbd252cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:34.857096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf6f62-4933-400e-a33e-06c5cbd252cf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.857371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf6f62-4933-400e-a33e-06c5cbd252cf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.857641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf6f62-4933-400e-a33e-06c5cbd252cf None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:34.858278 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf6f62-4933-400e-a33e-06c5cbd252cf None admin] RBAC: Adding query filter params (name=network) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:34.858577 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf6f62-4933-400e-a33e-06c5cbd252cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:34.860161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf6f62-4933-400e-a33e-06c5cbd252cf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:34.867935 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 378/776] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:20:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:34.868593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990fe31-f003-4f47-bd68-8f6ef2f3a3de None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.868872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990fe31-f003-4f47-bd68-8f6ef2f3a3de None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.869142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990fe31-f003-4f47-bd68-8f6ef2f3a3de None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:34.870342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 379/777] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:34.872240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990fe31-f003-4f47-bd68-8f6ef2f3a3de None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:34.904445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661454cc-7fc7-4289-b15e-2f55e6853566 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:34.938244 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:34.940580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:34.961181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129ed93-c6a9-4850-a9ee-6dd938df4437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:34.962588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129ed93-c6a9-4850-a9ee-6dd938df4437 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.963018 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129ed93-c6a9-4850-a9ee-6dd938df4437 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.963523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129ed93-c6a9-4850-a9ee-6dd938df4437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:34.964879 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129ed93-c6a9-4850-a9ee-6dd938df4437 None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=e44d9ab25b1444ed973079d988813b23) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:34.965343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129ed93-c6a9-4850-a9ee-6dd938df4437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:34.967755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129ed93-c6a9-4850-a9ee-6dd938df4437 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:34.975859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 399/778] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:34 2022] GET /identity/v3/role_assignments?user.id=e44d9ab25b1444ed973079d988813b23&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:34.983314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c040cb1-7635-4cd3-b2cb-1cf699ed763d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:34.983314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c040cb1-7635-4cd3-b2cb-1cf699ed763d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:34.983314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c040cb1-7635-4cd3-b2cb-1cf699ed763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:35.008721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990fe31-f003-4f47-bd68-8f6ef2f3a3de None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:35.020504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2c040cb1-7635-4cd3-b2cb-1cf699ed763d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:35.021736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2c040cb1-7635-4cd3-b2cb-1cf699ed763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:35.082540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ca501-1d9a-4692-afaa-22d8fc4149fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:35.083225 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ca501-1d9a-4692-afaa-22d8fc4149fd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:35.083504 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ca501-1d9a-4692-afaa-22d8fc4149fd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:35.083771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ca501-1d9a-4692-afaa-22d8fc4149fd None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:35.084460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ca501-1d9a-4692-afaa-22d8fc4149fd None admin] RBAC: Adding query filter params (type=network) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:35.084763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ca501-1d9a-4692-afaa-22d8fc4149fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:35.086161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ca501-1d9a-4692-afaa-22d8fc4149fd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:35.096691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 380/779] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:20:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:35.103231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ca501-1d9a-4692-afaa-22d8fc4149fd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:35.149402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 400/780] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:35.183392 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c040cb1-7635-4cd3-b2cb-1cf699ed763d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:35.247211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ca501-1d9a-4692-afaa-22d8fc4149fd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:35.275454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:35.288210 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb41a7-7a09-4635-8b98-5a32253dac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:35.289076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb41a7-7a09-4635-8b98-5a32253dac21 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:35.289501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb41a7-7a09-4635-8b98-5a32253dac21 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:35.289948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb41a7-7a09-4635-8b98-5a32253dac21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:35.291338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb41a7-7a09-4635-8b98-5a32253dac21 None admin] RBAC: Adding query filter params (interface=public, service_id=49db423665b4456383d4f718ca6419a2, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:35.291798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb41a7-7a09-4635-8b98-5a32253dac21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:35.293296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb41a7-7a09-4635-8b98-5a32253dac21 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:35.300222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 381/781] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 22:20:35 2022] GET /identity/v3/endpoints?service_id=49db423665b4456383d4f718ca6419a2&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:35.307284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb41a7-7a09-4635-8b98-5a32253dac21 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:35.348816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c040cb1-7635-4cd3-b2cb-1cf699ed763d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:35.373503 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:35.394430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb02b57-ff8e-497b-bc7a-0c46de65384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:35.395369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb02b57-ff8e-497b-bc7a-0c46de65384a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:35.395863 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb02b57-ff8e-497b-bc7a-0c46de65384a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:35.396279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb02b57-ff8e-497b-bc7a-0c46de65384a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:35.409843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb02b57-ff8e-497b-bc7a-0c46de65384a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-7eb02b57-ff8e-497b-bc7a-0c46de65384a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:35.414993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:35.416113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:35.417147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:35.417147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:35.417147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:35.417147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:35.417147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:35.417147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:35.417147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:35.417147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:35.417147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:35.417147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:35.417147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:20:35.417147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:35.419852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 401/782] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:20:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:35.427244 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb02b57-ff8e-497b-bc7a-0c46de65384a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:35.520192 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb41a7-7a09-4635-8b98-5a32253dac21 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:35.574063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13625b39-68c5-4ebf-9ef2-bd8b259912b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:35.574840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13625b39-68c5-4ebf-9ef2-bd8b259912b2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:35.575255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13625b39-68c5-4ebf-9ef2-bd8b259912b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:35.575623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13625b39-68c5-4ebf-9ef2-bd8b259912b2 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:35.576330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13625b39-68c5-4ebf-9ef2-bd8b259912b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:35.577797 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13625b39-68c5-4ebf-9ef2-bd8b259912b2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:35.585932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 382/783] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 22:20:35 2022] GET /identity/v3/services => generated 772 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:35.608453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb02b57-ff8e-497b-bc7a-0c46de65384a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:35.652207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e639-582b-428f-9a3b-b066cc595aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:35.652943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e639-582b-428f-9a3b-b066cc595aff None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:35.653292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e639-582b-428f-9a3b-b066cc595aff None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:35.653629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e639-582b-428f-9a3b-b066cc595aff None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:35.654444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78e639-582b-428f-9a3b-b066cc595aff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:35.654814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78e639-582b-428f-9a3b-b066cc595aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:35.656322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78e639-582b-428f-9a3b-b066cc595aff None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:35.666985 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 402/784] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:35.672955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13625b39-68c5-4ebf-9ef2-bd8b259912b2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:35.766213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:35.819915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13625b39-68c5-4ebf-9ef2-bd8b259912b2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:35.856949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee1ed2-0a01-4f4b-afe6-f7a11a44086d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:35.857631 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee1ed2-0a01-4f4b-afe6-f7a11a44086d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:35.857902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee1ed2-0a01-4f4b-afe6-f7a11a44086d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:35.858215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee1ed2-0a01-4f4b-afe6-f7a11a44086d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:35.869349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee1ed2-0a01-4f4b-afe6-f7a11a44086d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:35.870792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee1ed2-0a01-4f4b-afe6-f7a11a44086d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-cdee1ed2-0a01-4f4b-afe6-f7a11a44086d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:35.885735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:35.886703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:35.887655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:35.887655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:35.887655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:35.887655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 383/785] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:35.892543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e639-582b-428f-9a3b-b066cc595aff None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:35.948277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:36.032537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e639-582b-428f-9a3b-b066cc595aff None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:36.067340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a620d02-adf8-45e3-addc-25a87d179531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:36.067940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a620d02-adf8-45e3-addc-25a87d179531 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:36.068214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a620d02-adf8-45e3-addc-25a87d179531 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:36.068481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a620d02-adf8-45e3-addc-25a87d179531 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:36.069111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a620d02-adf8-45e3-addc-25a87d179531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:36.069408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a620d02-adf8-45e3-addc-25a87d179531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:36.070759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a620d02-adf8-45e3-addc-25a87d179531 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:36.083035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 403/786] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:36.088505 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee1ed2-0a01-4f4b-afe6-f7a11a44086d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:36.217255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee1ed2-0a01-4f4b-afe6-f7a11a44086d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:36.219028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:36.269027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d933e92-3c4a-41a9-ba18-93511ce1865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:36.269652 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d933e92-3c4a-41a9-ba18-93511ce1865d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:36.269925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d933e92-3c4a-41a9-ba18-93511ce1865d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:36.270191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d933e92-3c4a-41a9-ba18-93511ce1865d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:36.282843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d933e92-3c4a-41a9-ba18-93511ce1865d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:36.284813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d933e92-3c4a-41a9-ba18-93511ce1865d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4d933e92-3c4a-41a9-ba18-93511ce1865d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:36.301401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:36.302338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:36.303295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:36.303295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:36.303295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:36.303295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:36.303295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:36.303295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:36.303295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:36.303295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:36.303295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 22:20:36.303295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:36.303295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 384/787] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:20:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:36.308508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a620d02-adf8-45e3-addc-25a87d179531 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:36.417130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:36.426154 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a620d02-adf8-45e3-addc-25a87d179531 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:36.469944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a6f75-e923-43d9-a361-b1cfe78d8595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:36.470476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a6f75-e923-43d9-a361-b1cfe78d8595 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:36.470753 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a6f75-e923-43d9-a361-b1cfe78d8595 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:36.471050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a6f75-e923-43d9-a361-b1cfe78d8595 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:36.471809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a6f75-e923-43d9-a361-b1cfe78d8595 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:36.472111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a6f75-e923-43d9-a361-b1cfe78d8595 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:36.473525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a6f75-e923-43d9-a361-b1cfe78d8595 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:36.492185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 404/788] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Aug 7 22:20:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:36.497717 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d933e92-3c4a-41a9-ba18-93511ce1865d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:36.652178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d933e92-3c4a-41a9-ba18-93511ce1865d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:36.705047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526e69c-e987-4ca5-b085-93b6ac83c7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:36.706364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526e69c-e987-4ca5-b085-93b6ac83c7bf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:36.706629 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526e69c-e987-4ca5-b085-93b6ac83c7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:36.706907 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526e69c-e987-4ca5-b085-93b6ac83c7bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:36.724222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526e69c-e987-4ca5-b085-93b6ac83c7bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:36.725593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526e69c-e987-4ca5-b085-93b6ac83c7bf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-d526e69c-e987-4ca5-b085-93b6ac83c7bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:36.744880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:36.745853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:36.746772 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:36.746772 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:36.746772 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:36.747389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 385/789] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:36.752960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a6f75-e923-43d9-a361-b1cfe78d8595 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:36.868772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a6f75-e923-43d9-a361-b1cfe78d8595 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:36.914354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0237a-8b90-46b2-ad4b-f307ea9e2e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:36.914964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0237a-8b90-46b2-ad4b-f307ea9e2e4f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:36.915277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0237a-8b90-46b2-ad4b-f307ea9e2e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:36.915551 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0237a-8b90-46b2-ad4b-f307ea9e2e4f None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:36.916193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0237a-8b90-46b2-ad4b-f307ea9e2e4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:36.916496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0237a-8b90-46b2-ad4b-f307ea9e2e4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:36.917851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0237a-8b90-46b2-ad4b-f307ea9e2e4f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:36.930119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 405/790] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:36.935705 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526e69c-e987-4ca5-b085-93b6ac83c7bf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:36.967565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:37.077406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa6bd-7d61-4972-bb7f-b660cb529816 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.077760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa6bd-7d61-4972-bb7f-b660cb529816 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.077951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa6bd-7d61-4972-bb7f-b660cb529816 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.079312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 406/791] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:37.085526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db7cf0-aa52-49ac-ad27-1c9372286d00 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.085805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db7cf0-aa52-49ac-ad27-1c9372286d00 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.086142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db7cf0-aa52-49ac-ad27-1c9372286d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.111942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526e69c-e987-4ca5-b085-93b6ac83c7bf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:37.114268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e7db7cf0-aa52-49ac-ad27-1c9372286d00 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:37.115481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e7db7cf0-aa52-49ac-ad27-1c9372286d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:37.148078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:37.175939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03134f32-3cd8-4a02-8371-5604fdb0e85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:37.176573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03134f32-3cd8-4a02-8371-5604fdb0e85e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.176913 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03134f32-3cd8-4a02-8371-5604fdb0e85e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.177186 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03134f32-3cd8-4a02-8371-5604fdb0e85e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.185040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03134f32-3cd8-4a02-8371-5604fdb0e85e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:37.186488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03134f32-3cd8-4a02-8371-5604fdb0e85e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-03134f32-3cd8-4a02-8371-5604fdb0e85e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:37.200639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:37.201533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:37.202423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:37.202423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:37.202423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:37.202423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:37.202423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:37.202423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:37.202423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:37.202423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:37.202423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 386/792] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:37.203377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ade176-c8bf-4174-8391-83c6edf90379 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.206640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ade176-c8bf-4174-8391-83c6edf90379 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.206640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ade176-c8bf-4174-8391-83c6edf90379 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.206640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 387/793] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:37.207751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ade176-c8bf-4174-8391-83c6edf90379 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:37.236075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 407/794] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:20:37.237889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7bdd9-fc33-41c2-9637-245f09b64e16 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.238232 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7bdd9-fc33-41c2-9637-245f09b64e16 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.238508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7bdd9-fc33-41c2-9637-245f09b64e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.258179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-9fc7bdd9-fc33-41c2-9637-245f09b64e16 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:37.259435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9fc7bdd9-fc33-41c2-9637-245f09b64e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:37.315456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:37.339289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 408/795] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:37.340284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7bdd9-fc33-41c2-9637-245f09b64e16 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:37.343775 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ade176-c8bf-4174-8391-83c6edf90379 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:37.381044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbf854-5970-4ba9-84a2-070f220950c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:37.382088 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbf854-5970-4ba9-84a2-070f220950c6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.382420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbf854-5970-4ba9-84a2-070f220950c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.382697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbf854-5970-4ba9-84a2-070f220950c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.383755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbf854-5970-4ba9-84a2-070f220950c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:37.384529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbf854-5970-4ba9-84a2-070f220950c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:37.386500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbf854-5970-4ba9-84a2-070f220950c6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:37.406156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 388/796] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:37.406993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbf854-5970-4ba9-84a2-070f220950c6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:37.442238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:37.466866 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7bdd9-fc33-41c2-9637-245f09b64e16 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:37.501711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc319ef-ba7b-4798-8985-62eb82cde160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:37.502841 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc319ef-ba7b-4798-8985-62eb82cde160 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.503143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc319ef-ba7b-4798-8985-62eb82cde160 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.503408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc319ef-ba7b-4798-8985-62eb82cde160 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.503977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc319ef-ba7b-4798-8985-62eb82cde160 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:37.505311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc319ef-ba7b-4798-8985-62eb82cde160 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:37.510522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbf854-5970-4ba9-84a2-070f220950c6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-cfc319ef-ba7b-4798-8985-62eb82cde160 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:37.513705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:37.514668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:37.515557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 409/797] 10.222.0.15 () {56 vars in 1129 bytes} [Sun Aug 7 22:20:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:37.516371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbad903-3bbe-4306-8563-b392a475e9de None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.516930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbad903-3bbe-4306-8563-b392a475e9de None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.516930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbad903-3bbe-4306-8563-b392a475e9de None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.522748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 410/798] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:37.522748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbad903-3bbe-4306-8563-b392a475e9de None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:37.550920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39691a04-8c73-4623-962e-94a959e34395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:37.551592 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39691a04-8c73-4623-962e-94a959e34395 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.551850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39691a04-8c73-4623-962e-94a959e34395 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.552120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39691a04-8c73-4623-962e-94a959e34395 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.553964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:37.564003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39691a04-8c73-4623-962e-94a959e34395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-39691a04-8c73-4623-962e-94a959e34395 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:37.569667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:37.570619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:37.571501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 389/799] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:20:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:37.572275 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39691a04-8c73-4623-962e-94a959e34395 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:37.630171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbad903-3bbe-4306-8563-b392a475e9de None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:37.666600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3adaf4-54cc-44f6-8674-576ace17ba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:37.667298 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3adaf4-54cc-44f6-8674-576ace17ba62 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.667578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3adaf4-54cc-44f6-8674-576ace17ba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.667852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3adaf4-54cc-44f6-8674-576ace17ba62 None admin] PATH_INFO: `/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/c30e49a1967e48c9b45f56454ffc1297/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.669767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3adaf4-54cc-44f6-8674-576ace17ba62 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c5638056cea4e5397c6a25d434e5324, user_id=c30e49a1967e48c9b45f56454ffc1297, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:37.671223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3adaf4-54cc-44f6-8674-576ace17ba62 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:37.679594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39691a04-8c73-4623-962e-94a959e34395 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:37.695113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 411/800] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:20:37 2022] PUT /identity/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/c30e49a1967e48c9b45f56454ffc1297/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:20:37.695113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec89b3d-de83-4fb5-aa17-7fcab009490c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.695113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec89b3d-de83-4fb5-aa17-7fcab009490c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.695113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec89b3d-de83-4fb5-aa17-7fcab009490c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.702773 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:37.719067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-eec89b3d-de83-4fb5-aa17-7fcab009490c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:37.720546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-eec89b3d-de83-4fb5-aa17-7fcab009490c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:37.736467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19549d6-0ac7-4eb7-a91c-5d681acedc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:37.737551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19549d6-0ac7-4eb7-a91c-5d681acedc3c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.737966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19549d6-0ac7-4eb7-a91c-5d681acedc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.738793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19549d6-0ac7-4eb7-a91c-5d681acedc3c None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.740021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19549d6-0ac7-4eb7-a91c-5d681acedc3c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:37.740386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19549d6-0ac7-4eb7-a91c-5d681acedc3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:37.742580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19549d6-0ac7-4eb7-a91c-5d681acedc3c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:37.751491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 390/801] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Aug 7 22:20:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:37.753055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19549d6-0ac7-4eb7-a91c-5d681acedc3c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:37.809280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 412/802] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:37.810382 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec89b3d-de83-4fb5-aa17-7fcab009490c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:37.819479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:37.868618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19549d6-0ac7-4eb7-a91c-5d681acedc3c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:37.908767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea88a2e-fc06-45d7-a9e2-f74b97d093c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:37.909628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea88a2e-fc06-45d7-a9e2-f74b97d093c2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.910048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea88a2e-fc06-45d7-a9e2-f74b97d093c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.910457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea88a2e-fc06-45d7-a9e2-f74b97d093c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.911357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea88a2e-fc06-45d7-a9e2-f74b97d093c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:37.911866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea88a2e-fc06-45d7-a9e2-f74b97d093c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:37.913380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea88a2e-fc06-45d7-a9e2-f74b97d093c2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:37.922421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec89b3d-de83-4fb5-aa17-7fcab009490c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:37.925455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 391/803] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:37.926346 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea88a2e-fc06-45d7-a9e2-f74b97d093c2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:37.956825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:37.966134 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3c3c7-3de1-4990-9920-2e713f4df9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:37.967780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3c3c7-3de1-4990-9920-2e713f4df9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:37.968060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3c3c7-3de1-4990-9920-2e713f4df9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:37.968332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3c3c7-3de1-4990-9920-2e713f4df9c8 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:37.968968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3c3c7-3de1-4990-9920-2e713f4df9c8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:37.969270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3c3c7-3de1-4990-9920-2e713f4df9c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:37.970638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3c3c7-3de1-4990-9920-2e713f4df9c8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:37.976224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 413/804] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Aug 7 22:20:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:37.977390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3c3c7-3de1-4990-9920-2e713f4df9c8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:38.061703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea88a2e-fc06-45d7-a9e2-f74b97d093c2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:38.083494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:38.099589 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5718dcd-9606-4832-87e6-5f25a7f6d58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:38.100360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5718dcd-9606-4832-87e6-5f25a7f6d58a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:38.100740 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5718dcd-9606-4832-87e6-5f25a7f6d58a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:38.101108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5718dcd-9606-4832-87e6-5f25a7f6d58a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:38.105103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3c3c7-3de1-4990-9920-2e713f4df9c8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:38.113123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5718dcd-9606-4832-87e6-5f25a7f6d58a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b5718dcd-9606-4832-87e6-5f25a7f6d58a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:38.118549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:38.119716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:38.120750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:38.120750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:38.120750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:38.120750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:38.120750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:38.120750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:38.120750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:38.120750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:38.120750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:38.120750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:38.120750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:38.120750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:38.127122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 392/805] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:38.127122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5718dcd-9606-4832-87e6-5f25a7f6d58a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:38.160559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d66e0b-531c-4a9d-a1b4-1467dc09c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:38.161497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d66e0b-531c-4a9d-a1b4-1467dc09c0af None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:38.161774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d66e0b-531c-4a9d-a1b4-1467dc09c0af None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:38.162041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d66e0b-531c-4a9d-a1b4-1467dc09c0af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:38.175426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d66e0b-531c-4a9d-a1b4-1467dc09c0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:38.177258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d66e0b-531c-4a9d-a1b4-1467dc09c0af None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-f2d66e0b-531c-4a9d-a1b4-1467dc09c0af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:38.197176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:38.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:38.199165 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:38.199165 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:38.199165 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:38.203120 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 414/806] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:38.204387 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d66e0b-531c-4a9d-a1b4-1467dc09c0af None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:38.246940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5718dcd-9606-4832-87e6-5f25a7f6d58a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:38.269072 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:38.288712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c93366-8c22-4247-bb09-29011c14471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:38.289316 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c93366-8c22-4247-bb09-29011c14471f None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:38.289591 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c93366-8c22-4247-bb09-29011c14471f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:38.289936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c93366-8c22-4247-bb09-29011c14471f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:38.290500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c93366-8c22-4247-bb09-29011c14471f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:38.291877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c93366-8c22-4247-bb09-29011c14471f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:38.323200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 393/807] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:20:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:38.323200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c93366-8c22-4247-bb09-29011c14471f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:38.335464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d66e0b-531c-4a9d-a1b4-1467dc09c0af None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:38.383752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:38.388819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507e1dd-9aa9-4370-95ca-fb69bff5f48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:38.389571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507e1dd-9aa9-4370-95ca-fb69bff5f48c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:38.390981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507e1dd-9aa9-4370-95ca-fb69bff5f48c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:38.391252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507e1dd-9aa9-4370-95ca-fb69bff5f48c None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:38.392173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507e1dd-9aa9-4370-95ca-fb69bff5f48c None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:38.392690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507e1dd-9aa9-4370-95ca-fb69bff5f48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:38.394427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507e1dd-9aa9-4370-95ca-fb69bff5f48c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:38.404139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 415/808] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:38.405562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96147e29-1244-4b59-900f-7ba6f476c448 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:38.405951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96147e29-1244-4b59-900f-7ba6f476c448 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:38.406328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96147e29-1244-4b59-900f-7ba6f476c448 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:38.412133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 416/809] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:38.412133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96147e29-1244-4b59-900f-7ba6f476c448 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:38.493152 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c93366-8c22-4247-bb09-29011c14471f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:38.536093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96147e29-1244-4b59-900f-7ba6f476c448 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:38.536922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57992258-c432-40ec-bf7a-d88faae4aa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:38.537643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57992258-c432-40ec-bf7a-d88faae4aa9f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:38.537834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57992258-c432-40ec-bf7a-d88faae4aa9f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:38.538073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57992258-c432-40ec-bf7a-d88faae4aa9f None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:38.538716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57992258-c432-40ec-bf7a-d88faae4aa9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:38.539737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57992258-c432-40ec-bf7a-d88faae4aa9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:38.540411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57992258-c432-40ec-bf7a-d88faae4aa9f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:38.544692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:38.558788 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 394/810] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:38.559972 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a1f7b-83e1-414f-a228-41713febf50a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:38.560869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a1f7b-83e1-414f-a228-41713febf50a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:38.560869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a1f7b-83e1-414f-a228-41713febf50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:38.573988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495be3-7fa7-4a9a-bd3e-1bb8f6659f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:38.574599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495be3-7fa7-4a9a-bd3e-1bb8f6659f16 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:38.574876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495be3-7fa7-4a9a-bd3e-1bb8f6659f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:38.575191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495be3-7fa7-4a9a-bd3e-1bb8f6659f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:38.582705 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-264a1f7b-83e1-414f-a228-41713febf50a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:38.584402 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-264a1f7b-83e1-414f-a228-41713febf50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:38.585745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6495be3-7fa7-4a9a-bd3e-1bb8f6659f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:38.587223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6495be3-7fa7-4a9a-bd3e-1bb8f6659f16 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-b6495be3-7fa7-4a9a-bd3e-1bb8f6659f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:38.601478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:38.602555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:38.603481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:38.603481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:38.603481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:38.603481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 417/811] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:38.603703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495be3-7fa7-4a9a-bd3e-1bb8f6659f16 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:38.679198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 395/812] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:38.680354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a1f7b-83e1-414f-a228-41713febf50a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:38.731005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495be3-7fa7-4a9a-bd3e-1bb8f6659f16 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:38.744564 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:38.765904 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df4655-6f82-4ec4-9f84-5bca88885228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:38.766531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df4655-6f82-4ec4-9f84-5bca88885228 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:38.766848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df4655-6f82-4ec4-9f84-5bca88885228 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:38.767199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df4655-6f82-4ec4-9f84-5bca88885228 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:38.775871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df4655-6f82-4ec4-9f84-5bca88885228 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:38.777412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df4655-6f82-4ec4-9f84-5bca88885228 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-54df4655-6f82-4ec4-9f84-5bca88885228 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:38.789253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:38.790181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:38.791517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:38.791517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:38.791517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:38.791517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:38.791517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:38.791517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:38.791517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:38.791517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:38.791517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:20:38.791517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:38.791517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 418/813] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 22:20:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:38.795970 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df4655-6f82-4ec4-9f84-5bca88885228 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:38.797940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a1f7b-83e1-414f-a228-41713febf50a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:38.815820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:38.838391 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb31031-7362-459c-9e51-af093503c84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:38.839353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb31031-7362-459c-9e51-af093503c84a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:38.839792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb31031-7362-459c-9e51-af093503c84a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:38.840238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb31031-7362-459c-9e51-af093503c84a None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:38.841095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb31031-7362-459c-9e51-af093503c84a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:38.841542 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb31031-7362-459c-9e51-af093503c84a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:38.843184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb31031-7362-459c-9e51-af093503c84a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:38.856611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 396/814] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:38.857699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb31031-7362-459c-9e51-af093503c84a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:38.907645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df4655-6f82-4ec4-9f84-5bca88885228 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:38.952241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed35cba-e74a-4c72-9cc4-3338ac3c36a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:38.952922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed35cba-e74a-4c72-9cc4-3338ac3c36a1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:38.953193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed35cba-e74a-4c72-9cc4-3338ac3c36a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:38.953458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed35cba-e74a-4c72-9cc4-3338ac3c36a1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:38.954077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed35cba-e74a-4c72-9cc4-3338ac3c36a1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:38.955959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed35cba-e74a-4c72-9cc4-3338ac3c36a1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:38.965595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5ed35cba-e74a-4c72-9cc4-3338ac3c36a1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:38.966816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:38.968201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 22:20:38.969293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:38.973146 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 419/815] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:38 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:38.974485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed35cba-e74a-4c72-9cc4-3338ac3c36a1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:38.992993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb31031-7362-459c-9e51-af093503c84a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:39.038518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b87a0-6889-444e-9813-75b0426c0506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:39.039627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b87a0-6889-444e-9813-75b0426c0506 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:39.040463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b87a0-6889-444e-9813-75b0426c0506 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:39.041034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b87a0-6889-444e-9813-75b0426c0506 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:39.042054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b87a0-6889-444e-9813-75b0426c0506 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:39.042703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b87a0-6889-444e-9813-75b0426c0506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:39.044693 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b87a0-6889-444e-9813-75b0426c0506 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:39.072529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 397/816] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 22:20:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:39.072529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b87a0-6889-444e-9813-75b0426c0506 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:39.080347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:39.100540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed35cba-e74a-4c72-9cc4-3338ac3c36a1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:39.137362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80524a3b-4c2a-472f-bf98-f01989cf0415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:39.137985 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80524a3b-4c2a-472f-bf98-f01989cf0415 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:39.138266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80524a3b-4c2a-472f-bf98-f01989cf0415 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:39.138539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80524a3b-4c2a-472f-bf98-f01989cf0415 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:39.146555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80524a3b-4c2a-472f-bf98-f01989cf0415 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:39.148018 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80524a3b-4c2a-472f-bf98-f01989cf0415 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-80524a3b-4c2a-472f-bf98-f01989cf0415 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:39.160667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:39.161597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:39.162513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:39.162513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:39.162513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:39.162513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:39.162513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:39.162513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:39.162513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:39.162513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:39.162513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 22:20:39.162513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:39.162513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 420/817] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 22:20:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:39.163117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80524a3b-4c2a-472f-bf98-f01989cf0415 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:39.211942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b87a0-6889-444e-9813-75b0426c0506 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:39.250427 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae2f80-d39a-4aa8-9666-b1a7acdb3a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:39.251036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae2f80-d39a-4aa8-9666-b1a7acdb3a68 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:39.252127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae2f80-d39a-4aa8-9666-b1a7acdb3a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:39.252127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae2f80-d39a-4aa8-9666-b1a7acdb3a68 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:39.252774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae2f80-d39a-4aa8-9666-b1a7acdb3a68 None admin] RBAC: Adding query filter params (name=network) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:39.253079 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae2f80-d39a-4aa8-9666-b1a7acdb3a68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:39.254456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae2f80-d39a-4aa8-9666-b1a7acdb3a68 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:39.263874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 398/818] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:20:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:39.263874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae2f80-d39a-4aa8-9666-b1a7acdb3a68 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:39.272714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:39.291597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80524a3b-4c2a-472f-bf98-f01989cf0415 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:39.337196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06745115-1bfa-4ee0-82e0-9efb5206a9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:39.338176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06745115-1bfa-4ee0-82e0-9efb5206a9fc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:39.338649 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06745115-1bfa-4ee0-82e0-9efb5206a9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:39.339136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06745115-1bfa-4ee0-82e0-9efb5206a9fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:39.355889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:39.368621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae2f80-d39a-4aa8-9666-b1a7acdb3a68 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:39.418904 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8515b-7122-4f79-b27a-f0b52dc69b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:39.419873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8515b-7122-4f79-b27a-f0b52dc69b67 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:39.420345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8515b-7122-4f79-b27a-f0b52dc69b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:39.421061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8515b-7122-4f79-b27a-f0b52dc69b67 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:39.422570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8515b-7122-4f79-b27a-f0b52dc69b67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:39.423074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8515b-7122-4f79-b27a-f0b52dc69b67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:39.424213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06745115-1bfa-4ee0-82e0-9efb5206a9fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:39.425201 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8515b-7122-4f79-b27a-f0b52dc69b67 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:39.425695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06745115-1bfa-4ee0-82e0-9efb5206a9fc None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:39.447747 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 399/819] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Aug 7 22:20:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:39.449595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8515b-7122-4f79-b27a-f0b52dc69b67 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:39.537933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 421/820] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:20:39.537933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06745115-1bfa-4ee0-82e0-9efb5206a9fc None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:39.545377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:39.583812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:39.587562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8515b-7122-4f79-b27a-f0b52dc69b67 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:39.624411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d439270-5394-412f-ad0d-15dfa9b027a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:39.625450 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d439270-5394-412f-ad0d-15dfa9b027a1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:39.626030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d439270-5394-412f-ad0d-15dfa9b027a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:39.626755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d439270-5394-412f-ad0d-15dfa9b027a1 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:39.628184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d439270-5394-412f-ad0d-15dfa9b027a1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:39.628680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d439270-5394-412f-ad0d-15dfa9b027a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:39.630428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d439270-5394-412f-ad0d-15dfa9b027a1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:39.636119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 400/821] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:20:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:39.641564 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d439270-5394-412f-ad0d-15dfa9b027a1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:39.645990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06745115-1bfa-4ee0-82e0-9efb5206a9fc None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:39.681745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d967958-7b09-4906-b669-8a4f28e0dd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:39.682374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d967958-7b09-4906-b669-8a4f28e0dd07 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:39.682659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d967958-7b09-4906-b669-8a4f28e0dd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:39.682932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d967958-7b09-4906-b669-8a4f28e0dd07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:39.694424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d967958-7b09-4906-b669-8a4f28e0dd07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:39.695999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d967958-7b09-4906-b669-8a4f28e0dd07 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-0d967958-7b09-4906-b669-8a4f28e0dd07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:39.712347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:39.713347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:39.714327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:39.714327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:39.714327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:39.714327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 422/822] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:39.714972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d967958-7b09-4906-b669-8a4f28e0dd07 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:39.753751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d439270-5394-412f-ad0d-15dfa9b027a1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:39.785696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:39.792736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52497ab2-4108-462d-b3fe-513daea36f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:39.793636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497ab2-4108-462d-b3fe-513daea36f75 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:39.794121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497ab2-4108-462d-b3fe-513daea36f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:39.794578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497ab2-4108-462d-b3fe-513daea36f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:39.806109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52497ab2-4108-462d-b3fe-513daea36f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:39.807898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52497ab2-4108-462d-b3fe-513daea36f75 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-52497ab2-4108-462d-b3fe-513daea36f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:39.823446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:39.824372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:39.825244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:39.825244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:39.825244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:39.826559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:39.828594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 401/823] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:39.829602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52497ab2-4108-462d-b3fe-513daea36f75 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:39.837793 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d967958-7b09-4906-b669-8a4f28e0dd07 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:39.881973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055adc0-8e50-4f10-b39a-1e905a807fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:39.883382 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055adc0-8e50-4f10-b39a-1e905a807fb1 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:39.883904 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055adc0-8e50-4f10-b39a-1e905a807fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:39.884340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055adc0-8e50-4f10-b39a-1e905a807fb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:39.885396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055adc0-8e50-4f10-b39a-1e905a807fb1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:39.887662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055adc0-8e50-4f10-b39a-1e905a807fb1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:39.918738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 423/824] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:20:39 2022] POST /identity/v3/endpoints => generated 337 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:39.919818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055adc0-8e50-4f10-b39a-1e905a807fb1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:39.954658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52497ab2-4108-462d-b3fe-513daea36f75 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:40.013953 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884f7f5-e18d-444c-b3e2-2968d90226ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:40.015029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884f7f5-e18d-444c-b3e2-2968d90226ac None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.015634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884f7f5-e18d-444c-b3e2-2968d90226ac None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.016135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884f7f5-e18d-444c-b3e2-2968d90226ac None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.017009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884f7f5-e18d-444c-b3e2-2968d90226ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:40.017511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884f7f5-e18d-444c-b3e2-2968d90226ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:40.019393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884f7f5-e18d-444c-b3e2-2968d90226ac None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:40.034438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 402/825] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:40.036131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36dd25-48fd-44ea-a6ea-a19a73f22d63 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.036615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36dd25-48fd-44ea-a6ea-a19a73f22d63 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.037079 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36dd25-48fd-44ea-a6ea-a19a73f22d63 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.037389 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055adc0-8e50-4f10-b39a-1e905a807fb1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:40.039203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 403/826] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:40.040199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36dd25-48fd-44ea-a6ea-a19a73f22d63 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:40.089331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44753483-190a-4661-81f5-01a22f77eedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:40.090311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753483-190a-4661-81f5-01a22f77eedb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.090806 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753483-190a-4661-81f5-01a22f77eedb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.091486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753483-190a-4661-81f5-01a22f77eedb None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.093223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44753483-190a-4661-81f5-01a22f77eedb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:40.093731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44753483-190a-4661-81f5-01a22f77eedb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:40.095421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44753483-190a-4661-81f5-01a22f77eedb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:40.098658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:40.113809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 424/827] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:40.118890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2cc4b-9b60-4e3f-8a81-081970c9b2a4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.118890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2cc4b-9b60-4e3f-8a81-081970c9b2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.118890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2cc4b-9b60-4e3f-8a81-081970c9b2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.141269 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-95d2cc4b-9b60-4e3f-8a81-081970c9b2a4 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:40.142395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-95d2cc4b-9b60-4e3f-8a81-081970c9b2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:40.147043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:40.183368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36dd25-48fd-44ea-a6ea-a19a73f22d63 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:40.219913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 425/828] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:40.221751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2cc4b-9b60-4e3f-8a81-081970c9b2a4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:40.232083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88621ca5-e4be-4fb2-8fd5-88973b7c078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:40.232722 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88621ca5-e4be-4fb2-8fd5-88973b7c078f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.233001 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88621ca5-e4be-4fb2-8fd5-88973b7c078f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.233277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88621ca5-e4be-4fb2-8fd5-88973b7c078f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.243192 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88621ca5-e4be-4fb2-8fd5-88973b7c078f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:40.245032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88621ca5-e4be-4fb2-8fd5-88973b7c078f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-88621ca5-e4be-4fb2-8fd5-88973b7c078f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:40.257810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:40.258923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:40.260172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:40.260172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:40.260172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:40.260172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:40.260172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:40.260172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:40.260172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:40.260172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:40.260172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 404/829] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:40.260172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88621ca5-e4be-4fb2-8fd5-88973b7c078f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:40.338405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2cc4b-9b60-4e3f-8a81-081970c9b2a4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:40.375404 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:40.380141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8540c-bac0-4f6c-a8a5-cc48d5f366e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:40.380550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88621ca5-e4be-4fb2-8fd5-88973b7c078f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:40.380779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8540c-bac0-4f6c-a8a5-cc48d5f366e7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.381051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8540c-bac0-4f6c-a8a5-cc48d5f366e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.381318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8540c-bac0-4f6c-a8a5-cc48d5f366e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.388170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8540c-bac0-4f6c-a8a5-cc48d5f366e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:40.389597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8540c-bac0-4f6c-a8a5-cc48d5f366e7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:40.392476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-39e8540c-bac0-4f6c-a8a5-cc48d5f366e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:40.402575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:40.403663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:40.404707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:40.404707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:40.404707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:40.404707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:40.404707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:40.404707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:40.404707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:40.404707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:40.404707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 426/830] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:40.404707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8540c-bac0-4f6c-a8a5-cc48d5f366e7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:40.425234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1409da-95eb-4ef1-a40f-c77dae70888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:40.425857 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1409da-95eb-4ef1-a40f-c77dae70888e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.426135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1409da-95eb-4ef1-a40f-c77dae70888e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.426411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1409da-95eb-4ef1-a40f-c77dae70888e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.436891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1409da-95eb-4ef1-a40f-c77dae70888e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2f1409da-95eb-4ef1-a40f-c77dae70888e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:40.442575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:40.443548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:40.444398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 405/831] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:20:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:40.445084 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1409da-95eb-4ef1-a40f-c77dae70888e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:40.518151 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8540c-bac0-4f6c-a8a5-cc48d5f366e7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:40.548751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1409da-95eb-4ef1-a40f-c77dae70888e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:40.551611 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a50c7-da70-41c0-9cfe-f79639c2c804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:40.552210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a50c7-da70-41c0-9cfe-f79639c2c804 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.552488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a50c7-da70-41c0-9cfe-f79639c2c804 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.552765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a50c7-da70-41c0-9cfe-f79639c2c804 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.553446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a50c7-da70-41c0-9cfe-f79639c2c804 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:40.553860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a50c7-da70-41c0-9cfe-f79639c2c804 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:40.555299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a50c7-da70-41c0-9cfe-f79639c2c804 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:40.567030 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 427/832] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:40.567832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a50c7-da70-41c0-9cfe-f79639c2c804 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:40.585832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a80b1c-7ef8-4598-9b73-a7568a8387ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:40.586421 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80b1c-7ef8-4598-9b73-a7568a8387ba None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.586691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80b1c-7ef8-4598-9b73-a7568a8387ba None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.586954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80b1c-7ef8-4598-9b73-a7568a8387ba None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.587660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a80b1c-7ef8-4598-9b73-a7568a8387ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:40.587954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a80b1c-7ef8-4598-9b73-a7568a8387ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:40.589351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a80b1c-7ef8-4598-9b73-a7568a8387ba None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:40.601829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 406/833] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:40.603119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dab21-7702-4e15-ba01-3e10e1aced4c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.603404 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dab21-7702-4e15-ba01-3e10e1aced4c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.603674 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dab21-7702-4e15-ba01-3e10e1aced4c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.605035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 407/834] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:40.605595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dab21-7702-4e15-ba01-3e10e1aced4c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:40.624220 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:40.627795 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:40.668892 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a50c7-da70-41c0-9cfe-f79639c2c804 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:40.703860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2016f3-29dd-40de-9e52-259b8e64659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:40.704450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2016f3-29dd-40de-9e52-259b8e64659b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.704725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2016f3-29dd-40de-9e52-259b8e64659b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.704990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2016f3-29dd-40de-9e52-259b8e64659b None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.705668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2016f3-29dd-40de-9e52-259b8e64659b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:40.705895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dab21-7702-4e15-ba01-3e10e1aced4c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:40.705994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2016f3-29dd-40de-9e52-259b8e64659b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:40.707315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2016f3-29dd-40de-9e52-259b8e64659b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:40.715523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 428/835] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:40.716125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2016f3-29dd-40de-9e52-259b8e64659b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:40.747807 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d959a6-c57e-4b72-a4e2-31eb04bf83cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:40.748511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d959a6-c57e-4b72-a4e2-31eb04bf83cf None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.748823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d959a6-c57e-4b72-a4e2-31eb04bf83cf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.749122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d959a6-c57e-4b72-a4e2-31eb04bf83cf None admin] PATH_INFO: `/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/e44d9ab25b1444ed973079d988813b23/roles/e2ec52fbc4a74d6086f0649d8cb3f51e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.764948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d959a6-c57e-4b72-a4e2-31eb04bf83cf None admin] RBAC: Authorizing `identity:create_grant(project_id=6c5638056cea4e5397c6a25d434e5324, user_id=e44d9ab25b1444ed973079d988813b23, role_id=e2ec52fbc4a74d6086f0649d8cb3f51e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:40.766382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d959a6-c57e-4b72-a4e2-31eb04bf83cf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:40.778834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 408/836] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:20:40 2022] PUT /identity/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/e44d9ab25b1444ed973079d988813b23/roles/e2ec52fbc4a74d6086f0649d8cb3f51e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:20:40.780053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2071fd-7616-4870-9500-1bd91575d66b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.780336 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2071fd-7616-4870-9500-1bd91575d66b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.780710 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2071fd-7616-4870-9500-1bd91575d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.802568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2c2071fd-7616-4870-9500-1bd91575d66b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:40.803830 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2c2071fd-7616-4870-9500-1bd91575d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:40.823219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2016f3-29dd-40de-9e52-259b8e64659b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:40.861412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed7133-e6bf-4a6e-b4c5-4788e7670bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:40.862689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed7133-e6bf-4a6e-b4c5-4788e7670bcb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:40.863045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed7133-e6bf-4a6e-b4c5-4788e7670bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:40.863191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed7133-e6bf-4a6e-b4c5-4788e7670bcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:40.863919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed7133-e6bf-4a6e-b4c5-4788e7670bcb None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=cc8bf701e94c403ab70fcffaeb81b65b) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:40.864219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed7133-e6bf-4a6e-b4c5-4788e7670bcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:40.865691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed7133-e6bf-4a6e-b4c5-4788e7670bcb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:40.872368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 429/837] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:40 2022] GET /identity/v3/role_assignments?user.id=cc8bf701e94c403ab70fcffaeb81b65b&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:40.873057 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed7133-e6bf-4a6e-b4c5-4788e7670bcb None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:40.880670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:40.899121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 409/838] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:40.903798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:40.914804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2071fd-7616-4870-9500-1bd91575d66b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:41.013196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed7133-e6bf-4a6e-b4c5-4788e7670bcb None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:41.064417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2071fd-7616-4870-9500-1bd91575d66b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:41.064856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424f2f8-9f53-464e-8793-94cafb71d91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:41.066191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424f2f8-9f53-464e-8793-94cafb71d91c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:41.066847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424f2f8-9f53-464e-8793-94cafb71d91c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:41.067368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424f2f8-9f53-464e-8793-94cafb71d91c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:41.082922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424f2f8-9f53-464e-8793-94cafb71d91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:41.084528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424f2f8-9f53-464e-8793-94cafb71d91c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d424f2f8-9f53-464e-8793-94cafb71d91c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:41.100127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:41.101325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:41.102435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:41.102435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:41.102435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:41.107323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 430/839] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:41.108990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424f2f8-9f53-464e-8793-94cafb71d91c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:41.117459 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aff029-8e7b-467d-b5e5-0273441d1a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:41.118132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aff029-8e7b-467d-b5e5-0273441d1a89 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:41.118382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aff029-8e7b-467d-b5e5-0273441d1a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:41.118657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aff029-8e7b-467d-b5e5-0273441d1a89 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:41.119696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aff029-8e7b-467d-b5e5-0273441d1a89 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:41.121446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aff029-8e7b-467d-b5e5-0273441d1a89 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a9aff029-8e7b-467d-b5e5-0273441d1a89 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:41.133848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:41.135151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 22:20:41.136254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:41.137267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 410/840] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:20:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:41.143886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aff029-8e7b-467d-b5e5-0273441d1a89 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:41.166952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:41.225966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:41.259441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424f2f8-9f53-464e-8793-94cafb71d91c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:41.271920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aff029-8e7b-467d-b5e5-0273441d1a89 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:41.298089 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deb57f-4861-4112-a3e8-5f828c49d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:41.298856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deb57f-4861-4112-a3e8-5f828c49d03a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:41.299922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deb57f-4861-4112-a3e8-5f828c49d03a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:41.300286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deb57f-4861-4112-a3e8-5f828c49d03a None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:41.301070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deb57f-4861-4112-a3e8-5f828c49d03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:41.301456 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deb57f-4861-4112-a3e8-5f828c49d03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:41.302939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deb57f-4861-4112-a3e8-5f828c49d03a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:41.316125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbbefb-b98b-4663-a50f-c813410e6cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:41.316342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 431/841] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:41.316729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbbefb-b98b-4663-a50f-c813410e6cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:41.317008 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbbefb-b98b-4663-a50f-c813410e6cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:41.317280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbbefb-b98b-4663-a50f-c813410e6cb3 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:41.317917 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbbefb-b98b-4663-a50f-c813410e6cb3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:41.318220 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbbefb-b98b-4663-a50f-c813410e6cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:41.323218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbbefb-b98b-4663-a50f-c813410e6cb3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:41.323340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deb57f-4861-4112-a3e8-5f828c49d03a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:41.325759 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 411/842] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:20:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:41.330298 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbbefb-b98b-4663-a50f-c813410e6cb3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:41.437076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbbefb-b98b-4663-a50f-c813410e6cb3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:41.443423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:41.445733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deb57f-4861-4112-a3e8-5f828c49d03a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:41.465166 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:41.476745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87074aa0-c575-4d21-996e-02247f1808c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:41.477499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87074aa0-c575-4d21-996e-02247f1808c8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:41.477880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87074aa0-c575-4d21-996e-02247f1808c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:41.478242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87074aa0-c575-4d21-996e-02247f1808c8 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:41.478975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87074aa0-c575-4d21-996e-02247f1808c8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:41.479519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87074aa0-c575-4d21-996e-02247f1808c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:41.481074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87074aa0-c575-4d21-996e-02247f1808c8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:41.491210 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 412/843] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:20:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:41.494050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ac7d2-2052-4a17-bdd2-8c23bd922661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:41.494820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ac7d2-2052-4a17-bdd2-8c23bd922661 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:41.495237 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ac7d2-2052-4a17-bdd2-8c23bd922661 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:41.495610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ac7d2-2052-4a17-bdd2-8c23bd922661 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:41.504602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ac7d2-2052-4a17-bdd2-8c23bd922661 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:41.506250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ac7d2-2052-4a17-bdd2-8c23bd922661 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-8f4ac7d2-2052-4a17-bdd2-8c23bd922661 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:41.519645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:41.520840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:41.522001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:41.522001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:41.522001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:41.522001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:41.522001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:41.522001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:41.522001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:41.522001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:41.522001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 22:20:41.522001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:41.527113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 432/844] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:20:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:41.529681 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87074aa0-c575-4d21-996e-02247f1808c8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:41.642543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87074aa0-c575-4d21-996e-02247f1808c8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:41.677859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a669fd-cdbd-4acc-86f7-da027d5d29b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:41.678471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a669fd-cdbd-4acc-86f7-da027d5d29b7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:41.678748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a669fd-cdbd-4acc-86f7-da027d5d29b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:41.679017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a669fd-cdbd-4acc-86f7-da027d5d29b7 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:41.679793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a669fd-cdbd-4acc-86f7-da027d5d29b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:41.680098 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a669fd-cdbd-4acc-86f7-da027d5d29b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:41.681603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a669fd-cdbd-4acc-86f7-da027d5d29b7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:41.700751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 413/845] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Aug 7 22:20:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:41.707831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ac7d2-2052-4a17-bdd2-8c23bd922661 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:41.810979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ac7d2-2052-4a17-bdd2-8c23bd922661 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:41.845307 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56986ed-f638-47c0-91f1-d56b0045785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:41.845910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56986ed-f638-47c0-91f1-d56b0045785c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:41.846767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56986ed-f638-47c0-91f1-d56b0045785c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:41.847039 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56986ed-f638-47c0-91f1-d56b0045785c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:41.874072 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:41.916948 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56986ed-f638-47c0-91f1-d56b0045785c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:41.918392 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56986ed-f638-47c0-91f1-d56b0045785c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:42.024581 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 433/846] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 22:20:42.029962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a669fd-cdbd-4acc-86f7-da027d5d29b7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:42.090555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:42.151547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a669fd-cdbd-4acc-86f7-da027d5d29b7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:42.187560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e9bac-ffae-4918-b58e-f47181afebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:42.188183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e9bac-ffae-4918-b58e-f47181afebd2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:42.188457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e9bac-ffae-4918-b58e-f47181afebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:42.188780 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e9bac-ffae-4918-b58e-f47181afebd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:42.199363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e9bac-ffae-4918-b58e-f47181afebd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:42.200795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e9bac-ffae-4918-b58e-f47181afebd2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1f7e9bac-ffae-4918-b58e-f47181afebd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:42.216049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:42.217021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:42.217901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:42.217901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:42.217901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:42.217901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 414/847] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:42.224169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56986ed-f638-47c0-91f1-d56b0045785c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:42.287465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:42.328175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56986ed-f638-47c0-91f1-d56b0045785c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:42.362688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d043384-73f5-40e3-b10b-d069e60afd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:42.363388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d043384-73f5-40e3-b10b-d069e60afd49 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:42.363672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d043384-73f5-40e3-b10b-d069e60afd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:42.363944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d043384-73f5-40e3-b10b-d069e60afd49 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:42.364585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d043384-73f5-40e3-b10b-d069e60afd49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:42.364887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d043384-73f5-40e3-b10b-d069e60afd49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:42.366233 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d043384-73f5-40e3-b10b-d069e60afd49 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:42.378655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 434/848] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:42.384183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e9bac-ffae-4918-b58e-f47181afebd2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:42.496790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:42.500432 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e9bac-ffae-4918-b58e-f47181afebd2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:42.539930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ba9e-b299-471e-a02f-294fcfeb3d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:42.540554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ba9e-b299-471e-a02f-294fcfeb3d38 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:42.540825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ba9e-b299-471e-a02f-294fcfeb3d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:42.541089 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ba9e-b299-471e-a02f-294fcfeb3d38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:42.547993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ba9e-b299-471e-a02f-294fcfeb3d38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:42.549991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ba9e-b299-471e-a02f-294fcfeb3d38 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-78b7ba9e-b299-471e-a02f-294fcfeb3d38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:42.561248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:42.562147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:42.563026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:42.563026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:42.563026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:42.563026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:42.563026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:42.563026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:42.563026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:42.563026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:42.563026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 415/849] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:42.570377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d043384-73f5-40e3-b10b-d069e60afd49 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:42.676407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d043384-73f5-40e3-b10b-d069e60afd49 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:42.694635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:42.714640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b862b-7d81-463e-9b7a-2544e7032cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:42.715283 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b862b-7d81-463e-9b7a-2544e7032cbb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:42.715558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b862b-7d81-463e-9b7a-2544e7032cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:42.716525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b862b-7d81-463e-9b7a-2544e7032cbb None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:42.717241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b862b-7d81-463e-9b7a-2544e7032cbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:42.717545 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b862b-7d81-463e-9b7a-2544e7032cbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:42.719148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b862b-7d81-463e-9b7a-2544e7032cbb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:42.733837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 435/850] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:42.740286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ba9e-b299-471e-a02f-294fcfeb3d38 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:42.840588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990ebfa-7b0d-429f-baa5-41994f195e51 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:42.840920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990ebfa-7b0d-429f-baa5-41994f195e51 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:42.841122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990ebfa-7b0d-429f-baa5-41994f195e51 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:42.842562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 436/851] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:42.848339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375ce3e-c620-4b10-9e6f-afec5a35842b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:42.848885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375ce3e-c620-4b10-9e6f-afec5a35842b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:42.849362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375ce3e-c620-4b10-9e6f-afec5a35842b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:42.853654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ba9e-b299-471e-a02f-294fcfeb3d38 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:42.867946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e375ce3e-c620-4b10-9e6f-afec5a35842b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:42.869437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e375ce3e-c620-4b10-9e6f-afec5a35842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:42.897480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839af28-8835-4c6b-a9e0-3cdb07732da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:42.898080 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839af28-8835-4c6b-a9e0-3cdb07732da6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:42.898351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839af28-8835-4c6b-a9e0-3cdb07732da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:42.898617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839af28-8835-4c6b-a9e0-3cdb07732da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:42.899545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839af28-8835-4c6b-a9e0-3cdb07732da6 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=c30e49a1967e48c9b45f56454ffc1297) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:42.899854 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839af28-8835-4c6b-a9e0-3cdb07732da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:42.901281 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839af28-8835-4c6b-a9e0-3cdb07732da6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:42.909949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 416/852] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:42 2022] GET /identity/v3/role_assignments?user.id=c30e49a1967e48c9b45f56454ffc1297&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:42.963449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 437/853] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:20:42.980798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839af28-8835-4c6b-a9e0-3cdb07732da6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:43.022667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:43.106215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839af28-8835-4c6b-a9e0-3cdb07732da6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:43.141304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e143cc0-8645-4f02-9418-1bdb5d8126c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:43.141920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e143cc0-8645-4f02-9418-1bdb5d8126c0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:43.142190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e143cc0-8645-4f02-9418-1bdb5d8126c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:43.142456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e143cc0-8645-4f02-9418-1bdb5d8126c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:43.153442 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e143cc0-8645-4f02-9418-1bdb5d8126c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4e143cc0-8645-4f02-9418-1bdb5d8126c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:43.159381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:43.160283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:43.161115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:43.161115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:43.161115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:43.161115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:43.161115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:43.161115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:43.161115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:43.161115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:43.161115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:43.161115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:43.161115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:20:43.161115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:43.162736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 417/854] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:20:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:43.168909 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375ce3e-c620-4b10-9e6f-afec5a35842b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:43.203120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2c940-a67f-43bd-bf6e-ba2616ef25cf None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:43.203120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2c940-a67f-43bd-bf6e-ba2616ef25cf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:43.203120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2c940-a67f-43bd-bf6e-ba2616ef25cf None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:43.203831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 418/855] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:20:43.211189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ca9d-5eec-4b3a-a5e0-0aa9e3ea1591 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:43.211478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ca9d-5eec-4b3a-a5e0-0aa9e3ea1591 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:43.211750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ca9d-5eec-4b3a-a5e0-0aa9e3ea1591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:43.230946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-08b1ca9d-5eec-4b3a-a5e0-0aa9e3ea1591 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:43.232096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-08b1ca9d-5eec-4b3a-a5e0-0aa9e3ea1591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:43.279375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375ce3e-c620-4b10-9e6f-afec5a35842b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:43.291510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:43.316328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06493480-3792-4bd5-a519-0c3acd03d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:43.317313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06493480-3792-4bd5-a519-0c3acd03d67d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:43.317897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06493480-3792-4bd5-a519-0c3acd03d67d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:43.318400 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06493480-3792-4bd5-a519-0c3acd03d67d None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:43.319346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06493480-3792-4bd5-a519-0c3acd03d67d None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:43.319853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06493480-3792-4bd5-a519-0c3acd03d67d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:43.321421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06493480-3792-4bd5-a519-0c3acd03d67d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:43.330119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 419/856] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:20:43.337654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 438/857] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:20:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:43.344172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1ca9d-5eec-4b3a-a5e0-0aa9e3ea1591 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:43.346754 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06493480-3792-4bd5-a519-0c3acd03d67d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:43.363435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:43.454466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1ca9d-5eec-4b3a-a5e0-0aa9e3ea1591 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:43.485162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06493480-3792-4bd5-a519-0c3acd03d67d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:43.495924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa915f-d985-40c6-8200-e7645fd3f76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:43.496699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa915f-d985-40c6-8200-e7645fd3f76e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:43.496813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa915f-d985-40c6-8200-e7645fd3f76e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:43.497062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa915f-d985-40c6-8200-e7645fd3f76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:43.508673 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa915f-d985-40c6-8200-e7645fd3f76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:43.510113 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa915f-d985-40c6-8200-e7645fd3f76e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-bdfa915f-d985-40c6-8200-e7645fd3f76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:43.528016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:43.528983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:43.529860 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:43.529860 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:43.529860 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:43.531834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 420/858] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:43.532639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e231d4-748e-4a31-ad3e-5da8cbbe62e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:43.533437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e231d4-748e-4a31-ad3e-5da8cbbe62e1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:43.534373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e231d4-748e-4a31-ad3e-5da8cbbe62e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:43.534772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e231d4-748e-4a31-ad3e-5da8cbbe62e1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:43.535519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e231d4-748e-4a31-ad3e-5da8cbbe62e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:43.537900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa915f-d985-40c6-8200-e7645fd3f76e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:43.538303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e231d4-748e-4a31-ad3e-5da8cbbe62e1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a5e231d4-748e-4a31-ad3e-5da8cbbe62e1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:43.550766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:43.551789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 22:20:43.553062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:43.557217 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 439/859] 10.222.0.15 () {56 vars in 1132 bytes} [Sun Aug 7 22:20:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:43.558323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e231d4-748e-4a31-ad3e-5da8cbbe62e1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:43.605462 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:43.615697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:43.656629 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa915f-d985-40c6-8200-e7645fd3f76e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:43.683300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e231d4-748e-4a31-ad3e-5da8cbbe62e1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:43.693330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51067e59-e64e-4246-9728-9d529f7151d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:43.694229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51067e59-e64e-4246-9728-9d529f7151d0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:43.694702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51067e59-e64e-4246-9728-9d529f7151d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:43.695199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51067e59-e64e-4246-9728-9d529f7151d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:43.696181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51067e59-e64e-4246-9728-9d529f7151d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:43.696697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51067e59-e64e-4246-9728-9d529f7151d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:43.698275 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51067e59-e64e-4246-9728-9d529f7151d0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:43.716242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 421/860] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:43.716693 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e80ae-81be-4685-9d72-cec58449a4d7 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:43.716828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e80ae-81be-4685-9d72-cec58449a4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:43.717317 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e80ae-81be-4685-9d72-cec58449a4d7 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:43.719183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 422/861] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:43.719346 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e80ae-81be-4685-9d72-cec58449a4d7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:43.720172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bf119-b9a9-4c5b-b7c8-c20f06b7b62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:43.720804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bf119-b9a9-4c5b-b7c8-c20f06b7b62c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:43.721111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bf119-b9a9-4c5b-b7c8-c20f06b7b62c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:43.721579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bf119-b9a9-4c5b-b7c8-c20f06b7b62c None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:43.722678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bf119-b9a9-4c5b-b7c8-c20f06b7b62c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:43.723246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bf119-b9a9-4c5b-b7c8-c20f06b7b62c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:43.725800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bf119-b9a9-4c5b-b7c8-c20f06b7b62c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:43.731011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 440/862] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 22:20:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:43.732252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051d924-7f4d-45a2-8e76-dd5b3c0c356d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:43.732377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051d924-7f4d-45a2-8e76-dd5b3c0c356d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:43.734992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051d924-7f4d-45a2-8e76-dd5b3c0c356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:43.753405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3051d924-7f4d-45a2-8e76-dd5b3c0c356d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:43.754500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3051d924-7f4d-45a2-8e76-dd5b3c0c356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:43.829177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 441/863] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:43.830015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051d924-7f4d-45a2-8e76-dd5b3c0c356d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:43.862486 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e80ae-81be-4685-9d72-cec58449a4d7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:43.869882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:43.891800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:43.901493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747ebe3-fbb4-4459-af8c-0770eed2cec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:43.902120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747ebe3-fbb4-4459-af8c-0770eed2cec3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:43.902397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747ebe3-fbb4-4459-af8c-0770eed2cec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:43.902694 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747ebe3-fbb4-4459-af8c-0770eed2cec3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:43.910269 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747ebe3-fbb4-4459-af8c-0770eed2cec3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:43.911749 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747ebe3-fbb4-4459-af8c-0770eed2cec3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-c747ebe3-fbb4-4459-af8c-0770eed2cec3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:43.923811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:43.924791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:43.925697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:43.925697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:43.925697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:43.925697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:43.925697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:43.925697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:43.925697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:43.925697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:43.925697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 22:20:43.925697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:43.925697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 423/864] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 22:20:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:43.926849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747ebe3-fbb4-4459-af8c-0770eed2cec3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:43.956192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051d924-7f4d-45a2-8e76-dd5b3c0c356d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:43.996907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dc68e-595e-41a6-a3fc-abaa5d4eeea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:43.998137 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dc68e-595e-41a6-a3fc-abaa5d4eeea2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:43.998576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dc68e-595e-41a6-a3fc-abaa5d4eeea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:43.998983 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dc68e-595e-41a6-a3fc-abaa5d4eeea2 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:43.999772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dc68e-595e-41a6-a3fc-abaa5d4eeea2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:44.000226 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dc68e-595e-41a6-a3fc-abaa5d4eeea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:44.001956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dc68e-595e-41a6-a3fc-abaa5d4eeea2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:44.011493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 442/865] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 22:20:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:44.019207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dc68e-595e-41a6-a3fc-abaa5d4eeea2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:44.046702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747ebe3-fbb4-4459-af8c-0770eed2cec3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:44.098343 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2053170-0dc8-481b-b795-4469f76f627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:44.098973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2053170-0dc8-481b-b795-4469f76f627f None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:44.099606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2053170-0dc8-481b-b795-4469f76f627f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:44.099885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2053170-0dc8-481b-b795-4469f76f627f None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:44.101029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2053170-0dc8-481b-b795-4469f76f627f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:44.102480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2053170-0dc8-481b-b795-4469f76f627f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:44.135139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 424/866] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:20:43 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:44.166451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:44.178260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dc68e-595e-41a6-a3fc-abaa5d4eeea2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:44.225938 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e326-2904-4f5c-a0a4-62a8e420de4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:44.226553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e326-2904-4f5c-a0a4-62a8e420de4d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:44.226824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e326-2904-4f5c-a0a4-62a8e420de4d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:44.227130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e326-2904-4f5c-a0a4-62a8e420de4d None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:44.227848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156e326-2904-4f5c-a0a4-62a8e420de4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:44.228149 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156e326-2904-4f5c-a0a4-62a8e420de4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:44.229605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156e326-2904-4f5c-a0a4-62a8e420de4d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:44.249797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 443/867] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Aug 7 22:20:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:44.255990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2053170-0dc8-481b-b795-4469f76f627f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:44.314217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:44.375690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2053170-0dc8-481b-b795-4469f76f627f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:44.414205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69fe20-bb39-413b-8ab7-1d30dbaa0f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:44.415142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69fe20-bb39-413b-8ab7-1d30dbaa0f4f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:44.415605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69fe20-bb39-413b-8ab7-1d30dbaa0f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:44.416085 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69fe20-bb39-413b-8ab7-1d30dbaa0f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:44.500605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69fe20-bb39-413b-8ab7-1d30dbaa0f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:44.503419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69fe20-bb39-413b-8ab7-1d30dbaa0f4f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:44.560263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:44.618267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 425/868] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:44 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:20:44.624175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e326-2904-4f5c-a0a4-62a8e420de4d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:44.726979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e326-2904-4f5c-a0a4-62a8e420de4d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:44.761273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83029cf-e273-44e2-b11e-6473802dda98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:44.761893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83029cf-e273-44e2-b11e-6473802dda98 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:44.762165 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83029cf-e273-44e2-b11e-6473802dda98 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:44.762430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83029cf-e273-44e2-b11e-6473802dda98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:44.773040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83029cf-e273-44e2-b11e-6473802dda98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:44.774450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83029cf-e273-44e2-b11e-6473802dda98 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:44.781754 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a83029cf-e273-44e2-b11e-6473802dda98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:44.791112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:44.792077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:44.792958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:44.792958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:44.792958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:44.792958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 444/869] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:44.799329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69fe20-bb39-413b-8ab7-1d30dbaa0f4f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:44.906948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69fe20-bb39-413b-8ab7-1d30dbaa0f4f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:44.943578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca4af8-265b-4cec-bb00-1e6d28705b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:44.944558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca4af8-265b-4cec-bb00-1e6d28705b06 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:44.945042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca4af8-265b-4cec-bb00-1e6d28705b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:44.945513 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca4af8-265b-4cec-bb00-1e6d28705b06 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:44.946411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca4af8-265b-4cec-bb00-1e6d28705b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:44.946913 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca4af8-265b-4cec-bb00-1e6d28705b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:44.948507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca4af8-265b-4cec-bb00-1e6d28705b06 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:44.960891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 426/870] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:44.966628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83029cf-e273-44e2-b11e-6473802dda98 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:45.060334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c38f3-96f7-47e4-92f4-713049d97c07 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:45.060684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c38f3-96f7-47e4-92f4-713049d97c07 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:45.060875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c38f3-96f7-47e4-92f4-713049d97c07 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:45.062454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 427/871] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:20:45.067285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc62eeb-24d3-47a4-a487-9586ef0ac96f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:45.067568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc62eeb-24d3-47a4-a487-9586ef0ac96f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:45.067841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc62eeb-24d3-47a4-a487-9586ef0ac96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:45.074271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83029cf-e273-44e2-b11e-6473802dda98 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:45.083396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:45.085874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1fc62eeb-24d3-47a4-a487-9586ef0ac96f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:45.087135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1fc62eeb-24d3-47a4-a487-9586ef0ac96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:45.115742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e02c62-5a57-40b2-8d26-3e1390120f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:45.116447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e02c62-5a57-40b2-8d26-3e1390120f86 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:45.116794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e02c62-5a57-40b2-8d26-3e1390120f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:45.117131 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e02c62-5a57-40b2-8d26-3e1390120f86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:45.123992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e02c62-5a57-40b2-8d26-3e1390120f86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:45.125497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e02c62-5a57-40b2-8d26-3e1390120f86 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-c6e02c62-5a57-40b2-8d26-3e1390120f86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:45.137037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:45.137886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:45.138761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:45.138761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:45.138761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:45.138761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:45.138761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:45.138761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:45.138761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:45.138761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:45.138761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 445/872] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:45.144703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e02c62-5a57-40b2-8d26-3e1390120f86 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:45.181057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 428/873] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:45.196689 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc62eeb-24d3-47a4-a487-9586ef0ac96f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:45.222505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:45.274071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e02c62-5a57-40b2-8d26-3e1390120f86 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:45.309663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2ad7-7863-4c49-a244-d41e306c37a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:45.310366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2ad7-7863-4c49-a244-d41e306c37a1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:45.310712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2ad7-7863-4c49-a244-d41e306c37a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:45.311052 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2ad7-7863-4c49-a244-d41e306c37a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:45.311838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2ad7-7863-4c49-a244-d41e306c37a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:45.312327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2ad7-7863-4c49-a244-d41e306c37a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:45.313819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2ad7-7863-4c49-a244-d41e306c37a1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:45.322757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc62eeb-24d3-47a4-a487-9586ef0ac96f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:45.332716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 446/874] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:45.334488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2ad7-7863-4c49-a244-d41e306c37a1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:45.365410 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb1256-5d62-46d8-8219-cd7b43caf79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:45.366037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb1256-5d62-46d8-8219-cd7b43caf79f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:45.366312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb1256-5d62-46d8-8219-cd7b43caf79f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:45.366581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb1256-5d62-46d8-8219-cd7b43caf79f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:45.367283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb1256-5d62-46d8-8219-cd7b43caf79f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:45.368748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb1256-5d62-46d8-8219-cd7b43caf79f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:45.371500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-cddb1256-5d62-46d8-8219-cd7b43caf79f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:45.381226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:45.382233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:45.383066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:45.388248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 429/875] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 22:20:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:45.389527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb1256-5d62-46d8-8219-cd7b43caf79f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:45.451140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2ad7-7863-4c49-a244-d41e306c37a1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:45.469679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:45.488586 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b169dd2-6f72-45ae-9d6a-e1fe83e007a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:45.488586 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b169dd2-6f72-45ae-9d6a-e1fe83e007a7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:45.488860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b169dd2-6f72-45ae-9d6a-e1fe83e007a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:45.489117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b169dd2-6f72-45ae-9d6a-e1fe83e007a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:45.489821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b169dd2-6f72-45ae-9d6a-e1fe83e007a7 None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=e44d9ab25b1444ed973079d988813b23) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:45.490122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b169dd2-6f72-45ae-9d6a-e1fe83e007a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:45.491556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b169dd2-6f72-45ae-9d6a-e1fe83e007a7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:45.497889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 447/876] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:45 2022] GET /identity/v3/role_assignments?user.id=e44d9ab25b1444ed973079d988813b23&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:45.525098 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb1256-5d62-46d8-8219-cd7b43caf79f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:45.564148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce9e99-0ba5-4252-a389-5cd42d5fc794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:45.565608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce9e99-0ba5-4252-a389-5cd42d5fc794 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:45.566030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce9e99-0ba5-4252-a389-5cd42d5fc794 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:45.566451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce9e99-0ba5-4252-a389-5cd42d5fc794 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:45.567272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce9e99-0ba5-4252-a389-5cd42d5fc794 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:45.567719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce9e99-0ba5-4252-a389-5cd42d5fc794 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:45.569280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce9e99-0ba5-4252-a389-5cd42d5fc794 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:45.575147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 430/877] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 22:20:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:45.581872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b169dd2-6f72-45ae-9d6a-e1fe83e007a7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:45.692220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b169dd2-6f72-45ae-9d6a-e1fe83e007a7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:45.728618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00587ea4-c52b-47ca-b654-96bd7ee374c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:45.729148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00587ea4-c52b-47ca-b654-96bd7ee374c3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:45.729423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00587ea4-c52b-47ca-b654-96bd7ee374c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:45.729695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00587ea4-c52b-47ca-b654-96bd7ee374c3 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:45.730321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00587ea4-c52b-47ca-b654-96bd7ee374c3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:45.730624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00587ea4-c52b-47ca-b654-96bd7ee374c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:45.732021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00587ea4-c52b-47ca-b654-96bd7ee374c3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:45.737315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 448/878] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 22:20:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:46.183750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7d869-81b8-456a-b7ab-3da476f22c60 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:46.184260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7d869-81b8-456a-b7ab-3da476f22c60 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:46.184260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7d869-81b8-456a-b7ab-3da476f22c60 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:46.185879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 431/879] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:46.191074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fc994-e97f-4f38-b4e1-7b7e165e34f1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:46.191535 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fc994-e97f-4f38-b4e1-7b7e165e34f1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:46.191616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fc994-e97f-4f38-b4e1-7b7e165e34f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:46.213068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f70fc994-e97f-4f38-b4e1-7b7e165e34f1 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:46.214252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f70fc994-e97f-4f38-b4e1-7b7e165e34f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:46.245873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27709e6a-ce2d-457b-8ad7-d4b698a43618 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:46.246118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27709e6a-ce2d-457b-8ad7-d4b698a43618 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:46.246359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27709e6a-ce2d-457b-8ad7-d4b698a43618 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:46.247804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 432/880] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:46.253442 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba5df5-3ad6-456f-804c-ab284b9d800c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:46.253722 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba5df5-3ad6-456f-804c-ab284b9d800c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:46.253990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba5df5-3ad6-456f-804c-ab284b9d800c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:46.260991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:46.274115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0fba5df5-3ad6-456f-804c-ab284b9d800c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:46.275337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0fba5df5-3ad6-456f-804c-ab284b9d800c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:46.291481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 449/881] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:46.314704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fc994-e97f-4f38-b4e1-7b7e165e34f1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:46.363659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:46.373899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 433/882] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:46.398171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba5df5-3ad6-456f-804c-ab284b9d800c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:46.421179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fc994-e97f-4f38-b4e1-7b7e165e34f1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:46.455956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ad6c6-2bc3-4cf5-bd2c-0f00bc7f2a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:46.456556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ad6c6-2bc3-4cf5-bd2c-0f00bc7f2a27 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:46.456827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ad6c6-2bc3-4cf5-bd2c-0f00bc7f2a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:46.457088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ad6c6-2bc3-4cf5-bd2c-0f00bc7f2a27 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:46.457722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ad6c6-2bc3-4cf5-bd2c-0f00bc7f2a27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:46.459067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ad6c6-2bc3-4cf5-bd2c-0f00bc7f2a27 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:46.475893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 450/883] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:20:46 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:20:46.510186 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba5df5-3ad6-456f-804c-ab284b9d800c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:46.555765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bce2c5-e655-4c4f-a510-4e8594d9f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:46.556405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bce2c5-e655-4c4f-a510-4e8594d9f11e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:46.556676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bce2c5-e655-4c4f-a510-4e8594d9f11e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:46.556943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bce2c5-e655-4c4f-a510-4e8594d9f11e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:46.557575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bce2c5-e655-4c4f-a510-4e8594d9f11e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:46.558951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bce2c5-e655-4c4f-a510-4e8594d9f11e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-21bce2c5-e655-4c4f-a510-4e8594d9f11e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:46.569549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:46.570580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:46.571452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 434/884] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:20:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:46.577419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ad6c6-2bc3-4cf5-bd2c-0f00bc7f2a27 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:46.617171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:46.694815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ad6c6-2bc3-4cf5-bd2c-0f00bc7f2a27 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:46.739068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5889-dcc0-441a-8783-7e22caadd5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:46.739770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5889-dcc0-441a-8783-7e22caadd5ba None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:46.740045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5889-dcc0-441a-8783-7e22caadd5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:46.740312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5889-dcc0-441a-8783-7e22caadd5ba None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:46.740941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac5889-dcc0-441a-8783-7e22caadd5ba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:46.741236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac5889-dcc0-441a-8783-7e22caadd5ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:46.742657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac5889-dcc0-441a-8783-7e22caadd5ba None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:46.748679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 451/885] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:20:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:46.754183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bce2c5-e655-4c4f-a510-4e8594d9f11e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:46.814517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:46.866465 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bce2c5-e655-4c4f-a510-4e8594d9f11e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:46.903013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b409e-8bf5-4954-877b-280c9b37828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:46.903656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b409e-8bf5-4954-877b-280c9b37828d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:46.904240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b409e-8bf5-4954-877b-280c9b37828d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:46.904506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b409e-8bf5-4954-877b-280c9b37828d None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:46.905143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b409e-8bf5-4954-877b-280c9b37828d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:46.905443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b409e-8bf5-4954-877b-280c9b37828d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:46.906802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b409e-8bf5-4954-877b-280c9b37828d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:46.913285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 435/886] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:20:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:46.918683 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5889-dcc0-441a-8783-7e22caadd5ba None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:47.036951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:47.039755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5889-dcc0-441a-8783-7e22caadd5ba None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:47.075514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451c93f-1daa-4d1d-8a53-8b6b4adbc46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:47.076038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451c93f-1daa-4d1d-8a53-8b6b4adbc46a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:47.076313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451c93f-1daa-4d1d-8a53-8b6b4adbc46a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:47.076582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451c93f-1daa-4d1d-8a53-8b6b4adbc46a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:47.077274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451c93f-1daa-4d1d-8a53-8b6b4adbc46a None admin] RBAC: Adding query filter params (interface=public, service_id=b2cb0e859f8849b38345b7774141b8a7, region_id=RegionOne) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:47.077577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451c93f-1daa-4d1d-8a53-8b6b4adbc46a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:47.078926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451c93f-1daa-4d1d-8a53-8b6b4adbc46a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:47.087125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 452/887] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 22:20:46 2022] GET /identity/v3/endpoints?service_id=b2cb0e859f8849b38345b7774141b8a7&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:47.092165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b409e-8bf5-4954-877b-280c9b37828d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:47.196173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b409e-8bf5-4954-877b-280c9b37828d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:47.213812 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:47.232665 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e58231-392a-471f-b2a4-50705fa8bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:47.233282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58231-392a-471f-b2a4-50705fa8bf52 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:47.233557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58231-392a-471f-b2a4-50705fa8bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:47.233822 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58231-392a-471f-b2a4-50705fa8bf52 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:47.234434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e58231-392a-471f-b2a4-50705fa8bf52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:47.235845 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e58231-392a-471f-b2a4-50705fa8bf52 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:47.242945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 436/888] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 22:20:47 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:20:47.681271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6438d-6571-4029-9684-6dd7cbf2f475 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:47.681788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6438d-6571-4029-9684-6dd7cbf2f475 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:47.681788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6438d-6571-4029-9684-6dd7cbf2f475 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:47.683385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 453/889] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:47.688625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f27aa0-f03f-48b0-82ee-e975bb483e10 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:47.688907 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f27aa0-f03f-48b0-82ee-e975bb483e10 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:47.689172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f27aa0-f03f-48b0-82ee-e975bb483e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:47.710143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c1f27aa0-f03f-48b0-82ee-e975bb483e10 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:47.711904 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c1f27aa0-f03f-48b0-82ee-e975bb483e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:47.782355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 437/890] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:47.806014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6438d-6571-4029-9684-6dd7cbf2f475 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:47.866187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e6d81-dcde-4f1e-81bf-9755554b605f None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:47.866810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e6d81-dcde-4f1e-81bf-9755554b605f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:47.867325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e6d81-dcde-4f1e-81bf-9755554b605f None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:47.869130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 438/891] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:47.874120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ea608-30f6-4749-a5c2-2baa4b89dda3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:47.874631 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ea608-30f6-4749-a5c2-2baa4b89dda3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:47.875144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ea608-30f6-4749-a5c2-2baa4b89dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:47.894405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-156ea608-30f6-4749-a5c2-2baa4b89dda3 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:47.896088 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-156ea608-30f6-4749-a5c2-2baa4b89dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:47.915355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6438d-6571-4029-9684-6dd7cbf2f475 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:47.950734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e71151-9185-41c5-bbf1-0dbd48ba8000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:47.951373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e71151-9185-41c5-bbf1-0dbd48ba8000 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:47.951628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e71151-9185-41c5-bbf1-0dbd48ba8000 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:47.952100 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e71151-9185-41c5-bbf1-0dbd48ba8000 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:47.963771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e71151-9185-41c5-bbf1-0dbd48ba8000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-29e71151-9185-41c5-bbf1-0dbd48ba8000 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:47.968621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:47.969760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:47.970786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:47.970786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:47.970786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:47.970786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:47.970786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:47.970786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:47.970786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:47.970786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:47.970786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:47.970786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:47.970786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 22:20:47.970786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:47.973928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 454/892] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Aug 7 22:20:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:47.975993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 439/893] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:20:47.979852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e71151-9185-41c5-bbf1-0dbd48ba8000 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:47.997881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ea608-30f6-4749-a5c2-2baa4b89dda3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:48.008079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:48.066332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:48.106632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e71151-9185-41c5-bbf1-0dbd48ba8000 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:48.132116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ea608-30f6-4749-a5c2-2baa4b89dda3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:48.150916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b44120-318a-4dca-ac9c-d549a8bd5825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:48.151864 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44120-318a-4dca-ac9c-d549a8bd5825 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:48.152536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44120-318a-4dca-ac9c-d549a8bd5825 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:48.152983 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44120-318a-4dca-ac9c-d549a8bd5825 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:48.154041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b44120-318a-4dca-ac9c-d549a8bd5825 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:48.154504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b44120-318a-4dca-ac9c-d549a8bd5825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:48.158417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b44120-318a-4dca-ac9c-d549a8bd5825 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:48.170909 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 455/894] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 22:20:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:48.175075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53dcf0-1c88-4a4f-9c93-2d7fc42075f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:48.175838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53dcf0-1c88-4a4f-9c93-2d7fc42075f9 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:48.176190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53dcf0-1c88-4a4f-9c93-2d7fc42075f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:48.176551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53dcf0-1c88-4a4f-9c93-2d7fc42075f9 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:48.177204 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b44120-318a-4dca-ac9c-d549a8bd5825 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:48.177333 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53dcf0-1c88-4a4f-9c93-2d7fc42075f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:48.178708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53dcf0-1c88-4a4f-9c93-2d7fc42075f9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:48.203240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 440/895] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:20:47 2022] POST /identity/v3/services => generated 241 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:48.287423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:48.304158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b44120-318a-4dca-ac9c-d549a8bd5825 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:48.351044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e027b-d2ce-4e7d-b4c9-dd008363605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:48.352007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e027b-d2ce-4e7d-b4c9-dd008363605f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:48.352462 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e027b-d2ce-4e7d-b4c9-dd008363605f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:48.352908 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e027b-d2ce-4e7d-b4c9-dd008363605f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:48.365775 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e027b-d2ce-4e7d-b4c9-dd008363605f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:48.367698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e027b-d2ce-4e7d-b4c9-dd008363605f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d87e027b-d2ce-4e7d-b4c9-dd008363605f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:48.385537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:48.386554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:48.387488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:48.387488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:48.387488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:48.389536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 456/896] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:48.396474 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53dcf0-1c88-4a4f-9c93-2d7fc42075f9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:48.507815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53dcf0-1c88-4a4f-9c93-2d7fc42075f9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:48.519358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:48.544683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad62a5-9683-46c3-9f13-016dfd13d04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:48.545288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad62a5-9683-46c3-9f13-016dfd13d04d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:48.545564 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad62a5-9683-46c3-9f13-016dfd13d04d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:48.545831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad62a5-9683-46c3-9f13-016dfd13d04d None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:48.546470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad62a5-9683-46c3-9f13-016dfd13d04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:48.546766 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad62a5-9683-46c3-9f13-016dfd13d04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:48.548159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad62a5-9683-46c3-9f13-016dfd13d04d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:48.565563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 441/897] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:48.571392 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e027b-d2ce-4e7d-b4c9-dd008363605f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:48.673906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e027b-d2ce-4e7d-b4c9-dd008363605f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:48.709526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53acae-43d9-496e-a4a5-659a0d337cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:48.710145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53acae-43d9-496e-a4a5-659a0d337cba None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:48.710414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53acae-43d9-496e-a4a5-659a0d337cba None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:48.710682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53acae-43d9-496e-a4a5-659a0d337cba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:48.712787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:48.718924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53acae-43d9-496e-a4a5-659a0d337cba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:48.720855 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53acae-43d9-496e-a4a5-659a0d337cba None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-1c53acae-43d9-496e-a4a5-659a0d337cba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:48.733025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:48.734001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:48.734941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:48.734941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:48.734941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:48.734941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:48.734941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:48.734941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:48.734941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:48.734941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:48.734941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 22:20:48.734941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:48.734941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 457/898] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 22:20:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:48.744310 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad62a5-9683-46c3-9f13-016dfd13d04d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:48.760596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ffb17-880e-41f2-a361-68c2773e7fc1 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:48.760971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ffb17-880e-41f2-a361-68c2773e7fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:48.761250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ffb17-880e-41f2-a361-68c2773e7fc1 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:48.763472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 458/899] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:20:48.769350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b5cbb-eba6-4ff2-a91f-dcff6fc6e8da None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:48.769629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b5cbb-eba6-4ff2-a91f-dcff6fc6e8da None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:48.769902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b5cbb-eba6-4ff2-a91f-dcff6fc6e8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:48.792692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0e7b5cbb-eba6-4ff2-a91f-dcff6fc6e8da None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:48.794557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0e7b5cbb-eba6-4ff2-a91f-dcff6fc6e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:48.860529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad62a5-9683-46c3-9f13-016dfd13d04d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:48.870642 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 459/900] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:48.892745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b5cbb-eba6-4ff2-a91f-dcff6fc6e8da None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:48.898199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc30545-4798-497f-9b10-f2b464eebe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:48.898903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc30545-4798-497f-9b10-f2b464eebe88 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:48.899271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc30545-4798-497f-9b10-f2b464eebe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:48.899613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc30545-4798-497f-9b10-f2b464eebe88 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:48.900413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc30545-4798-497f-9b10-f2b464eebe88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:48.900882 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc30545-4798-497f-9b10-f2b464eebe88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:48.902380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc30545-4798-497f-9b10-f2b464eebe88 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:48.928121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 442/901] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Aug 7 22:20:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:48.929379 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc30545-4798-497f-9b10-f2b464eebe88 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:48.951569 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:49.020759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b5cbb-eba6-4ff2-a91f-dcff6fc6e8da None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:49.051652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:49.053883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc30545-4798-497f-9b10-f2b464eebe88 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:49.069423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb9746-6140-420b-9073-30f3743942e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:49.070787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb9746-6140-420b-9073-30f3743942e0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:49.071450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb9746-6140-420b-9073-30f3743942e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:49.071978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb9746-6140-420b-9073-30f3743942e0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:49.072702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb9746-6140-420b-9073-30f3743942e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:49.074906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb9746-6140-420b-9073-30f3743942e0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-64eb9746-6140-420b-9073-30f3743942e0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:49.087527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:49.088688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 22:20:49.089781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:49.097396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1da5f-f7f7-4cbf-8f11-bd85e1ee2a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:49.097396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1da5f-f7f7-4cbf-8f11-bd85e1ee2a41 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:49.097396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1da5f-f7f7-4cbf-8f11-bd85e1ee2a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:49.097396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1da5f-f7f7-4cbf-8f11-bd85e1ee2a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:49.098060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 460/902] 10.222.0.15 () {56 vars in 1132 bytes} [Sun Aug 7 22:20:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:49.099061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb9746-6140-420b-9073-30f3743942e0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:49.188828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1da5f-f7f7-4cbf-8f11-bd85e1ee2a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:49.191519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1da5f-f7f7-4cbf-8f11-bd85e1ee2a41 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:49.214416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb9746-6140-420b-9073-30f3743942e0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:49.223584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:49.250997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ea422-dcbd-4840-b9a7-7c038d6243df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:49.251970 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ea422-dcbd-4840-b9a7-7c038d6243df None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:49.252514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ea422-dcbd-4840-b9a7-7c038d6243df None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:49.252702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ea422-dcbd-4840-b9a7-7c038d6243df None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:49.253438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ea422-dcbd-4840-b9a7-7c038d6243df None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:49.253805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ea422-dcbd-4840-b9a7-7c038d6243df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:49.255338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ea422-dcbd-4840-b9a7-7c038d6243df None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:49.264917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 461/903] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 22:20:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:49.265913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ea422-dcbd-4840-b9a7-7c038d6243df None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:49.321639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:49.327444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 443/904] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:48 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:20:49.328810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af1039-30de-495a-a454-030e36dfff58 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:49.329169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af1039-30de-495a-a454-030e36dfff58 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:49.329515 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af1039-30de-495a-a454-030e36dfff58 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:49.331638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 444/905] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:49.334279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af1039-30de-495a-a454-030e36dfff58 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:49.375408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ea422-dcbd-4840-b9a7-7c038d6243df None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:49.409839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef40aaa-d7db-42e4-8f2b-5d02657de0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:49.410453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef40aaa-d7db-42e4-8f2b-5d02657de0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:49.410732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef40aaa-d7db-42e4-8f2b-5d02657de0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:49.411003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef40aaa-d7db-42e4-8f2b-5d02657de0a6 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:49.411664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef40aaa-d7db-42e4-8f2b-5d02657de0a6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:49.411969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef40aaa-d7db-42e4-8f2b-5d02657de0a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:49.413318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef40aaa-d7db-42e4-8f2b-5d02657de0a6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:49.418329 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 462/906] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 22:20:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:49.424249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b44072-ff29-4e73-ba99-feed455134e9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:49.424491 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b44072-ff29-4e73-ba99-feed455134e9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:49.424753 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b44072-ff29-4e73-ba99-feed455134e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:49.442524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b8b44072-ff29-4e73-ba99-feed455134e9 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:49.443783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b8b44072-ff29-4e73-ba99-feed455134e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:49.446483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af1039-30de-495a-a454-030e36dfff58 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:49.469786 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:49.486887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c9d79-292b-44e6-8252-163205c6c27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:49.487659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c9d79-292b-44e6-8252-163205c6c27a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:49.487915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c9d79-292b-44e6-8252-163205c6c27a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:49.488178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c9d79-292b-44e6-8252-163205c6c27a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:49.499532 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c9d79-292b-44e6-8252-163205c6c27a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:49.501382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c9d79-292b-44e6-8252-163205c6c27a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:49.515435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 463/907] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:49.516525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b44072-ff29-4e73-ba99-feed455134e9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-715c9d79-292b-44e6-8252-163205c6c27a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:49.517144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:49.518602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:49.524451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:49.524451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:49.524451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:49.524451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 445/908] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:49.524451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c9d79-292b-44e6-8252-163205c6c27a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:49.567878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:49.624088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b44072-ff29-4e73-ba99-feed455134e9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:49.639756 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c9d79-292b-44e6-8252-163205c6c27a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:49.660315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b450a-56ab-431f-ab1b-3b94b04568ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:49.661252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b450a-56ab-431f-ab1b-3b94b04568ed None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:49.661759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b450a-56ab-431f-ab1b-3b94b04568ed None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:49.662198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b450a-56ab-431f-ab1b-3b94b04568ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:49.663069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b450a-56ab-431f-ab1b-3b94b04568ed None admin] RBAC: Adding query filter params (interface=public, service_id=0b6fa5dc384a43daa8166d12967aab4e, region_id=RegionOne) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:49.663574 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b450a-56ab-431f-ab1b-3b94b04568ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:49.665072 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b450a-56ab-431f-ab1b-3b94b04568ed None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:49.670170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 464/909] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 22:20:49 2022] GET /identity/v3/endpoints?service_id=0b6fa5dc384a43daa8166d12967aab4e&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:49.671136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b450a-56ab-431f-ab1b-3b94b04568ed None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:49.680792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf8b12-3a3f-4444-9981-3052a58eff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:49.681388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf8b12-3a3f-4444-9981-3052a58eff93 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:49.681662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf8b12-3a3f-4444-9981-3052a58eff93 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:49.681934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf8b12-3a3f-4444-9981-3052a58eff93 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:49.682989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf8b12-3a3f-4444-9981-3052a58eff93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:49.683335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf8b12-3a3f-4444-9981-3052a58eff93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:49.685043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf8b12-3a3f-4444-9981-3052a58eff93 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:49.697982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 446/910] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:49.698747 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf8b12-3a3f-4444-9981-3052a58eff93 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:49.732843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:49.785483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b450a-56ab-431f-ab1b-3b94b04568ed None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:49.797266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:49.808540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf8b12-3a3f-4444-9981-3052a58eff93 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:49.824310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1aefe-0459-4c15-a33c-615bda7b23fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:49.824883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1aefe-0459-4c15-a33c-615bda7b23fc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:49.825162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1aefe-0459-4c15-a33c-615bda7b23fc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:49.825440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1aefe-0459-4c15-a33c-615bda7b23fc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:49.826049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1aefe-0459-4c15-a33c-615bda7b23fc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:49.827423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1aefe-0459-4c15-a33c-615bda7b23fc None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-c6f1aefe-0459-4c15-a33c-615bda7b23fc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:49.836476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:49.837481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:49.838396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 465/911] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:20:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:49.839248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1aefe-0459-4c15-a33c-615bda7b23fc None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:49.850495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5b1f7-0641-482f-9daa-e42086f48d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:49.851310 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b1f7-0641-482f-9daa-e42086f48d6b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:49.851422 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b1f7-0641-482f-9daa-e42086f48d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:49.851674 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b1f7-0641-482f-9daa-e42086f48d6b None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:49.852259 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5b1f7-0641-482f-9daa-e42086f48d6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:49.853612 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5b1f7-0641-482f-9daa-e42086f48d6b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:49.859857 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 447/912] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 22:20:49 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:20:49.860549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5b1f7-0641-482f-9daa-e42086f48d6b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:49.986337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1aefe-0459-4c15-a33c-615bda7b23fc None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:49.996337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:50.004825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5b1f7-0641-482f-9daa-e42086f48d6b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:50.038242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f877db4-5c48-477c-8e45-6310da58e6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:50.039329 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f877db4-5c48-477c-8e45-6310da58e6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:50.039786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f877db4-5c48-477c-8e45-6310da58e6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:50.040249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f877db4-5c48-477c-8e45-6310da58e6d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:50.047896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b29261-fa84-4b45-a84d-e8289e5a43ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:50.048511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b29261-fa84-4b45-a84d-e8289e5a43ea None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:50.048790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b29261-fa84-4b45-a84d-e8289e5a43ea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:50.049060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b29261-fa84-4b45-a84d-e8289e5a43ea None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:50.050073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f877db4-5c48-477c-8e45-6310da58e6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:50.050248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b29261-fa84-4b45-a84d-e8289e5a43ea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:50.050522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b29261-fa84-4b45-a84d-e8289e5a43ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:50.051801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f877db4-5c48-477c-8e45-6310da58e6d2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:50.051907 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b29261-fa84-4b45-a84d-e8289e5a43ea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:50.058380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 448/913] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:20:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5f877db4-5c48-477c-8e45-6310da58e6d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:50.063722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:50.064592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:50.066043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:50.066043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:50.066043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:50.066043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:50.066043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:50.066043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:50.066043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:50.066043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:50.066465 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b29261-fa84-4b45-a84d-e8289e5a43ea None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:50.066536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 466/914] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:50.079266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f877db4-5c48-477c-8e45-6310da58e6d2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:50.147144 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:50.173308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b29261-fa84-4b45-a84d-e8289e5a43ea None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:50.208757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f877db4-5c48-477c-8e45-6310da58e6d2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:50.212442 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bfc1a-bab2-4c5a-a626-4d8d16f9e75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:50.213155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bfc1a-bab2-4c5a-a626-4d8d16f9e75e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:50.213525 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bfc1a-bab2-4c5a-a626-4d8d16f9e75e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:50.213911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bfc1a-bab2-4c5a-a626-4d8d16f9e75e None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:50.214646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bfc1a-bab2-4c5a-a626-4d8d16f9e75e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:50.215046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bfc1a-bab2-4c5a-a626-4d8d16f9e75e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:50.216530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bfc1a-bab2-4c5a-a626-4d8d16f9e75e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:50.226464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 449/915] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 22:20:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:50.227825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bfc1a-bab2-4c5a-a626-4d8d16f9e75e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:50.246640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e331c71-cf55-49ff-bb9e-9346200b7afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:50.247921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e331c71-cf55-49ff-bb9e-9346200b7afe None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:50.248371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e331c71-cf55-49ff-bb9e-9346200b7afe None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:50.248810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e331c71-cf55-49ff-bb9e-9346200b7afe None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:50.249686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e331c71-cf55-49ff-bb9e-9346200b7afe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:50.250156 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e331c71-cf55-49ff-bb9e-9346200b7afe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:50.253482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e331c71-cf55-49ff-bb9e-9346200b7afe None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:50.255730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:50.277146 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 467/916] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:50.277815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e331c71-cf55-49ff-bb9e-9346200b7afe None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:50.348594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bfc1a-bab2-4c5a-a626-4d8d16f9e75e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:50.390754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe2156-1663-46da-902d-8061bf82dfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:50.391393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe2156-1663-46da-902d-8061bf82dfac None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:50.391678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe2156-1663-46da-902d-8061bf82dfac None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:50.391952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe2156-1663-46da-902d-8061bf82dfac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:50.392626 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe2156-1663-46da-902d-8061bf82dfac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:50.394016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe2156-1663-46da-902d-8061bf82dfac None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:50.394286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:50.402000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e331c71-cf55-49ff-bb9e-9346200b7afe None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:50.427130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 450/917] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:20:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:20:50.427130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffcb2-2e6c-42a2-8c2f-c6652bfb9141 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:50.427130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffcb2-2e6c-42a2-8c2f-c6652bfb9141 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:50.427130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffcb2-2e6c-42a2-8c2f-c6652bfb9141 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:50.427537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 451/918] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:50.429211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a2bc2-3f56-494f-8d76-8af5db42e477 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:50.429496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a2bc2-3f56-494f-8d76-8af5db42e477 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:50.429778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a2bc2-3f56-494f-8d76-8af5db42e477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:50.453090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92236e29-119b-43fa-944f-fddd46d98ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:50.453702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92236e29-119b-43fa-944f-fddd46d98ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:50.454035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92236e29-119b-43fa-944f-fddd46d98ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:50.454306 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92236e29-119b-43fa-944f-fddd46d98ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:50.455167 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92236e29-119b-43fa-944f-fddd46d98ca5 None admin] RBAC: Adding query filter params (role.id=dbd98afdf4814f1b864d9da8e7861ca5, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=e44d9ab25b1444ed973079d988813b23) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:50.455501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92236e29-119b-43fa-944f-fddd46d98ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:50.455663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f75a2bc2-3f56-494f-8d76-8af5db42e477 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:50.456952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f75a2bc2-3f56-494f-8d76-8af5db42e477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:50.457082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92236e29-119b-43fa-944f-fddd46d98ca5 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:50.463881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 468/919] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:50 2022] GET /identity/v3/role_assignments?user.id=e44d9ab25b1444ed973079d988813b23&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=dbd98afdf4814f1b864d9da8e7861ca5 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:50.544897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 452/920] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:50.568529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92236e29-119b-43fa-944f-fddd46d98ca5 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:50.694411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92236e29-119b-43fa-944f-fddd46d98ca5 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:50.732260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28398cb7-5a3b-470b-b294-9ba2e2b74dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:50.733304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28398cb7-5a3b-470b-b294-9ba2e2b74dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:50.733750 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28398cb7-5a3b-470b-b294-9ba2e2b74dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:50.734200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28398cb7-5a3b-470b-b294-9ba2e2b74dd4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:50.735055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28398cb7-5a3b-470b-b294-9ba2e2b74dd4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:50.736459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28398cb7-5a3b-470b-b294-9ba2e2b74dd4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-28398cb7-5a3b-470b-b294-9ba2e2b74dd4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:50.746500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:50.747560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:50.748784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 469/921] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 22:20:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:50.754542 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a2bc2-3f56-494f-8d76-8af5db42e477 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:50.769720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:50.877405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a2bc2-3f56-494f-8d76-8af5db42e477 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:50.919782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05736be-9638-41bf-9076-44f00e7061e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:50.920385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05736be-9638-41bf-9076-44f00e7061e9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:50.920653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05736be-9638-41bf-9076-44f00e7061e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:50.920919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05736be-9638-41bf-9076-44f00e7061e9 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:50.921544 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05736be-9638-41bf-9076-44f00e7061e9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:50.921841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05736be-9638-41bf-9076-44f00e7061e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:50.924688 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05736be-9638-41bf-9076-44f00e7061e9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:50.928895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 453/922] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 22:20:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:50.936513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28398cb7-5a3b-470b-b294-9ba2e2b74dd4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:50.959748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:51.059576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28398cb7-5a3b-470b-b294-9ba2e2b74dd4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:51.097592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ddb5f-e215-42d3-bb39-432089ac460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:51.098449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ddb5f-e215-42d3-bb39-432089ac460c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:51.098869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ddb5f-e215-42d3-bb39-432089ac460c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:51.099328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ddb5f-e215-42d3-bb39-432089ac460c None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:51.100101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ddb5f-e215-42d3-bb39-432089ac460c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:51.100568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ddb5f-e215-42d3-bb39-432089ac460c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:51.102059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ddb5f-e215-42d3-bb39-432089ac460c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:51.107723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 470/923] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 22:20:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:51.116708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05736be-9638-41bf-9076-44f00e7061e9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:51.195817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:51.224585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05736be-9638-41bf-9076-44f00e7061e9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:51.262112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af942b44-e71f-42b6-9aa0-59c44b22933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:51.262737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af942b44-e71f-42b6-9aa0-59c44b22933b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:51.262967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af942b44-e71f-42b6-9aa0-59c44b22933b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:51.263262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af942b44-e71f-42b6-9aa0-59c44b22933b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:51.263957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af942b44-e71f-42b6-9aa0-59c44b22933b None admin] RBAC: Adding query filter params (interface=public, service_id=a29a15d2064b4686b66e1f88dcafdffd, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:51.264258 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af942b44-e71f-42b6-9aa0-59c44b22933b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:51.265852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af942b44-e71f-42b6-9aa0-59c44b22933b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:51.272249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 454/924] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 22:20:51 2022] GET /identity/v3/endpoints?service_id=a29a15d2064b4686b66e1f88dcafdffd&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:51.277528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ddb5f-e215-42d3-bb39-432089ac460c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:51.366065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:51.385656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ddb5f-e215-42d3-bb39-432089ac460c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:51.422196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669949fd-7be6-4935-a86a-5d8d9e4465c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:51.422801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669949fd-7be6-4935-a86a-5d8d9e4465c4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:51.423072 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669949fd-7be6-4935-a86a-5d8d9e4465c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:51.423358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669949fd-7be6-4935-a86a-5d8d9e4465c4 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:51.423951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669949fd-7be6-4935-a86a-5d8d9e4465c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:51.425879 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669949fd-7be6-4935-a86a-5d8d9e4465c4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:51.432180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 471/925] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 22:20:51 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:20:52.023202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524189-302c-4930-9af4-93db7d9c805b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:52.023484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524189-302c-4930-9af4-93db7d9c805b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:52.023752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524189-302c-4930-9af4-93db7d9c805b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:52.025324 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 455/926] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:52.030528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e539fa-48fd-4e3f-bb5d-858b547051f3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:52.031436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e539fa-48fd-4e3f-bb5d-858b547051f3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:52.031917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e539fa-48fd-4e3f-bb5d-858b547051f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:52.050124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f9e539fa-48fd-4e3f-bb5d-858b547051f3 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:52.051658 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f9e539fa-48fd-4e3f-bb5d-858b547051f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:52.123069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 472/927] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:52.147030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba524189-302c-4930-9af4-93db7d9c805b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:52.251387 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba524189-302c-4930-9af4-93db7d9c805b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:52.288046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6e045-d3d6-4377-bfb1-7eeab9ffb63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:52.289483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e045-d3d6-4377-bfb1-7eeab9ffb63a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:52.289963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e045-d3d6-4377-bfb1-7eeab9ffb63a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:52.290436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e045-d3d6-4377-bfb1-7eeab9ffb63a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:52.291263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6e045-d3d6-4377-bfb1-7eeab9ffb63a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:52.292820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6e045-d3d6-4377-bfb1-7eeab9ffb63a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-50c6e045-d3d6-4377-bfb1-7eeab9ffb63a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:52.301861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:52.302819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 22:20:52.303742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:52.306505 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 456/928] 10.222.0.15 () {56 vars in 1132 bytes} [Sun Aug 7 22:20:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:52.316889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e539fa-48fd-4e3f-bb5d-858b547051f3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:52.397854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:52.421815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e539fa-48fd-4e3f-bb5d-858b547051f3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:52.456512 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709b213-68b5-4320-bea3-e6a00ea78649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:52.457113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709b213-68b5-4320-bea3-e6a00ea78649 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:52.457383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709b213-68b5-4320-bea3-e6a00ea78649 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:52.457646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709b213-68b5-4320-bea3-e6a00ea78649 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:52.458266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709b213-68b5-4320-bea3-e6a00ea78649 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:52.458562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709b213-68b5-4320-bea3-e6a00ea78649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:52.459928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709b213-68b5-4320-bea3-e6a00ea78649 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:52.465011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 473/929] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 22:20:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:52.470476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6e045-d3d6-4377-bfb1-7eeab9ffb63a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:52.473969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:52.580897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6e045-d3d6-4377-bfb1-7eeab9ffb63a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:52.618623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a8cd-2943-4fa2-909d-d8b352078893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:52.619557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a8cd-2943-4fa2-909d-d8b352078893 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:52.620029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a8cd-2943-4fa2-909d-d8b352078893 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:52.620488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a8cd-2943-4fa2-909d-d8b352078893 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:52.621287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3a8cd-2943-4fa2-909d-d8b352078893 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:52.621756 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3a8cd-2943-4fa2-909d-d8b352078893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:52.623306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3a8cd-2943-4fa2-909d-d8b352078893 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:52.627220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f18bd-fc1f-417c-87a2-13b326ce7fde None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:52.627539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f18bd-fc1f-417c-87a2-13b326ce7fde None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:52.627810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f18bd-fc1f-417c-87a2-13b326ce7fde None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:52.629463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 474/930] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:52.629841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 457/931] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 22:20:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:52.634457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a79d8-1298-49b3-8c37-f07fcd529ffc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:52.634736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a79d8-1298-49b3-8c37-f07fcd529ffc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:52.635004 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a79d8-1298-49b3-8c37-f07fcd529ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:52.638033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a8cd-2943-4fa2-909d-d8b352078893 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:52.653545 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-145a79d8-1298-49b3-8c37-f07fcd529ffc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:52.655191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-145a79d8-1298-49b3-8c37-f07fcd529ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:52.707981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:52.729289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 475/932] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:52.730528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7b85f-7185-48f0-b335-e22c8fe794dd None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:52.730795 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7b85f-7185-48f0-b335-e22c8fe794dd None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:52.731062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7b85f-7185-48f0-b335-e22c8fe794dd None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:52.732518 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 476/933] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:52.738989 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e73107-d9ea-4d68-8738-ac49478d6ccc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:52.739349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e73107-d9ea-4d68-8738-ac49478d6ccc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:52.739651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e73107-d9ea-4d68-8738-ac49478d6ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:52.755235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a8cd-2943-4fa2-909d-d8b352078893 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:52.758142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a5e73107-d9ea-4d68-8738-ac49478d6ccc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:52.759394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a5e73107-d9ea-4d68-8738-ac49478d6ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:52.791885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab6de2-8e9b-443d-9e09-f56a5c5cd444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:52.793004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab6de2-8e9b-443d-9e09-f56a5c5cd444 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:52.793618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab6de2-8e9b-443d-9e09-f56a5c5cd444 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:52.794016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab6de2-8e9b-443d-9e09-f56a5c5cd444 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:52.794742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab6de2-8e9b-443d-9e09-f56a5c5cd444 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:52.796143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab6de2-8e9b-443d-9e09-f56a5c5cd444 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:52.817638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 458/934] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:20:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:20:52.821765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:52.828313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab6de2-8e9b-443d-9e09-f56a5c5cd444 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:52.846921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 477/935] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:20:52.866763 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e73107-d9ea-4d68-8738-ac49478d6ccc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:52.974386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab6de2-8e9b-443d-9e09-f56a5c5cd444 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:52.993265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e73107-d9ea-4d68-8738-ac49478d6ccc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:53.012813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:53.030217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ecaab-77b9-4d2a-a8cb-bd5e4dab3905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:53.031159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ecaab-77b9-4d2a-a8cb-bd5e4dab3905 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:53.031731 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ecaab-77b9-4d2a-a8cb-bd5e4dab3905 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:53.032290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ecaab-77b9-4d2a-a8cb-bd5e4dab3905 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:53.033007 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ecaab-77b9-4d2a-a8cb-bd5e4dab3905 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:53.034666 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ecaab-77b9-4d2a-a8cb-bd5e4dab3905 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:53.037789 dv-cinder-850321-3-smb devstack@keystone.service[80285]: WARNING keystone.server.flask.common [None req-da0ecaab-77b9-4d2a-a8cb-bd5e4dab3905 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 07 22:20:53.041579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193f17d-02af-4076-83d3-585b503d7c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:53.042714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193f17d-02af-4076-83d3-585b503d7c99 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:53.043275 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193f17d-02af-4076-83d3-585b503d7c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:53.043712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193f17d-02af-4076-83d3-585b503d7c99 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:53.055734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193f17d-02af-4076-83d3-585b503d7c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:53.059195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.sql.core [None req-da0ecaab-77b9-4d2a-a8cb-bd5e4dab3905 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 22:20:53.059195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 22:20:53.059195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [parameters: {'id': 'd8762b6b9bf4480f8d99f5e18d614d52', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 22:20:53.059195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80285) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5193f17d-02af-4076-83d3-585b503d7c99 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:53.061731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:53.062632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:53.063595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:53.063595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:53.063595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:53.063595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:53.063595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:53.063595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:53.063595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:53.063595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:53.063595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:53.063595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:53.063595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 22:20:53.063595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:53.066853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 478/936] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Aug 7 22:20:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-da0ecaab-77b9-4d2a-a8cb-bd5e4dab3905 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d8762b6b9bf4480f8d99f5e18d614d52.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d8762b6b9bf4480f8d99f5e18d614d52. Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application conn.query(q) Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 22:20:53.071121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result.read() Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 07 22:20:53.072199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application next(self.gen) Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application yield resource Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application next(self.gen) Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise self.value Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application session.commit() Aug 07 22:20:53.073141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.session.flush() Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application compat.raise_( Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 22:20:53.074073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 22:20:53.075606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application conn.query(q) Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result.read() Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 22:20:53.078335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [parameters: {'id': 'd8762b6b9bf4480f8d99f5e18d614d52', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:53.080647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:53.083056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:53.085599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:53.085599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 07 22:20:53.085599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 07 22:20:53.085599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:53.085599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:53.085599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 07 22:20:53.085599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 07 22:20:53.085599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d8762b6b9bf4480f8d99f5e18d614d52. Aug 07 22:20:53.085599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:53.085599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 459/937] 10.222.0.15 () {60 vars in 1140 bytes} [Sun Aug 7 22:20:52 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:53.087397 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193f17d-02af-4076-83d3-585b503d7c99 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:53.088983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ecaab-77b9-4d2a-a8cb-bd5e4dab3905 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:53.141936 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:53.197413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193f17d-02af-4076-83d3-585b503d7c99 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:53.217672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ecaab-77b9-4d2a-a8cb-bd5e4dab3905 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:53.237856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3da286-f657-4a66-911d-d15903d86f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:53.238747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3da286-f657-4a66-911d-d15903d86f95 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:53.239163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3da286-f657-4a66-911d-d15903d86f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:53.239565 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3da286-f657-4a66-911d-d15903d86f95 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:53.240493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3da286-f657-4a66-911d-d15903d86f95 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:53.240894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3da286-f657-4a66-911d-d15903d86f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:53.242352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3da286-f657-4a66-911d-d15903d86f95 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:53.255370 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 479/938] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 22:20:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:53.258394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3da286-f657-4a66-911d-d15903d86f95 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:53.260476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ac1f1-965f-4608-9746-a82acfc580e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:53.261444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac1f1-965f-4608-9746-a82acfc580e6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:53.261897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac1f1-965f-4608-9746-a82acfc580e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:53.262310 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac1f1-965f-4608-9746-a82acfc580e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:53.275868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ac1f1-965f-4608-9746-a82acfc580e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:53.278320 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ac1f1-965f-4608-9746-a82acfc580e6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-319ac1f1-965f-4608-9746-a82acfc580e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:53.294216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:53.295828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:53.296964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:53.296964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:53.296964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:53.296964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:53.296964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:53.296964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:53.296964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:53.296964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:53.300645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 460/939] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:53.307138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ac1f1-965f-4608-9746-a82acfc580e6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:53.353967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:53.375963 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3da286-f657-4a66-911d-d15903d86f95 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:53.394308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:53.413017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be2643-f260-4ec9-b88c-aecedf0dbccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:53.413907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2643-f260-4ec9-b88c-aecedf0dbccb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:53.414344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2643-f260-4ec9-b88c-aecedf0dbccb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:53.414762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2643-f260-4ec9-b88c-aecedf0dbccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:53.426661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be2643-f260-4ec9-b88c-aecedf0dbccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:53.428375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ac1f1-965f-4608-9746-a82acfc580e6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:53.428701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be2643-f260-4ec9-b88c-aecedf0dbccb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-02be2643-f260-4ec9-b88c-aecedf0dbccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:53.443870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:53.444847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:53.445736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:53.445736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:53.445736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:53.447826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 480/940] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:53.453065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be2643-f260-4ec9-b88c-aecedf0dbccb None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:53.471936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1b918-dc4f-4c37-a388-b0d31a3741e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:53.472994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1b918-dc4f-4c37-a388-b0d31a3741e8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:53.473541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1b918-dc4f-4c37-a388-b0d31a3741e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:53.474423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1b918-dc4f-4c37-a388-b0d31a3741e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:53.475647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1b918-dc4f-4c37-a388-b0d31a3741e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:53.476158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1b918-dc4f-4c37-a388-b0d31a3741e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:53.478206 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1b918-dc4f-4c37-a388-b0d31a3741e8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:53.511497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 461/941] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:20:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:53.514792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec47a5-d5da-428a-b147-e9c697fcee49 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:53.515066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec47a5-d5da-428a-b147-e9c697fcee49 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:53.515376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec47a5-d5da-428a-b147-e9c697fcee49 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:53.521301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 462/942] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:20:53.522717 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dafc6-af16-48bc-8d8f-678d29477b21 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:53.523002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dafc6-af16-48bc-8d8f-678d29477b21 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:53.523298 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dafc6-af16-48bc-8d8f-678d29477b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:53.543490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9c0dafc6-af16-48bc-8d8f-678d29477b21 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:53.545046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9c0dafc6-af16-48bc-8d8f-678d29477b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:53.596811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be2643-f260-4ec9-b88c-aecedf0dbccb None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:53.624769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 463/943] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:53.646529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1370-dac6-42f4-ae26-396f8d2f0353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:53.647557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1370-dac6-42f4-ae26-396f8d2f0353 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:53.648061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1370-dac6-42f4-ae26-396f8d2f0353 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:53.648239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dafc6-af16-48bc-8d8f-678d29477b21 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:53.648702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1370-dac6-42f4-ae26-396f8d2f0353 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:53.649561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1370-dac6-42f4-ae26-396f8d2f0353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:53.650097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1370-dac6-42f4-ae26-396f8d2f0353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:53.653240 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1370-dac6-42f4-ae26-396f8d2f0353 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:53.671297 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 481/944] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:53.678490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1370-dac6-42f4-ae26-396f8d2f0353 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:53.685786 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:53.714965 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:53.785334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dafc6-af16-48bc-8d8f-678d29477b21 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:53.806614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1370-dac6-42f4-ae26-396f8d2f0353 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:53.821997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e9f44-89cf-42bc-806f-e1d9cd176d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:53.822714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e9f44-89cf-42bc-806f-e1d9cd176d4c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:53.823119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e9f44-89cf-42bc-806f-e1d9cd176d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:53.823539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e9f44-89cf-42bc-806f-e1d9cd176d4c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:53.824206 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e9f44-89cf-42bc-806f-e1d9cd176d4c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:53.825638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e9f44-89cf-42bc-806f-e1d9cd176d4c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a41e9f44-89cf-42bc-806f-e1d9cd176d4c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:53.834715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:53.835738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:53.836571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 464/945] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 22:20:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:53.844019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e9f44-89cf-42bc-806f-e1d9cd176d4c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:53.856299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bf87a-3c5c-4f98-a1a8-984af59a378e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:53.856935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bf87a-3c5c-4f98-a1a8-984af59a378e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:53.857230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bf87a-3c5c-4f98-a1a8-984af59a378e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:53.857857 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bf87a-3c5c-4f98-a1a8-984af59a378e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:53.867721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bf87a-3c5c-4f98-a1a8-984af59a378e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:53.869156 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bf87a-3c5c-4f98-a1a8-984af59a378e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-9e7bf87a-3c5c-4f98-a1a8-984af59a378e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:53.885747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:53.886883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:53.887858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:53.887858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:53.887858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:53.887858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:53.887858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:53.887858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:53.887858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:53.887858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:53.887858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 22:20:53.887858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:53.887858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 482/946] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 22:20:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:53.896326 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bf87a-3c5c-4f98-a1a8-984af59a378e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:53.961756 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:53.973623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e9f44-89cf-42bc-806f-e1d9cd176d4c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:53.998233 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:54.014769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bf87a-3c5c-4f98-a1a8-984af59a378e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:54.024007 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf06c0-cf4e-4b00-82a3-45bc73f1ee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:54.024642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf06c0-cf4e-4b00-82a3-45bc73f1ee80 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:54.024922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf06c0-cf4e-4b00-82a3-45bc73f1ee80 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:54.025193 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf06c0-cf4e-4b00-82a3-45bc73f1ee80 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:54.025831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf06c0-cf4e-4b00-82a3-45bc73f1ee80 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:54.026135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf06c0-cf4e-4b00-82a3-45bc73f1ee80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:54.027961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf06c0-cf4e-4b00-82a3-45bc73f1ee80 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:54.035542 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 465/947] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 22:20:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:54.040547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf06c0-cf4e-4b00-82a3-45bc73f1ee80 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:54.067271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef381281-f0c0-4807-927a-1fed2aba8c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:54.069134 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef381281-f0c0-4807-927a-1fed2aba8c66 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:54.069876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef381281-f0c0-4807-927a-1fed2aba8c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:54.070336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef381281-f0c0-4807-927a-1fed2aba8c66 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:54.071552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef381281-f0c0-4807-927a-1fed2aba8c66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:54.072396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef381281-f0c0-4807-927a-1fed2aba8c66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:54.074547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef381281-f0c0-4807-927a-1fed2aba8c66 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:54.100280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 483/948] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Aug 7 22:20:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:54.108382 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef381281-f0c0-4807-927a-1fed2aba8c66 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:54.162675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf06c0-cf4e-4b00-82a3-45bc73f1ee80 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:54.201786 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7435ea-7b25-4258-a177-c22f1a4c8040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:54.202604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7435ea-7b25-4258-a177-c22f1a4c8040 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:54.202942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7435ea-7b25-4258-a177-c22f1a4c8040 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:54.203312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7435ea-7b25-4258-a177-c22f1a4c8040 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:54.204047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7435ea-7b25-4258-a177-c22f1a4c8040 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:54.204413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7435ea-7b25-4258-a177-c22f1a4c8040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:54.205939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7435ea-7b25-4258-a177-c22f1a4c8040 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:54.215518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 466/949] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 22:20:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:54.216755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7435ea-7b25-4258-a177-c22f1a4c8040 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:54.231601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef381281-f0c0-4807-927a-1fed2aba8c66 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:54.240398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:54.278878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb414-64ec-482b-aca7-9bd2b4a8a227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:54.279788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb414-64ec-482b-aca7-9bd2b4a8a227 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:54.280404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb414-64ec-482b-aca7-9bd2b4a8a227 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:54.280828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb414-64ec-482b-aca7-9bd2b4a8a227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:54.297176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cb414-64ec-482b-aca7-9bd2b4a8a227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:54.299367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cb414-64ec-482b-aca7-9bd2b4a8a227 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-c93cb414-64ec-482b-aca7-9bd2b4a8a227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:54.318787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:54.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:54.320682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:54.320682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:54.320682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:54.323410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:54.327475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 484/950] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:54.328344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb414-64ec-482b-aca7-9bd2b4a8a227 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:54.332194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7435ea-7b25-4258-a177-c22f1a4c8040 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:54.381732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ceaa69-3f8e-417f-b18b-4fc8f151081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:54.382709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ceaa69-3f8e-417f-b18b-4fc8f151081c None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:54.383005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ceaa69-3f8e-417f-b18b-4fc8f151081c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:54.383322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ceaa69-3f8e-417f-b18b-4fc8f151081c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:54.384465 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ceaa69-3f8e-417f-b18b-4fc8f151081c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:54.386043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ceaa69-3f8e-417f-b18b-4fc8f151081c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:54.419119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 467/951] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:20:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:20:54.456746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb414-64ec-482b-aca7-9bd2b4a8a227 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:54.504627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569d31a-d6ad-48b2-9e28-c96f842fb527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:54.505491 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569d31a-d6ad-48b2-9e28-c96f842fb527 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:54.505908 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569d31a-d6ad-48b2-9e28-c96f842fb527 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:54.506315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569d31a-d6ad-48b2-9e28-c96f842fb527 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:54.507120 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569d31a-d6ad-48b2-9e28-c96f842fb527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:54.507559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569d31a-d6ad-48b2-9e28-c96f842fb527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:54.509127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569d31a-d6ad-48b2-9e28-c96f842fb527 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:54.523643 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 485/952] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:54.531158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ceaa69-3f8e-417f-b18b-4fc8f151081c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:54.615974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:54.645464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ceaa69-3f8e-417f-b18b-4fc8f151081c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:54.681547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfac2ba-6c4b-4d94-8f24-46570a35a37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:54.682561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfac2ba-6c4b-4d94-8f24-46570a35a37b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:54.683117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfac2ba-6c4b-4d94-8f24-46570a35a37b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:54.683584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfac2ba-6c4b-4d94-8f24-46570a35a37b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:54.691524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfac2ba-6c4b-4d94-8f24-46570a35a37b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:54.693245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfac2ba-6c4b-4d94-8f24-46570a35a37b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2dfac2ba-6c4b-4d94-8f24-46570a35a37b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:54.705493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:54.706444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:54.707539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:54.707539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:54.707539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:54.707539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:54.707539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:54.707539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:54.707539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:54.707539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:54.710070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 468/953] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:54.715784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569d31a-d6ad-48b2-9e28-c96f842fb527 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:54.780927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:54.829469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569d31a-d6ad-48b2-9e28-c96f842fb527 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:54.866764 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d875de7-1401-43dc-ae66-aea2127360f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:54.867818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d875de7-1401-43dc-ae66-aea2127360f8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:54.868310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d875de7-1401-43dc-ae66-aea2127360f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:54.868774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d875de7-1401-43dc-ae66-aea2127360f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:54.869647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d875de7-1401-43dc-ae66-aea2127360f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:54.870141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d875de7-1401-43dc-ae66-aea2127360f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:54.871781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d875de7-1401-43dc-ae66-aea2127360f8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:54.884668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 486/954] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:54.890866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfac2ba-6c4b-4d94-8f24-46570a35a37b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:54.930032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503d143-6a4a-4961-a919-d6ca77328085 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:54.930317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503d143-6a4a-4961-a919-d6ca77328085 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:54.930593 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503d143-6a4a-4961-a919-d6ca77328085 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:54.933213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 487/955] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:20:54.937178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080c6a3-6f11-4f0b-b77d-645e00e83d0b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:54.937463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080c6a3-6f11-4f0b-b77d-645e00e83d0b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:54.937732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080c6a3-6f11-4f0b-b77d-645e00e83d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:54.956074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a080c6a3-6f11-4f0b-b77d-645e00e83d0b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:54.957550 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a080c6a3-6f11-4f0b-b77d-645e00e83d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:55.018775 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfac2ba-6c4b-4d94-8f24-46570a35a37b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:55.051391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 488/956] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:20:55.059294 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166138b-45a8-4c97-8330-25cdf73fd57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:55.059947 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166138b-45a8-4c97-8330-25cdf73fd57d None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:55.060221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166138b-45a8-4c97-8330-25cdf73fd57d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:55.060491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166138b-45a8-4c97-8330-25cdf73fd57d None admin] PATH_INFO: `/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/e44d9ab25b1444ed973079d988813b23/roles/dbd98afdf4814f1b864d9da8e7861ca5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:55.062719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166138b-45a8-4c97-8330-25cdf73fd57d None admin] RBAC: Authorizing `identity:create_grant(project_id=6c5638056cea4e5397c6a25d434e5324, user_id=e44d9ab25b1444ed973079d988813b23, role_id=dbd98afdf4814f1b864d9da8e7861ca5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:55.064347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166138b-45a8-4c97-8330-25cdf73fd57d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:55.066465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080c6a3-6f11-4f0b-b77d-645e00e83d0b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:55.068586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:55.083032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 469/957] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:20:54 2022] PUT /identity/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/e44d9ab25b1444ed973079d988813b23/roles/dbd98afdf4814f1b864d9da8e7861ca5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:20:55.128182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:55.194608 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080c6a3-6f11-4f0b-b77d-645e00e83d0b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:55.235615 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dd9d2-5d48-4739-b3cb-5a7a52c63747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:55.236246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dd9d2-5d48-4739-b3cb-5a7a52c63747 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:55.236517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dd9d2-5d48-4739-b3cb-5a7a52c63747 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:55.237448 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dd9d2-5d48-4739-b3cb-5a7a52c63747 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:55.238032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dd9d2-5d48-4739-b3cb-5a7a52c63747 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:55.239407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dd9d2-5d48-4739-b3cb-5a7a52c63747 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-169dd9d2-5d48-4739-b3cb-5a7a52c63747 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:55.248822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:55.249943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:55.250837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 489/958] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:55.258070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166138b-45a8-4c97-8330-25cdf73fd57d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:55.367632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166138b-45a8-4c97-8330-25cdf73fd57d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:55.403576 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46970778-53b6-4db7-940a-7656c0009197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:55.404180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970778-53b6-4db7-940a-7656c0009197 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:55.404451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970778-53b6-4db7-940a-7656c0009197 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:55.404720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970778-53b6-4db7-940a-7656c0009197 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:55.405346 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46970778-53b6-4db7-940a-7656c0009197 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:55.405639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46970778-53b6-4db7-940a-7656c0009197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:55.407173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46970778-53b6-4db7-940a-7656c0009197 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:55.413241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 470/959] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:20:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:55.418819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dd9d2-5d48-4739-b3cb-5a7a52c63747 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:55.525114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dd9d2-5d48-4739-b3cb-5a7a52c63747 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:55.536917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:55.560769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bc653-312c-4724-8f63-5fe5259766a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:55.561728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bc653-312c-4724-8f63-5fe5259766a6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:55.562257 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bc653-312c-4724-8f63-5fe5259766a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:55.562731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bc653-312c-4724-8f63-5fe5259766a6 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:55.563609 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bc653-312c-4724-8f63-5fe5259766a6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:55.564115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bc653-312c-4724-8f63-5fe5259766a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:55.566203 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bc653-312c-4724-8f63-5fe5259766a6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:55.571983 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 490/960] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:20:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:55.712899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc6c7-5fbd-4aa7-9155-31e7d3a4adec None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:55.713246 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc6c7-5fbd-4aa7-9155-31e7d3a4adec None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:55.713430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc6c7-5fbd-4aa7-9155-31e7d3a4adec None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:55.714987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 471/961] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:55.720980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc068d-fc0f-49ed-b8ba-08db7d53669e None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:55.721788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc068d-fc0f-49ed-b8ba-08db7d53669e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:55.722058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc068d-fc0f-49ed-b8ba-08db7d53669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:55.742241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a7dc068d-fc0f-49ed-b8ba-08db7d53669e None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:55.743629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a7dc068d-fc0f-49ed-b8ba-08db7d53669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:55.812817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 491/962] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:55.837219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dc6c7-5fbd-4aa7-9155-31e7d3a4adec None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:55.901288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:55.950980 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dc6c7-5fbd-4aa7-9155-31e7d3a4adec None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:55.986554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893d84-2f4a-4172-a63a-cb12cbcdf790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:55.986554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893d84-2f4a-4172-a63a-cb12cbcdf790 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:55.986554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893d84-2f4a-4172-a63a-cb12cbcdf790 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:55.986554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893d84-2f4a-4172-a63a-cb12cbcdf790 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:55.987618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18893d84-2f4a-4172-a63a-cb12cbcdf790 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:55.990441 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18893d84-2f4a-4172-a63a-cb12cbcdf790 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:56.005879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.sql.core [None req-18893d84-2f4a-4172-a63a-cb12cbcdf790 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 22:20:56.005879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 22:20:56.005879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [parameters: {'user_id': '569e9e9da3164eafafdddbd760a4b932', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 22:20:56.005879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80285) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-18893d84-2f4a-4172-a63a-cb12cbcdf790 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application conn.query(q) Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result.read() Aug 07 22:20:56.014672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 22:20:56.015764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application next(self.gen) Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application yield resource Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application next(self.gen) Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise self.value Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application session.commit() Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 22:20:56.016753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.session.flush() Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application compat.raise_( Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 22:20:56.017632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 22:20:56.018570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application conn.query(q) Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result.read() Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 22:20:56.021020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [parameters: {'user_id': '569e9e9da3164eafafdddbd760a4b932', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:56.023988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 07 22:20:56.028312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 07 22:20:56.030691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 07 22:20:56.030691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 07 22:20:56.030691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 22:20:56.030691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 22:20:56.030691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 22:20:56.030691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:56.030691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 472/963] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Aug 7 22:20:55 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:56.033361 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc068d-fc0f-49ed-b8ba-08db7d53669e None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:56.137413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc068d-fc0f-49ed-b8ba-08db7d53669e None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:56.139829 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:56.172708 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d5e54-0a97-4466-a6a2-9f196835792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:56.173379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d5e54-0a97-4466-a6a2-9f196835792a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:56.173656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d5e54-0a97-4466-a6a2-9f196835792a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:56.173922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d5e54-0a97-4466-a6a2-9f196835792a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:56.181662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d5e54-0a97-4466-a6a2-9f196835792a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:56.183106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d5e54-0a97-4466-a6a2-9f196835792a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-c77d5e54-0a97-4466-a6a2-9f196835792a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:56.195509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:56.196506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:56.198135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:56.198135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:56.198135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:56.198135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:56.198135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:56.198135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:56.198135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:56.198135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:56.198135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 22:20:56.198135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:56.198135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 492/964] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:20:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:56.202879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893d84-2f4a-4172-a63a-cb12cbcdf790 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:56.309486 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893d84-2f4a-4172-a63a-cb12cbcdf790 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:56.333272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:56.348216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a063556-da0a-41eb-b46d-58c6b82e0080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:56.349032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a063556-da0a-41eb-b46d-58c6b82e0080 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:56.349497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a063556-da0a-41eb-b46d-58c6b82e0080 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:56.350260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a063556-da0a-41eb-b46d-58c6b82e0080 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:56.351322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a063556-da0a-41eb-b46d-58c6b82e0080 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:56.351854 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a063556-da0a-41eb-b46d-58c6b82e0080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:56.354402 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a063556-da0a-41eb-b46d-58c6b82e0080 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:56.395463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 473/965] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 22:20:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:56.509138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28443c85-cfb3-48fe-ace8-94bbe455b3d8 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:56.509450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28443c85-cfb3-48fe-ace8-94bbe455b3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:56.509685 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28443c85-cfb3-48fe-ace8-94bbe455b3d8 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:56.511327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 493/966] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:56.517031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a2b4b-2ed2-4193-975e-3d7c8f872fce None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:56.517331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a2b4b-2ed2-4193-975e-3d7c8f872fce None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:56.517591 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a2b4b-2ed2-4193-975e-3d7c8f872fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:56.537307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9e9a2b4b-2ed2-4193-975e-3d7c8f872fce None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:56.538853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9e9a2b4b-2ed2-4193-975e-3d7c8f872fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:56.615062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 474/967] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:56.653307 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28443c85-cfb3-48fe-ace8-94bbe455b3d8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:56.763380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28443c85-cfb3-48fe-ace8-94bbe455b3d8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:56.798087 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58290f-d0d6-4b8b-90e5-6bbab1c2d1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:56.798715 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58290f-d0d6-4b8b-90e5-6bbab1c2d1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:56.798991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58290f-d0d6-4b8b-90e5-6bbab1c2d1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:56.799811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58290f-d0d6-4b8b-90e5-6bbab1c2d1c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:56.800422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58290f-d0d6-4b8b-90e5-6bbab1c2d1c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:56.801783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58290f-d0d6-4b8b-90e5-6bbab1c2d1c3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-2b58290f-d0d6-4b8b-90e5-6bbab1c2d1c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:56.810525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:56.811786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:56.812830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 494/968] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 22:20:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:56.818279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a2b4b-2ed2-4193-975e-3d7c8f872fce None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:56.916768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a2b4b-2ed2-4193-975e-3d7c8f872fce None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:56.927836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:56.953506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23d8dc-2f64-4031-aa79-667adeba4c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:56.954110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23d8dc-2f64-4031-aa79-667adeba4c9a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:56.954386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23d8dc-2f64-4031-aa79-667adeba4c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:56.954658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23d8dc-2f64-4031-aa79-667adeba4c9a None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:56.955319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23d8dc-2f64-4031-aa79-667adeba4c9a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:56.955647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23d8dc-2f64-4031-aa79-667adeba4c9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:56.957004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23d8dc-2f64-4031-aa79-667adeba4c9a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:56.966363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 475/969] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 22:20:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:56.967607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58290f-d0d6-4b8b-90e5-6bbab1c2d1c3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:56.998410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:57.072055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58290f-d0d6-4b8b-90e5-6bbab1c2d1c3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:57.106674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495978b-ec9e-4cb8-93f0-478f88b08e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:57.107308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495978b-ec9e-4cb8-93f0-478f88b08e54 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:57.107582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495978b-ec9e-4cb8-93f0-478f88b08e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:57.107848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495978b-ec9e-4cb8-93f0-478f88b08e54 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:57.108460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495978b-ec9e-4cb8-93f0-478f88b08e54 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:57.108755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495978b-ec9e-4cb8-93f0-478f88b08e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:57.110088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495978b-ec9e-4cb8-93f0-478f88b08e54 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:57.120408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 495/970] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 22:20:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:57.121586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23d8dc-2f64-4031-aa79-667adeba4c9a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:57.222200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23d8dc-2f64-4031-aa79-667adeba4c9a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:57.256511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9ae25-af59-4a62-a279-474a3ca1e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:57.257290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ae25-af59-4a62-a279-474a3ca1e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:57.257662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ae25-af59-4a62-a279-474a3ca1e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:57.258024 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ae25-af59-4a62-a279-474a3ca1e4f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:57.258821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ae25-af59-4a62-a279-474a3ca1e4f6 None admin] RBAC: Adding query filter params (interface=admin, service_id=a29a15d2064b4686b66e1f88dcafdffd, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:57.259270 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ae25-af59-4a62-a279-474a3ca1e4f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:57.260706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ae25-af59-4a62-a279-474a3ca1e4f6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:57.270328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 476/971] 10.222.0.15 () {56 vars in 1249 bytes} [Sun Aug 7 22:20:57 2022] GET /identity/v3/endpoints?service_id=a29a15d2064b4686b66e1f88dcafdffd&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:57.271475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495978b-ec9e-4cb8-93f0-478f88b08e54 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:57.310566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f062f-1297-4901-8f0e-505bd877786d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:57.310850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f062f-1297-4901-8f0e-505bd877786d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:57.311153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f062f-1297-4901-8f0e-505bd877786d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:57.312627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 477/972] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:20:57.317511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c159-13a2-4df8-a777-d9f6736af593 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:57.317796 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c159-13a2-4df8-a777-d9f6736af593 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:57.318072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c159-13a2-4df8-a777-d9f6736af593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:57.336288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-19d7c159-13a2-4df8-a777-d9f6736af593 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:57.337481 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-19d7c159-13a2-4df8-a777-d9f6736af593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:57.369783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:57.370791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:57.380577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495978b-ec9e-4cb8-93f0-478f88b08e54 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:57.419129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 478/973] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:20:57.419648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f8939-fc0f-4fe9-9b45-d53bf54cf184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:57.419648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f8939-fc0f-4fe9-9b45-d53bf54cf184 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:57.419648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f8939-fc0f-4fe9-9b45-d53bf54cf184 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:57.419648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f8939-fc0f-4fe9-9b45-d53bf54cf184 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:57.419982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f8939-fc0f-4fe9-9b45-d53bf54cf184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:57.420060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f8939-fc0f-4fe9-9b45-d53bf54cf184 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:57.427386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 496/974] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 22:20:57 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:20:57.438940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c159-13a2-4df8-a777-d9f6736af593 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:57.550773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c159-13a2-4df8-a777-d9f6736af593 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:57.588733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46518212-9e36-4087-ad74-e7149b576733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:57.589357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46518212-9e36-4087-ad74-e7149b576733 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:57.589631 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46518212-9e36-4087-ad74-e7149b576733 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:57.589893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46518212-9e36-4087-ad74-e7149b576733 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:57.602407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46518212-9e36-4087-ad74-e7149b576733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-46518212-9e36-4087-ad74-e7149b576733 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:20:57.607004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:57.608160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:57.609214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 479/975] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Aug 7 22:20:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:57.616675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f8939-fc0f-4fe9-9b45-d53bf54cf184 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:57.671769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1235b4-6d74-41e5-9405-7d6b79bd5f1a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:57.672052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1235b4-6d74-41e5-9405-7d6b79bd5f1a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:57.672328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1235b4-6d74-41e5-9405-7d6b79bd5f1a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:57.673821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 480/976] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:20:57.680255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e0cb6-707e-42c0-8d61-864c4bc3f524 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:57.680535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e0cb6-707e-42c0-8d61-864c4bc3f524 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:57.680813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e0cb6-707e-42c0-8d61-864c4bc3f524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:57.701406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e75e0cb6-707e-42c0-8d61-864c4bc3f524 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:57.702905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e75e0cb6-707e-42c0-8d61-864c4bc3f524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:57.726579 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:57.731738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f8939-fc0f-4fe9-9b45-d53bf54cf184 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:57.769296 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cde898-1eee-4949-81bb-c839127f116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:57.770068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cde898-1eee-4949-81bb-c839127f116a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:57.770345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cde898-1eee-4949-81bb-c839127f116a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:57.770615 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cde898-1eee-4949-81bb-c839127f116a None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:57.771301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cde898-1eee-4949-81bb-c839127f116a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:57.771604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cde898-1eee-4949-81bb-c839127f116a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:57.775118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 481/977] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:20:57.775280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cde898-1eee-4949-81bb-c839127f116a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:57.789739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 497/978] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 22:20:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:57.792406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e0cb6-707e-42c0-8d61-864c4bc3f524 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:57.795315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cde898-1eee-4949-81bb-c839127f116a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:57.815518 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:57.898109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e0cb6-707e-42c0-8d61-864c4bc3f524 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:57.900440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cde898-1eee-4949-81bb-c839127f116a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:57.935160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bc223-2361-4bb3-b517-230399010100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:57.935887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bc223-2361-4bb3-b517-230399010100 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:57.936258 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bc223-2361-4bb3-b517-230399010100 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:57.936595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bc223-2361-4bb3-b517-230399010100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:57.936935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc332f-8eec-4992-9cd9-d6c20711bbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:57.937604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc332f-8eec-4992-9cd9-d6c20711bbe4 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:57.937948 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc332f-8eec-4992-9cd9-d6c20711bbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:57.938283 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc332f-8eec-4992-9cd9-d6c20711bbe4 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:57.939180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc332f-8eec-4992-9cd9-d6c20711bbe4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:57.940929 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc332f-8eec-4992-9cd9-d6c20711bbe4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:57.947659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bc223-2361-4bb3-b517-230399010100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:57.949381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bc223-2361-4bb3-b517-230399010100 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:57.957346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 498/979] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:20:57 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e22bc223-2361-4bb3-b517-230399010100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:57.964945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:57.966013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:57.966903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:57.966903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:57.966903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:57.971874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 482/980] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:57.973564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc332f-8eec-4992-9cd9-d6c20711bbe4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:58.065838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:58.099183 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc332f-8eec-4992-9cd9-d6c20711bbe4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:58.138523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34190a13-bcd8-42d6-925c-02358bc81138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:58.139218 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34190a13-bcd8-42d6-925c-02358bc81138 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:58.139499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34190a13-bcd8-42d6-925c-02358bc81138 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:58.139770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34190a13-bcd8-42d6-925c-02358bc81138 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:58.140459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34190a13-bcd8-42d6-925c-02358bc81138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:58.140764 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34190a13-bcd8-42d6-925c-02358bc81138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:58.142118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34190a13-bcd8-42d6-925c-02358bc81138 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:58.154843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 499/981] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:58.160853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bc223-2361-4bb3-b517-230399010100 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:58.175970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:58.264718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bc223-2361-4bb3-b517-230399010100 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:58.298744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dddb76-d5a2-486d-b268-ab4c9a55e455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:58.299449 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dddb76-d5a2-486d-b268-ab4c9a55e455 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:58.299727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dddb76-d5a2-486d-b268-ab4c9a55e455 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:58.299997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dddb76-d5a2-486d-b268-ab4c9a55e455 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:58.307552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dddb76-d5a2-486d-b268-ab4c9a55e455 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:58.308979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dddb76-d5a2-486d-b268-ab4c9a55e455 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-76dddb76-d5a2-486d-b268-ab4c9a55e455 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:20:58.320092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:58.321053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:58.322583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:58.322583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:58.322583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:20:58.322583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:20:58.322583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:20:58.322583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:20:58.322583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:20:58.322583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:20:58.322583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 22:20:58.322583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:20:58.326139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 483/982] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 22:20:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:58.327160 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34190a13-bcd8-42d6-925c-02358bc81138 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:58.430470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34190a13-bcd8-42d6-925c-02358bc81138 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:58.465280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a40ac-5b2c-46a6-8446-af318878b581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:58.465879 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a40ac-5b2c-46a6-8446-af318878b581 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:58.466152 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a40ac-5b2c-46a6-8446-af318878b581 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:58.466416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a40ac-5b2c-46a6-8446-af318878b581 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:58.467154 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a40ac-5b2c-46a6-8446-af318878b581 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:58.467458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a40ac-5b2c-46a6-8446-af318878b581 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:58.468855 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a40ac-5b2c-46a6-8446-af318878b581 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:58.470478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:58.488539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 500/983] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Aug 7 22:20:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:58.493933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dddb76-d5a2-486d-b268-ab4c9a55e455 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:58.567153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:58.600026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dddb76-d5a2-486d-b268-ab4c9a55e455 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:58.633560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e08be-1daf-4eb9-ade8-4eabb99b238f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:58.634160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e08be-1daf-4eb9-ade8-4eabb99b238f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:58.634435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e08be-1daf-4eb9-ade8-4eabb99b238f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:58.634703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e08be-1daf-4eb9-ade8-4eabb99b238f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:58.702650 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e08be-1daf-4eb9-ade8-4eabb99b238f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:58.704115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e08be-1daf-4eb9-ade8-4eabb99b238f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:58.770454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:58.807522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 484/984] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:20:58 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:20:58.809106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a40ac-5b2c-46a6-8446-af318878b581 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:58.910514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a40ac-5b2c-46a6-8446-af318878b581 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:58.944499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75f00-95c8-40f6-b4d9-c2e2d979e824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:58.945133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75f00-95c8-40f6-b4d9-c2e2d979e824 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:58.945423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75f00-95c8-40f6-b4d9-c2e2d979e824 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:58.945678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75f00-95c8-40f6-b4d9-c2e2d979e824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:58.956627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b75f00-95c8-40f6-b4d9-c2e2d979e824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:58.958114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b75f00-95c8-40f6-b4d9-c2e2d979e824 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-10b75f00-95c8-40f6-b4d9-c2e2d979e824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:20:58.973090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:58.974037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:20:58.974933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:20:58.974933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:20:58.974933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:58.978951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 501/985] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:58.980340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e08be-1daf-4eb9-ade8-4eabb99b238f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:59.091697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e08be-1daf-4eb9-ade8-4eabb99b238f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:59.126851 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa35ee4-21af-4b8b-84bd-787e36e287fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:59.128269 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa35ee4-21af-4b8b-84bd-787e36e287fa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:59.128540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa35ee4-21af-4b8b-84bd-787e36e287fa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:59.128804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa35ee4-21af-4b8b-84bd-787e36e287fa None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:59.129445 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa35ee4-21af-4b8b-84bd-787e36e287fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:59.129741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa35ee4-21af-4b8b-84bd-787e36e287fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:59.131118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa35ee4-21af-4b8b-84bd-787e36e287fa None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:59.147188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 485/986] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:59.148455 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75f00-95c8-40f6-b4d9-c2e2d979e824 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:59.196425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:59.252995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75f00-95c8-40f6-b4d9-c2e2d979e824 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:59.286258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98511c07-9736-46ce-8836-798629ea564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:59.286888 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511c07-9736-46ce-8836-798629ea564b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:59.287189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511c07-9736-46ce-8836-798629ea564b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:59.287459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511c07-9736-46ce-8836-798629ea564b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:59.293972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98511c07-9736-46ce-8836-798629ea564b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:59.295493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98511c07-9736-46ce-8836-798629ea564b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-98511c07-9736-46ce-8836-798629ea564b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:20:59.308625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:59.309555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:59.310469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:20:59.310469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:20:59.310469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:20:59.310469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:20:59.310469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:20:59.310469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:20:59.310469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:20:59.310469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:59.315157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 502/987] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:20:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:20:59.317014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa35ee4-21af-4b8b-84bd-787e36e287fa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:59.361064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:59.438946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5559a-f587-4d33-a9c7-07c6ec0a4881 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:59.439533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5559a-f587-4d33-a9c7-07c6ec0a4881 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:59.439533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5559a-f587-4d33-a9c7-07c6ec0a4881 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:59.441015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 503/988] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:20:59.445532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08233791-1217-49dc-95de-f4311d0fc094 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:59.445806 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08233791-1217-49dc-95de-f4311d0fc094 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:59.446071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08233791-1217-49dc-95de-f4311d0fc094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:59.446231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa35ee4-21af-4b8b-84bd-787e36e287fa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:59.463669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-08233791-1217-49dc-95de-f4311d0fc094 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:20:59.464745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-08233791-1217-49dc-95de-f4311d0fc094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:20:59.482322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b478f-151e-46fd-92d6-81eff6e92301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:59.482917 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b478f-151e-46fd-92d6-81eff6e92301 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:59.483225 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b478f-151e-46fd-92d6-81eff6e92301 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:59.483489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b478f-151e-46fd-92d6-81eff6e92301 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:59.484173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b478f-151e-46fd-92d6-81eff6e92301 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:59.484474 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b478f-151e-46fd-92d6-81eff6e92301 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:59.485877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b478f-151e-46fd-92d6-81eff6e92301 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:59.498651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 486/989] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:20:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:59.505680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b478f-151e-46fd-92d6-81eff6e92301 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:59.543251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 504/990] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:20:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:20:59.562770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08233791-1217-49dc-95de-f4311d0fc094 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:59.602673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:59.604237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:20:59.615246 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b478f-151e-46fd-92d6-81eff6e92301 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:59.650722 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d6d8c-398f-40cb-a01d-c83dbbc24abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:59.651352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d6d8c-398f-40cb-a01d-c83dbbc24abc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:59.651627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d6d8c-398f-40cb-a01d-c83dbbc24abc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:59.651907 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d6d8c-398f-40cb-a01d-c83dbbc24abc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:59.652651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d6d8c-398f-40cb-a01d-c83dbbc24abc None admin] RBAC: Adding query filter params (role.id=dbd98afdf4814f1b864d9da8e7861ca5, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=e44d9ab25b1444ed973079d988813b23) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:59.652958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d6d8c-398f-40cb-a01d-c83dbbc24abc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:59.654374 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d6d8c-398f-40cb-a01d-c83dbbc24abc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:59.661453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 487/991] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:20:59 2022] GET /identity/v3/role_assignments?user.id=e44d9ab25b1444ed973079d988813b23&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=dbd98afdf4814f1b864d9da8e7861ca5 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:20:59.681772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08233791-1217-49dc-95de-f4311d0fc094 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:59.724791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34255fff-7fbd-4802-91a7-caf1ffd15384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:59.725356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255fff-7fbd-4802-91a7-caf1ffd15384 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:59.725631 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255fff-7fbd-4802-91a7-caf1ffd15384 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:59.725897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255fff-7fbd-4802-91a7-caf1ffd15384 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:59.726481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34255fff-7fbd-4802-91a7-caf1ffd15384 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:59.727880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34255fff-7fbd-4802-91a7-caf1ffd15384 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-34255fff-7fbd-4802-91a7-caf1ffd15384 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:20:59.737902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:20:59.738955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:20:59.739826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 505/992] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 22:20:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:20:59.747685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d6d8c-398f-40cb-a01d-c83dbbc24abc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:20:59.853687 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d6d8c-398f-40cb-a01d-c83dbbc24abc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:20:59.889374 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e075b-293c-4b5d-9d14-f3dd74520e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:20:59.889973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e075b-293c-4b5d-9d14-f3dd74520e37 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:20:59.890244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e075b-293c-4b5d-9d14-f3dd74520e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:20:59.890509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e075b-293c-4b5d-9d14-f3dd74520e37 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:20:59.891206 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e075b-293c-4b5d-9d14-f3dd74520e37 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:20:59.891510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e075b-293c-4b5d-9d14-f3dd74520e37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:20:59.892858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e075b-293c-4b5d-9d14-f3dd74520e37 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:20:59.897957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 488/993] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 22:20:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:20:59.903447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34255fff-7fbd-4802-91a7-caf1ffd15384 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:00.009892 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:00.013823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34255fff-7fbd-4802-91a7-caf1ffd15384 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:00.029095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2377c-94a0-41c2-91c9-3e61849b057a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:00.029648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2377c-94a0-41c2-91c9-3e61849b057a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:00.029922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2377c-94a0-41c2-91c9-3e61849b057a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:00.031837 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 489/994] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:21:00.037434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba9a98-57b9-417c-afa9-0176c542c87a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:00.037713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba9a98-57b9-417c-afa9-0176c542c87a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:00.037981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba9a98-57b9-417c-afa9-0176c542c87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:00.049328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdfca4-43f2-4413-9e4e-7fa4b45bfd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:00.050462 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdfca4-43f2-4413-9e4e-7fa4b45bfd78 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:00.050737 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdfca4-43f2-4413-9e4e-7fa4b45bfd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:00.051001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdfca4-43f2-4413-9e4e-7fa4b45bfd78 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:00.051653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdfca4-43f2-4413-9e4e-7fa4b45bfd78 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:00.051954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdfca4-43f2-4413-9e4e-7fa4b45bfd78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:00.053411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdfca4-43f2-4413-9e4e-7fa4b45bfd78 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:00.056147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5cba9a98-57b9-417c-afa9-0176c542c87a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:00.057327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5cba9a98-57b9-417c-afa9-0176c542c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:00.063353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 506/995] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 22:20:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:00.064849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdfca4-43f2-4413-9e4e-7fa4b45bfd78 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:00.074822 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:00.133627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 490/996] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:00.155596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba9a98-57b9-417c-afa9-0176c542c87a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:00.171338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdfca4-43f2-4413-9e4e-7fa4b45bfd78 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:00.205841 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040d467-c3f3-40cd-b3ce-654943bccf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:00.206441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040d467-c3f3-40cd-b3ce-654943bccf81 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:00.206719 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040d467-c3f3-40cd-b3ce-654943bccf81 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:00.206985 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040d467-c3f3-40cd-b3ce-654943bccf81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:00.207662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040d467-c3f3-40cd-b3ce-654943bccf81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:00.209016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040d467-c3f3-40cd-b3ce-654943bccf81 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:00.235114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 507/997] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:21:00 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:21:00.265987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba9a98-57b9-417c-afa9-0176c542c87a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:00.310663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55003d02-8506-4d36-acbb-376e907780a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:00.311446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55003d02-8506-4d36-acbb-376e907780a8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:00.311729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55003d02-8506-4d36-acbb-376e907780a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:00.311994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55003d02-8506-4d36-acbb-376e907780a8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:00.312576 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55003d02-8506-4d36-acbb-376e907780a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:00.313943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55003d02-8506-4d36-acbb-376e907780a8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-55003d02-8506-4d36-acbb-376e907780a8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:00.324139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:00.325222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 22:21:00.326165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:00.330368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 491/998] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:21:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:21:00.332286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040d467-c3f3-40cd-b3ce-654943bccf81 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:00.359488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:00.450556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040d467-c3f3-40cd-b3ce-654943bccf81 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:00.483391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3786dd7-db1b-4ede-a61c-7e0c6c92d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:00.483991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3786dd7-db1b-4ede-a61c-7e0c6c92d101 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:00.484261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3786dd7-db1b-4ede-a61c-7e0c6c92d101 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:00.484525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3786dd7-db1b-4ede-a61c-7e0c6c92d101 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:00.485141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3786dd7-db1b-4ede-a61c-7e0c6c92d101 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:00.485435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3786dd7-db1b-4ede-a61c-7e0c6c92d101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:00.487304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3786dd7-db1b-4ede-a61c-7e0c6c92d101 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:00.492118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 508/999] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:21:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:00.497680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55003d02-8506-4d36-acbb-376e907780a8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:00.510299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:00.607846 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55003d02-8506-4d36-acbb-376e907780a8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:00.642096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcd348-f108-4403-9464-7643fdd5747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:00.642692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcd348-f108-4403-9464-7643fdd5747d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:00.642988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcd348-f108-4403-9464-7643fdd5747d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:00.643287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcd348-f108-4403-9464-7643fdd5747d None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:00.643912 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcd348-f108-4403-9464-7643fdd5747d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:00.644211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcd348-f108-4403-9464-7643fdd5747d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:00.645574 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcd348-f108-4403-9464-7643fdd5747d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:00.655146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 492/1000] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:21:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:00.656494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3786dd7-db1b-4ede-a61c-7e0c6c92d101 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:00.744893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:00.761977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3786dd7-db1b-4ede-a61c-7e0c6c92d101 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:00.795913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b900a3-712e-47f1-9af6-b95be4f96102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:00.796600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b900a3-712e-47f1-9af6-b95be4f96102 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:00.796942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b900a3-712e-47f1-9af6-b95be4f96102 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:00.797277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b900a3-712e-47f1-9af6-b95be4f96102 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:00.798101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b900a3-712e-47f1-9af6-b95be4f96102 None admin] RBAC: Adding query filter params (interface=public, service_id=9610bfb22f2f436eab39857e51d9d655, region_id=RegionOne) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:00.798472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b900a3-712e-47f1-9af6-b95be4f96102 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:00.800527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b900a3-712e-47f1-9af6-b95be4f96102 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:00.810349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 509/1001] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 22:21:00 2022] GET /identity/v3/endpoints?service_id=9610bfb22f2f436eab39857e51d9d655&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:00.811804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcd348-f108-4403-9464-7643fdd5747d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:00.885854 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:00.916593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcd348-f108-4403-9464-7643fdd5747d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:00.949762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7aa33b-4b00-4b53-9aa8-cb917a17befb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:00.950501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aa33b-4b00-4b53-9aa8-cb917a17befb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:00.950871 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aa33b-4b00-4b53-9aa8-cb917a17befb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:00.951264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aa33b-4b00-4b53-9aa8-cb917a17befb None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:00.951957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7aa33b-4b00-4b53-9aa8-cb917a17befb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:00.953416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7aa33b-4b00-4b53-9aa8-cb917a17befb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:00.967408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 493/1002] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 22:21:00 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:21:01.736857 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28731ed0-c0ab-440e-b58b-71fff25f55be None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:01.737383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28731ed0-c0ab-440e-b58b-71fff25f55be None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:01.737383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28731ed0-c0ab-440e-b58b-71fff25f55be None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:01.738749 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 510/1003] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:01.743696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b27d75-9a4f-4a15-9da2-f1405c0f5994 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:01.744088 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b27d75-9a4f-4a15-9da2-f1405c0f5994 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:01.744247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b27d75-9a4f-4a15-9da2-f1405c0f5994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:01.762644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b2b27d75-9a4f-4a15-9da2-f1405c0f5994 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:01.763840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b2b27d75-9a4f-4a15-9da2-f1405c0f5994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:01.829870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 494/1004] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:01.851772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28731ed0-c0ab-440e-b58b-71fff25f55be None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:01.953608 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28731ed0-c0ab-440e-b58b-71fff25f55be None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:01.994443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2614af0-983c-4405-b814-df111b7ebf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:01.995103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2614af0-983c-4405-b814-df111b7ebf1e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:01.995470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2614af0-983c-4405-b814-df111b7ebf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:01.995716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2614af0-983c-4405-b814-df111b7ebf1e None admin] PATH_INFO: `/v3/services/image` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:01.996300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2614af0-983c-4405-b814-df111b7ebf1e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:01.997646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2614af0-983c-4405-b814-df111b7ebf1e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-e2614af0-983c-4405-b814-df111b7ebf1e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:02.007364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:02.008403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 22:21:02.009250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:02.011431 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 511/1005] 10.222.0.15 () {56 vars in 1105 bytes} [Sun Aug 7 22:21:01 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:02.014316 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b27d75-9a4f-4a15-9da2-f1405c0f5994 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:02.083963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:02.119864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b27d75-9a4f-4a15-9da2-f1405c0f5994 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:02.153952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a31c0-39cc-46ec-b432-31716cd27e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:02.154550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a31c0-39cc-46ec-b432-31716cd27e18 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:02.154825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a31c0-39cc-46ec-b432-31716cd27e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:02.155110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a31c0-39cc-46ec-b432-31716cd27e18 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:02.155742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a31c0-39cc-46ec-b432-31716cd27e18 None admin] RBAC: Adding query filter params (name=image) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:02.156125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a31c0-39cc-46ec-b432-31716cd27e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:02.157479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a31c0-39cc-46ec-b432-31716cd27e18 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:02.166997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 495/1006] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:02.168259 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2614af0-983c-4405-b814-df111b7ebf1e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:02.186025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:02.268141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db84367-6add-41c8-a458-6c73df1604ad None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:02.268353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db84367-6add-41c8-a458-6c73df1604ad None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:02.268553 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db84367-6add-41c8-a458-6c73df1604ad None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:02.269892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 496/1007] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:02.274979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330a5ee-f4f2-4b39-87df-ebaf59d64315 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:02.275123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2614af0-983c-4405-b814-df111b7ebf1e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:02.275327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330a5ee-f4f2-4b39-87df-ebaf59d64315 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:02.275602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330a5ee-f4f2-4b39-87df-ebaf59d64315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:02.298584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d330a5ee-f4f2-4b39-87df-ebaf59d64315 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:02.301004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d330a5ee-f4f2-4b39-87df-ebaf59d64315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:02.310819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3c912-9a1a-470f-9d28-fdc1aa712a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:02.311447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3c912-9a1a-470f-9d28-fdc1aa712a8f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:02.311723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3c912-9a1a-470f-9d28-fdc1aa712a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:02.311992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3c912-9a1a-470f-9d28-fdc1aa712a8f None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:02.312614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3c912-9a1a-470f-9d28-fdc1aa712a8f None admin] RBAC: Adding query filter params (type=image) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:02.312942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3c912-9a1a-470f-9d28-fdc1aa712a8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:02.314251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3c912-9a1a-470f-9d28-fdc1aa712a8f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:02.318909 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 512/1008] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:02.385254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 497/1009] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:21:02.406305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3c912-9a1a-470f-9d28-fdc1aa712a8f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:02.495595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:02.517315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3c912-9a1a-470f-9d28-fdc1aa712a8f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:02.553020 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14514df9-a487-4fae-9af9-74c60dbf0015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:02.553648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14514df9-a487-4fae-9af9-74c60dbf0015 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:02.553923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14514df9-a487-4fae-9af9-74c60dbf0015 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:02.554190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14514df9-a487-4fae-9af9-74c60dbf0015 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:02.555319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14514df9-a487-4fae-9af9-74c60dbf0015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:02.556741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14514df9-a487-4fae-9af9-74c60dbf0015 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:02.563024 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 513/1010] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:02.564497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330a5ee-f4f2-4b39-87df-ebaf59d64315 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:02.624598 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:02.667776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330a5ee-f4f2-4b39-87df-ebaf59d64315 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:02.701513 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba1fdf-f49f-44a5-9705-f8e0a29b4e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:02.702256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba1fdf-f49f-44a5-9705-f8e0a29b4e7a None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:02.702454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba1fdf-f49f-44a5-9705-f8e0a29b4e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:02.702726 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba1fdf-f49f-44a5-9705-f8e0a29b4e7a None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:02.703430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba1fdf-f49f-44a5-9705-f8e0a29b4e7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:02.704879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba1fdf-f49f-44a5-9705-f8e0a29b4e7a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:02.739235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 498/1011] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:21:02 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:21:02.980388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3224d3e-dc99-4f86-a0fe-7dad49539c10 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:02.980914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3224d3e-dc99-4f86-a0fe-7dad49539c10 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:02.980914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3224d3e-dc99-4f86-a0fe-7dad49539c10 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:02.982353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 514/1012] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:02.987421 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fc5b3-a0c8-4864-bb54-1ab49b3a576f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:02.987845 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fc5b3-a0c8-4864-bb54-1ab49b3a576f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:02.988023 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fc5b3-a0c8-4864-bb54-1ab49b3a576f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:03.006757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ea5fc5b3-a0c8-4864-bb54-1ab49b3a576f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:03.007965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ea5fc5b3-a0c8-4864-bb54-1ab49b3a576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:03.076733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 499/1013] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:03.101726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3224d3e-dc99-4f86-a0fe-7dad49539c10 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:03.203811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3224d3e-dc99-4f86-a0fe-7dad49539c10 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:03.237710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761beb-bb54-4091-9e9a-da0880ef7242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:03.238310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761beb-bb54-4091-9e9a-da0880ef7242 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:03.238588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761beb-bb54-4091-9e9a-da0880ef7242 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:03.238853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761beb-bb54-4091-9e9a-da0880ef7242 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:03.239498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2761beb-bb54-4091-9e9a-da0880ef7242 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:03.240841 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2761beb-bb54-4091-9e9a-da0880ef7242 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-e2761beb-bb54-4091-9e9a-da0880ef7242 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:03.249774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:03.250762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 22:21:03.251673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:03.255435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 515/1014] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:21:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:03.257475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fc5b3-a0c8-4864-bb54-1ab49b3a576f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:03.300686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:03.358793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fc5b3-a0c8-4864-bb54-1ab49b3a576f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:03.397031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ae4ce-baa0-4a95-a896-9756782e5f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:03.397630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae4ce-baa0-4a95-a896-9756782e5f3d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:03.397904 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae4ce-baa0-4a95-a896-9756782e5f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:03.398170 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae4ce-baa0-4a95-a896-9756782e5f3d None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:03.398802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ae4ce-baa0-4a95-a896-9756782e5f3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:03.399121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ae4ce-baa0-4a95-a896-9756782e5f3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:03.400484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ae4ce-baa0-4a95-a896-9756782e5f3d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:03.407608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 500/1015] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:21:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:03.411361 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761beb-bb54-4091-9e9a-da0880ef7242 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:03.425188 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:03.518617 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761beb-bb54-4091-9e9a-da0880ef7242 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:03.551519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258fde6-0570-41c6-aa1f-4f409dd7aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:03.552119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258fde6-0570-41c6-aa1f-4f409dd7aacc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:03.552393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258fde6-0570-41c6-aa1f-4f409dd7aacc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:03.552657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258fde6-0570-41c6-aa1f-4f409dd7aacc None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:03.553272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258fde6-0570-41c6-aa1f-4f409dd7aacc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:03.553570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258fde6-0570-41c6-aa1f-4f409dd7aacc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:03.554899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258fde6-0570-41c6-aa1f-4f409dd7aacc None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:03.563130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 516/1016] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 22:21:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:03.566222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ae4ce-baa0-4a95-a896-9756782e5f3d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:03.667826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ae4ce-baa0-4a95-a896-9756782e5f3d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:03.675448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:03.706561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80e8b-4e45-47ec-94d7-778c1a436c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:03.707538 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80e8b-4e45-47ec-94d7-778c1a436c29 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:03.708042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80e8b-4e45-47ec-94d7-778c1a436c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:03.708537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80e8b-4e45-47ec-94d7-778c1a436c29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:03.709232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b80e8b-4e45-47ec-94d7-778c1a436c29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:03.711060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b80e8b-4e45-47ec-94d7-778c1a436c29 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:03.739527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 501/1017] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:21:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:21:04.334041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19346659-9806-4ff5-83b6-edb9873ad15c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:04.334565 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19346659-9806-4ff5-83b6-edb9873ad15c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:04.334565 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19346659-9806-4ff5-83b6-edb9873ad15c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:04.335964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 517/1018] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:04.341006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93158270-d0da-4f1c-9538-625c3c786d30 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:04.341431 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93158270-d0da-4f1c-9538-625c3c786d30 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:04.341618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93158270-d0da-4f1c-9538-625c3c786d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:04.360348 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-93158270-d0da-4f1c-9538-625c3c786d30 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:04.361520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-93158270-d0da-4f1c-9538-625c3c786d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:04.436291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 502/1019] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:04 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:04.458343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19346659-9806-4ff5-83b6-edb9873ad15c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:04.534447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:04.561407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19346659-9806-4ff5-83b6-edb9873ad15c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:04.595655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64485c-7303-4995-a870-cc8261c9e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:04.596179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64485c-7303-4995-a870-cc8261c9e51d None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:04.596453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64485c-7303-4995-a870-cc8261c9e51d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:04.596716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64485c-7303-4995-a870-cc8261c9e51d None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:04.597400 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64485c-7303-4995-a870-cc8261c9e51d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:04.598762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64485c-7303-4995-a870-cc8261c9e51d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:04.614607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 518/1020] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:21:04 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:21:04.791025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd272c-d75b-4755-837f-2313ff2cc571 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:04.791394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd272c-d75b-4755-837f-2313ff2cc571 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:04.791599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd272c-d75b-4755-837f-2313ff2cc571 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:04.793081 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 503/1021] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:04.798106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33614f-14b8-4a9b-911a-544584f16085 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:04.798391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33614f-14b8-4a9b-911a-544584f16085 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:04.798662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33614f-14b8-4a9b-911a-544584f16085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:04.817345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-df33614f-14b8-4a9b-911a-544584f16085 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:04.818516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-df33614f-14b8-4a9b-911a-544584f16085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:04.891251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 519/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:04.916224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd272c-d75b-4755-837f-2313ff2cc571 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:05.016303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:05.031622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd272c-d75b-4755-837f-2313ff2cc571 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:05.073534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb3ec-2b16-42c8-b6fe-10a6983c6027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:05.074161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb3ec-2b16-42c8-b6fe-10a6983c6027 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:05.074434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb3ec-2b16-42c8-b6fe-10a6983c6027 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:05.074702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb3ec-2b16-42c8-b6fe-10a6983c6027 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:05.075911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdb3ec-2b16-42c8-b6fe-10a6983c6027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:05.077330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdb3ec-2b16-42c8-b6fe-10a6983c6027 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:05.080277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 504/1023] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:05.084756 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33614f-14b8-4a9b-911a-544584f16085 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:05.145130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:05.187332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33614f-14b8-4a9b-911a-544584f16085 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:05.221659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5632ba0-17d0-44ef-b869-3523796d0f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:05.222246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5632ba0-17d0-44ef-b869-3523796d0f8e None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:05.222580 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5632ba0-17d0-44ef-b869-3523796d0f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:05.222855 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5632ba0-17d0-44ef-b869-3523796d0f8e None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:05.223523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5632ba0-17d0-44ef-b869-3523796d0f8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:05.224928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5632ba0-17d0-44ef-b869-3523796d0f8e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:05.247820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 520/1024] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:21:05 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:21:05.857945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a04747-fd4c-4f09-8e29-e8e2e3bfd757 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:05.858472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a04747-fd4c-4f09-8e29-e8e2e3bfd757 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:05.858472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a04747-fd4c-4f09-8e29-e8e2e3bfd757 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:05.859996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 505/1025] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:05.865498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3395923-529d-4bd1-bb61-1c05beb326b1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:05.865915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3395923-529d-4bd1-bb61-1c05beb326b1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:05.866089 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3395923-529d-4bd1-bb61-1c05beb326b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:05.884506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c3395923-529d-4bd1-bb61-1c05beb326b1 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:05.885668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c3395923-529d-4bd1-bb61-1c05beb326b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:05.952312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 521/1026] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:05.975132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a04747-fd4c-4f09-8e29-e8e2e3bfd757 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:06.083649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a04747-fd4c-4f09-8e29-e8e2e3bfd757 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:06.117458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be6ab1-e7de-45b5-9045-5c8c68b1f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:06.118009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be6ab1-e7de-45b5-9045-5c8c68b1f5fd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:06.118283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be6ab1-e7de-45b5-9045-5c8c68b1f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:06.118552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be6ab1-e7de-45b5-9045-5c8c68b1f5fd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:06.128753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be6ab1-e7de-45b5-9045-5c8c68b1f5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f6be6ab1-e7de-45b5-9045-5c8c68b1f5fd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:21:06.133451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:06.134439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:06.135683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:06.135683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:06.135683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:06.135683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:06.135683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:21:06.135683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:21:06.135683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:21:06.135683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:21:06.135683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:21:06.135683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:21:06.135683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 22:21:06.135683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:06.139162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 506/1027] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Aug 7 22:21:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:06.140797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3395923-529d-4bd1-bb61-1c05beb326b1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:06.187225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:06.240600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3395923-529d-4bd1-bb61-1c05beb326b1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:06.273985 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58263f38-390a-4c88-b20a-4ec027759f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:06.274583 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58263f38-390a-4c88-b20a-4ec027759f61 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:06.274858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58263f38-390a-4c88-b20a-4ec027759f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:06.275144 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58263f38-390a-4c88-b20a-4ec027759f61 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:06.275798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58263f38-390a-4c88-b20a-4ec027759f61 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:06.276098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58263f38-390a-4c88-b20a-4ec027759f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:06.277448 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58263f38-390a-4c88-b20a-4ec027759f61 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:06.290479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 522/1028] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 22:21:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:06.291640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be6ab1-e7de-45b5-9045-5c8c68b1f5fd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:06.310690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:06.395356 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be6ab1-e7de-45b5-9045-5c8c68b1f5fd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:06.431194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adfcc0-9002-4297-9805-757eb13bba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:06.431817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adfcc0-9002-4297-9805-757eb13bba0e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:06.432094 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adfcc0-9002-4297-9805-757eb13bba0e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:06.432360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adfcc0-9002-4297-9805-757eb13bba0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:06.442347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adfcc0-9002-4297-9805-757eb13bba0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:06.443811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adfcc0-9002-4297-9805-757eb13bba0e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-57adfcc0-9002-4297-9805-757eb13bba0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:21:06.458509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:06.464355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:21:06.465263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:21:06.465263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:06.465263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:06.465263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 507/1029] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:21:06.466520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58263f38-390a-4c88-b20a-4ec027759f61 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:06.566938 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58263f38-390a-4c88-b20a-4ec027759f61 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:06.575697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:06.602115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a58d83-582a-4b97-b4ba-6cab702a0dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:06.602718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a58d83-582a-4b97-b4ba-6cab702a0dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:06.602992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a58d83-582a-4b97-b4ba-6cab702a0dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:06.603287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a58d83-582a-4b97-b4ba-6cab702a0dc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:06.603921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a58d83-582a-4b97-b4ba-6cab702a0dc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:06.604219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a58d83-582a-4b97-b4ba-6cab702a0dc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:06.605569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a58d83-582a-4b97-b4ba-6cab702a0dc9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:06.621613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 523/1030] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:06.623065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adfcc0-9002-4297-9805-757eb13bba0e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:06.635943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750f6ad-f01f-4240-b794-6a02d631093a None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:06.636224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750f6ad-f01f-4240-b794-6a02d631093a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:06.636495 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750f6ad-f01f-4240-b794-6a02d631093a None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:06.638046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 524/1031] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:21:06.642642 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e45a9-acf6-4ca4-875c-92ebb9e684b3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:06.642918 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e45a9-acf6-4ca4-875c-92ebb9e684b3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:06.643735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e45a9-acf6-4ca4-875c-92ebb9e684b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:06.661804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-015e45a9-acf6-4ca4-875c-92ebb9e684b3 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:06.662910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-015e45a9-acf6-4ca4-875c-92ebb9e684b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:06.695732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:06.734361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adfcc0-9002-4297-9805-757eb13bba0e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:06.739404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 525/1032] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:21:06.753065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e45a9-acf6-4ca4-875c-92ebb9e684b3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:06.776227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f197b2a-cbf4-425d-9263-154bcec9b2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:06.776851 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f197b2a-cbf4-425d-9263-154bcec9b2db None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:06.777128 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f197b2a-cbf4-425d-9263-154bcec9b2db None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:06.777398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f197b2a-cbf4-425d-9263-154bcec9b2db None admin] PATH_INFO: `/v3/users/nova` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:06.785536 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f197b2a-cbf4-425d-9263-154bcec9b2db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:06.786962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f197b2a-cbf4-425d-9263-154bcec9b2db None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-6f197b2a-cbf4-425d-9263-154bcec9b2db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:21:06.797850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:06.798992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:06.799992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:06.799992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:06.799992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:21:06.799992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:21:06.799992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:21:06.799992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:21:06.799992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:21:06.799992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:21:06.799992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:21:06.799992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:06.799992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 508/1033] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 22:21:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:21:06.805173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f197b2a-cbf4-425d-9263-154bcec9b2db None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:06.859148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:06.864030 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e45a9-acf6-4ca4-875c-92ebb9e684b3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:06.902215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a90ff-b250-4837-91d3-05d3beb597e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:06.902901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a90ff-b250-4837-91d3-05d3beb597e3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:06.903129 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a90ff-b250-4837-91d3-05d3beb597e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:06.903419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a90ff-b250-4837-91d3-05d3beb597e3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:06.904003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a90ff-b250-4837-91d3-05d3beb597e3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:06.905348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a90ff-b250-4837-91d3-05d3beb597e3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:06.913109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f197b2a-cbf4-425d-9263-154bcec9b2db None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-0c6a90ff-b250-4837-91d3-05d3beb597e3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:06.914082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:06.915046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:06.916648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 526/1034] 10.222.0.15 () {56 vars in 1105 bytes} [Sun Aug 7 22:21:06 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:21:06.920925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a90ff-b250-4837-91d3-05d3beb597e3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:06.945366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:06.954399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b38d4-ce0c-4ae5-9968-8d0817a0cbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:06.955017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b38d4-ce0c-4ae5-9968-8d0817a0cbde None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:06.955319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b38d4-ce0c-4ae5-9968-8d0817a0cbde None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:06.956148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b38d4-ce0c-4ae5-9968-8d0817a0cbde None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:06.956910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b38d4-ce0c-4ae5-9968-8d0817a0cbde None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:06.957222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b38d4-ce0c-4ae5-9968-8d0817a0cbde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:06.958644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b38d4-ce0c-4ae5-9968-8d0817a0cbde None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:06.976384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 509/1035] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 22:21:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:06.982093 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b38d4-ce0c-4ae5-9968-8d0817a0cbde None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:07.036202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a90ff-b250-4837-91d3-05d3beb597e3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:07.071797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3bacc-2e30-4615-994c-5a239b2dc337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:07.072401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3bacc-2e30-4615-994c-5a239b2dc337 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.072676 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3bacc-2e30-4615-994c-5a239b2dc337 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.072942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3bacc-2e30-4615-994c-5a239b2dc337 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.073565 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3bacc-2e30-4615-994c-5a239b2dc337 None admin] RBAC: Adding query filter params (name=image) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:07.073863 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3bacc-2e30-4615-994c-5a239b2dc337 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:07.075241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3bacc-2e30-4615-994c-5a239b2dc337 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:07.085091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 527/1036] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:07.086088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3bacc-2e30-4615-994c-5a239b2dc337 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:07.097827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b38d4-ce0c-4ae5-9968-8d0817a0cbde None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:07.116411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:07.133332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a87a9-5e8c-43c1-b780-8683f979d4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:07.133940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a87a9-5e8c-43c1-b780-8683f979d4ea None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.134220 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a87a9-5e8c-43c1-b780-8683f979d4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.134487 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a87a9-5e8c-43c1-b780-8683f979d4ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.192355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:07.198932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3bacc-2e30-4615-994c-5a239b2dc337 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:07.206520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a87a9-5e8c-43c1-b780-8683f979d4ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:07.208005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a87a9-5e8c-43c1-b780-8683f979d4ea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:07.233328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b02d6-3237-4503-bda4-2d12d2cc5032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:07.233931 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b02d6-3237-4503-bda4-2d12d2cc5032 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.234205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b02d6-3237-4503-bda4-2d12d2cc5032 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.234728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b02d6-3237-4503-bda4-2d12d2cc5032 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.235112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b02d6-3237-4503-bda4-2d12d2cc5032 None admin] RBAC: Adding query filter params (type=image) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:07.235418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b02d6-3237-4503-bda4-2d12d2cc5032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:07.237265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b02d6-3237-4503-bda4-2d12d2cc5032 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:07.242628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 528/1037] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:07.248058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b02d6-3237-4503-bda4-2d12d2cc5032 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:07.312028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 510/1038] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:21:06 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 22:21:07.314502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d7b57-7556-4d13-a84b-fdd8127814f1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.314783 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d7b57-7556-4d13-a84b-fdd8127814f1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.315707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d7b57-7556-4d13-a84b-fdd8127814f1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.317193 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 511/1039] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:21:07.317891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d7b57-7556-4d13-a84b-fdd8127814f1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:07.346142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:07.356139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b02d6-3237-4503-bda4-2d12d2cc5032 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:07.390259 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12b2d5-8668-4275-b359-666fc2181d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:07.390853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12b2d5-8668-4275-b359-666fc2181d17 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.391153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12b2d5-8668-4275-b359-666fc2181d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.391422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12b2d5-8668-4275-b359-666fc2181d17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.392109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12b2d5-8668-4275-b359-666fc2181d17 None admin] RBAC: Adding query filter params (interface=public, service_id=950eda3400db4035b1dd5f239be28881, region_id=RegionOne) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:07.392412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12b2d5-8668-4275-b359-666fc2181d17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:07.393801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12b2d5-8668-4275-b359-666fc2181d17 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:07.398812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 529/1040] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 22:21:07 2022] GET /identity/v3/endpoints?service_id=950eda3400db4035b1dd5f239be28881&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:07.399992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc693e7-2643-4547-ba26-450b3305dc71 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.400285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc693e7-2643-4547-ba26-450b3305dc71 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.400544 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc693e7-2643-4547-ba26-450b3305dc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.405552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:07.418011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6cc693e7-2643-4547-ba26-450b3305dc71 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:07.418757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d7b57-7556-4d13-a84b-fdd8127814f1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:07.419323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6cc693e7-2643-4547-ba26-450b3305dc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:07.455699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da380b4f-e948-487c-8f08-692596a64643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:07.456253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da380b4f-e948-487c-8f08-692596a64643 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.456531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da380b4f-e948-487c-8f08-692596a64643 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.456800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da380b4f-e948-487c-8f08-692596a64643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.467010 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da380b4f-e948-487c-8f08-692596a64643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:07.468476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da380b4f-e948-487c-8f08-692596a64643 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-da380b4f-e948-487c-8f08-692596a64643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:21:07.482658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:07.483744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:21:07.484645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:21:07.484645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:07.484645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:07.484645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 512/1041] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:07.484645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da380b4f-e948-487c-8f08-692596a64643 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:07.485465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 530/1042] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:07.490040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc693e7-2643-4547-ba26-450b3305dc71 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:07.577247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:07.587471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da380b4f-e948-487c-8f08-692596a64643 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:07.593169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc693e7-2643-4547-ba26-450b3305dc71 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:07.620771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f2de7-b466-46b8-9db2-3244092981a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:07.621371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f2de7-b466-46b8-9db2-3244092981a8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.621641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f2de7-b466-46b8-9db2-3244092981a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.621916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f2de7-b466-46b8-9db2-3244092981a8 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.622512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f2de7-b466-46b8-9db2-3244092981a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:07.623890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f2de7-b466-46b8-9db2-3244092981a8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:07.627147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428a8c8-7ca5-44d4-aeac-7ce14eec9633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:07.628023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428a8c8-7ca5-44d4-aeac-7ce14eec9633 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.628299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428a8c8-7ca5-44d4-aeac-7ce14eec9633 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.628564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428a8c8-7ca5-44d4-aeac-7ce14eec9633 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.629190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428a8c8-7ca5-44d4-aeac-7ce14eec9633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:07.629491 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428a8c8-7ca5-44d4-aeac-7ce14eec9633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:07.630564 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 513/1043] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 22:21:07 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:21:07.630821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428a8c8-7ca5-44d4-aeac-7ce14eec9633 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:07.631282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f2de7-b466-46b8-9db2-3244092981a8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:07.634477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:07.642764 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 531/1044] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:07.651571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428a8c8-7ca5-44d4-aeac-7ce14eec9633 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:07.760842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f2de7-b466-46b8-9db2-3244092981a8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:07.765293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428a8c8-7ca5-44d4-aeac-7ce14eec9633 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:07.809097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8198deb-2a5b-43ed-b430-938735c714c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:07.809724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8198deb-2a5b-43ed-b430-938735c714c7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.809993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8198deb-2a5b-43ed-b430-938735c714c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.810256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8198deb-2a5b-43ed-b430-938735c714c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.811299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d3b07-e44f-458e-816c-29dac6681eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:07.812045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d3b07-e44f-458e-816c-29dac6681eab None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.812203 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d3b07-e44f-458e-816c-29dac6681eab None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.812474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d3b07-e44f-458e-816c-29dac6681eab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.819775 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d3b07-e44f-458e-816c-29dac6681eab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:07.821242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d3b07-e44f-458e-816c-29dac6681eab None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:07.822495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8198deb-2a5b-43ed-b430-938735c714c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b8198deb-2a5b-43ed-b430-938735c714c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:21:07.827249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:07.828171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:07.828990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 514/1045] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:21:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:07.834291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8198deb-2a5b-43ed-b430-938735c714c7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a50d3b07-e44f-458e-816c-29dac6681eab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:21:07.835404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:07.836236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:07.837110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:21:07.837110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:21:07.837110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:21:07.837110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:21:07.837110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:21:07.837110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:21:07.837110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:21:07.837110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:07.837110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 532/1046] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:21:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:21:07.842149 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d3b07-e44f-458e-816c-29dac6681eab None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:07.845819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:07.900641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:07.941695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8198deb-2a5b-43ed-b430-938735c714c7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:07.951278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d3b07-e44f-458e-816c-29dac6681eab None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:07.977943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04cf58-c93b-47db-b96e-f9efed16b00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:07.978545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04cf58-c93b-47db-b96e-f9efed16b00a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.978820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04cf58-c93b-47db-b96e-f9efed16b00a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.979106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04cf58-c93b-47db-b96e-f9efed16b00a None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.979776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04cf58-c93b-47db-b96e-f9efed16b00a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:07.980077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04cf58-c93b-47db-b96e-f9efed16b00a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:07.981430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04cf58-c93b-47db-b96e-f9efed16b00a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:07.993795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 515/1047] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:21:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:07.995829 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4846b-7c3c-4d88-9d19-dc8db219fcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:07.996438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4846b-7c3c-4d88-9d19-dc8db219fcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:07.996713 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4846b-7c3c-4d88-9d19-dc8db219fcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:07.996976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4846b-7c3c-4d88-9d19-dc8db219fcb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:07.997697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4846b-7c3c-4d88-9d19-dc8db219fcb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:07.997967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4846b-7c3c-4d88-9d19-dc8db219fcb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:07.999000 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04cf58-c93b-47db-b96e-f9efed16b00a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:07.999399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4846b-7c3c-4d88-9d19-dc8db219fcb0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:08.013630 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 533/1048] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:21:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:08.019973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4846b-7c3c-4d88-9d19-dc8db219fcb0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:08.083687 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:08.112750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04cf58-c93b-47db-b96e-f9efed16b00a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:08.123733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4846b-7c3c-4d88-9d19-dc8db219fcb0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:08.139195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:08.151448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801c7de-f8bf-4112-8fbc-a155a8032f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:08.152068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801c7de-f8bf-4112-8fbc-a155a8032f4a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:08.152340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801c7de-f8bf-4112-8fbc-a155a8032f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:08.152607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801c7de-f8bf-4112-8fbc-a155a8032f4a None admin] PATH_INFO: `/v3/users/ea078da3f15f44bb8bf1df3782c97ecf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:08.159207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33df6d-a9cb-4289-bc1e-336b2a7a84de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:08.159804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33df6d-a9cb-4289-bc1e-336b2a7a84de None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:08.160078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33df6d-a9cb-4289-bc1e-336b2a7a84de None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:08.160749 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33df6d-a9cb-4289-bc1e-336b2a7a84de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:08.161474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33df6d-a9cb-4289-bc1e-336b2a7a84de None admin] RBAC: Adding query filter params (role.id=dbd98afdf4814f1b864d9da8e7861ca5, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=cc8bf701e94c403ab70fcffaeb81b65b) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:08.161780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33df6d-a9cb-4289-bc1e-336b2a7a84de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:08.163222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33df6d-a9cb-4289-bc1e-336b2a7a84de None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:08.169432 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801c7de-f8bf-4112-8fbc-a155a8032f4a None admin] RBAC: Authorizing `identity:get_user(user_id=ea078da3f15f44bb8bf1df3782c97ecf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:08.179751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 534/1049] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:21:08 2022] GET /identity/v3/role_assignments?user.id=cc8bf701e94c403ab70fcffaeb81b65b&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=dbd98afdf4814f1b864d9da8e7861ca5 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:08.179944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801c7de-f8bf-4112-8fbc-a155a8032f4a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:08.179944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 516/1050] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:07 2022] GET /identity/v3/users/ea078da3f15f44bb8bf1df3782c97ecf => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:08.180708 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33df6d-a9cb-4289-bc1e-336b2a7a84de None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:08.291788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33df6d-a9cb-4289-bc1e-336b2a7a84de None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:08.319930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:08.330165 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d3281-5931-44e4-9df3-75b1a06d34ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:08.331117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3281-5931-44e4-9df3-75b1a06d34ed None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:08.331117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3281-5931-44e4-9df3-75b1a06d34ed None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:08.331315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3281-5931-44e4-9df3-75b1a06d34ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:08.404127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d3281-5931-44e4-9df3-75b1a06d34ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:08.405552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d3281-5931-44e4-9df3-75b1a06d34ed None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:08.503128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 535/1051] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:21:08 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 22:21:08.508782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801c7de-f8bf-4112-8fbc-a155a8032f4a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:08.607049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801c7de-f8bf-4112-8fbc-a155a8032f4a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:08.642222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8872dbc-df50-4a14-9a2d-c2adb8e00dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:08.642833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8872dbc-df50-4a14-9a2d-c2adb8e00dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:08.643664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8872dbc-df50-4a14-9a2d-c2adb8e00dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:08.643930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8872dbc-df50-4a14-9a2d-c2adb8e00dc3 None admin] PATH_INFO: `/v3/projects/10efcf0404a0473d9014b930ef11e96c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:08.645028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8872dbc-df50-4a14-9a2d-c2adb8e00dc3 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcf0404a0473d9014b930ef11e96c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:08.646429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8872dbc-df50-4a14-9a2d-c2adb8e00dc3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:08.648225 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 517/1052] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:21:08 2022] GET /identity/v3/projects/10efcf0404a0473d9014b930ef11e96c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:08.654046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d3281-5931-44e4-9df3-75b1a06d34ed None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:08.683381 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:08.759883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d3281-5931-44e4-9df3-75b1a06d34ed None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:08.795215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87162c16-02df-4d61-bb03-177a0ae050b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:08.795876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87162c16-02df-4d61-bb03-177a0ae050b5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:08.796155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87162c16-02df-4d61-bb03-177a0ae050b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:08.796429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87162c16-02df-4d61-bb03-177a0ae050b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:08.797146 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87162c16-02df-4d61-bb03-177a0ae050b5 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=10efcf0404a0473d9014b930ef11e96c, user.id=ea078da3f15f44bb8bf1df3782c97ecf) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:08.797506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87162c16-02df-4d61-bb03-177a0ae050b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:08.798974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87162c16-02df-4d61-bb03-177a0ae050b5 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:08.811169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 536/1053] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:21:08 2022] GET /identity/v3/role_assignments?user.id=ea078da3f15f44bb8bf1df3782c97ecf&scope.project.id=10efcf0404a0473d9014b930ef11e96c&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:09.637530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0615d-4711-471b-9e64-2a4a662c447b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:09.638051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0615d-4711-471b-9e64-2a4a662c447b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:09.638051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0615d-4711-471b-9e64-2a4a662c447b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:09.639455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 518/1054] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:09.644419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93af5-d0a3-41d5-98cd-8761502e581b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:09.644831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93af5-d0a3-41d5-98cd-8761502e581b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:09.645000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93af5-d0a3-41d5-98cd-8761502e581b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:09.662826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d8e93af5-d0a3-41d5-98cd-8761502e581b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:09.664027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d8e93af5-d0a3-41d5-98cd-8761502e581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:09.732728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 537/1055] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:09.755847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0615d-4711-471b-9e64-2a4a662c447b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:09.807020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:09.863019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0615d-4711-471b-9e64-2a4a662c447b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:09.899224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3afcd6-2535-4ae8-9c43-0ba13b384140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:09.899767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3afcd6-2535-4ae8-9c43-0ba13b384140 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:09.900041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3afcd6-2535-4ae8-9c43-0ba13b384140 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:09.900309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3afcd6-2535-4ae8-9c43-0ba13b384140 None admin] PATH_INFO: `/v3/services/image` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:09.900892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3afcd6-2535-4ae8-9c43-0ba13b384140 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:09.902236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3afcd6-2535-4ae8-9c43-0ba13b384140 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9d3afcd6-2535-4ae8-9c43-0ba13b384140 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:09.911430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:09.912406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:09.913257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 519/1056] 10.222.0.15 () {56 vars in 1105 bytes} [Sun Aug 7 22:21:09 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:09.920038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e93af5-d0a3-41d5-98cd-8761502e581b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:09.944765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:10.033583 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e93af5-d0a3-41d5-98cd-8761502e581b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:10.069008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c349dd6-0a3b-477a-8441-152e9ff4f057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:10.069613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c349dd6-0a3b-477a-8441-152e9ff4f057 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:10.069891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c349dd6-0a3b-477a-8441-152e9ff4f057 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:10.070160 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c349dd6-0a3b-477a-8441-152e9ff4f057 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:10.070783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c349dd6-0a3b-477a-8441-152e9ff4f057 None admin] RBAC: Adding query filter params (name=image) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:10.071110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c349dd6-0a3b-477a-8441-152e9ff4f057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:10.072453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c349dd6-0a3b-477a-8441-152e9ff4f057 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:10.077570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 538/1057] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:10.083097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3afcd6-2535-4ae8-9c43-0ba13b384140 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:10.149175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961d470-7c7c-4570-a213-877be19f95af None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:10.149552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961d470-7c7c-4570-a213-877be19f95af None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:10.149725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961d470-7c7c-4570-a213-877be19f95af None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:10.151106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 539/1058] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:21:10.155674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee60850-1240-41a6-b276-29a42bf4a1a4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:10.155954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee60850-1240-41a6-b276-29a42bf4a1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:10.156222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee60850-1240-41a6-b276-29a42bf4a1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:10.175184 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4ee60850-1240-41a6-b276-29a42bf4a1a4 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:10.176351 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4ee60850-1240-41a6-b276-29a42bf4a1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:10.184508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3afcd6-2535-4ae8-9c43-0ba13b384140 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:10.198012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:10.220680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897440-eac7-489c-b1cf-3fa3a8771709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:10.221828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897440-eac7-489c-b1cf-3fa3a8771709 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:10.222104 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897440-eac7-489c-b1cf-3fa3a8771709 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:10.222371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897440-eac7-489c-b1cf-3fa3a8771709 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:10.222995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3897440-eac7-489c-b1cf-3fa3a8771709 None admin] RBAC: Adding query filter params (type=image) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:10.223326 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3897440-eac7-489c-b1cf-3fa3a8771709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:10.224695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3897440-eac7-489c-b1cf-3fa3a8771709 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:10.229478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 520/1059] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:10.235005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897440-eac7-489c-b1cf-3fa3a8771709 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:10.249199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 540/1060] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:21:10.272649 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee60850-1240-41a6-b276-29a42bf4a1a4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:10.289923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:10.341349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897440-eac7-489c-b1cf-3fa3a8771709 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:10.376448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2c79d-0177-4741-8819-861a54451647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:10.377042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2c79d-0177-4741-8819-861a54451647 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:10.377173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee60850-1240-41a6-b276-29a42bf4a1a4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:10.377737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2c79d-0177-4741-8819-861a54451647 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:10.378540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2c79d-0177-4741-8819-861a54451647 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:10.379256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2c79d-0177-4741-8819-861a54451647 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:10.380599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2c79d-0177-4741-8819-861a54451647 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:10.402369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 521/1061] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:21:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:21:10.424388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0bc7a-6944-4f71-92ad-8417f2833497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:10.425038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0bc7a-6944-4f71-92ad-8417f2833497 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:10.425311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0bc7a-6944-4f71-92ad-8417f2833497 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:10.425574 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0bc7a-6944-4f71-92ad-8417f2833497 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:10.437772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0bc7a-6944-4f71-92ad-8417f2833497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-24c0bc7a-6944-4f71-92ad-8417f2833497 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:21:10.442606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:10.443791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:10.450277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 541/1062] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Aug 7 22:21:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:21:10.452613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2c79d-0177-4741-8819-861a54451647 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:10.492996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:10.568986 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2c79d-0177-4741-8819-861a54451647 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:10.604160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1c9c9-a3bd-4607-ba62-336227e8707e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:10.604757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1c9c9-a3bd-4607-ba62-336227e8707e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:10.605029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1c9c9-a3bd-4607-ba62-336227e8707e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:10.605291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1c9c9-a3bd-4607-ba62-336227e8707e None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:10.605943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1c9c9-a3bd-4607-ba62-336227e8707e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:10.606238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1c9c9-a3bd-4607-ba62-336227e8707e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:10.607615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1c9c9-a3bd-4607-ba62-336227e8707e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:10.616804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 522/1063] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 22:21:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:10.622367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0bc7a-6944-4f71-92ad-8417f2833497 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:10.696569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:10.727453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0bc7a-6944-4f71-92ad-8417f2833497 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:10.761791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c750feb-c8a6-4d9e-ba17-da2e839c377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:10.762412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c750feb-c8a6-4d9e-ba17-da2e839c377c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:10.762709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c750feb-c8a6-4d9e-ba17-da2e839c377c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:10.762944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c750feb-c8a6-4d9e-ba17-da2e839c377c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:10.773187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c750feb-c8a6-4d9e-ba17-da2e839c377c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:10.774611 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c750feb-c8a6-4d9e-ba17-da2e839c377c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5c750feb-c8a6-4d9e-ba17-da2e839c377c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:21:10.789812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:10.790779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:21:10.796652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:21:10.796652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:10.796652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:10.796652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 542/1064] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:10.796884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71205-dddb-4188-8a5a-ce4d54136ee6 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:10.796884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71205-dddb-4188-8a5a-ce4d54136ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:10.796884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71205-dddb-4188-8a5a-ce4d54136ee6 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:10.797408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c750feb-c8a6-4d9e-ba17-da2e839c377c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:10.797482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 523/1065] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:10.802130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d956ed3-47fc-48ea-9712-f8b3eba19275 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:10.802437 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d956ed3-47fc-48ea-9712-f8b3eba19275 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:10.802692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d956ed3-47fc-48ea-9712-f8b3eba19275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:10.820788 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0d956ed3-47fc-48ea-9712-f8b3eba19275 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:10.821970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0d956ed3-47fc-48ea-9712-f8b3eba19275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:10.895135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 524/1066] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:21:10.904840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c750feb-c8a6-4d9e-ba17-da2e839c377c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:10.916006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d956ed3-47fc-48ea-9712-f8b3eba19275 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:10.929786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:10.942506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba86d6-de78-4c3d-bf4f-0fef19fca1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:10.943136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba86d6-de78-4c3d-bf4f-0fef19fca1be None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:10.943421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba86d6-de78-4c3d-bf4f-0fef19fca1be None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:10.943694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba86d6-de78-4c3d-bf4f-0fef19fca1be None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:10.944336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba86d6-de78-4c3d-bf4f-0fef19fca1be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:10.944647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba86d6-de78-4c3d-bf4f-0fef19fca1be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:10.944840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:10.946278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba86d6-de78-4c3d-bf4f-0fef19fca1be None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:10.959453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 543/1067] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:10.964761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba86d6-de78-4c3d-bf4f-0fef19fca1be None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:11.028800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d956ed3-47fc-48ea-9712-f8b3eba19275 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:11.066757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec22fa-2e88-48a3-bc15-bbba575cfc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:11.067416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec22fa-2e88-48a3-bc15-bbba575cfc54 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:11.067696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec22fa-2e88-48a3-bc15-bbba575cfc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:11.067968 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec22fa-2e88-48a3-bc15-bbba575cfc54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:11.071934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba86d6-de78-4c3d-bf4f-0fef19fca1be None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:11.078594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec22fa-2e88-48a3-bc15-bbba575cfc54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e1ec22fa-2e88-48a3-bc15-bbba575cfc54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:21:11.083469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:11.084406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:11.085234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 525/1068] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:21:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:21:11.090670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec22fa-2e88-48a3-bc15-bbba575cfc54 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:11.114245 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d965f-89cb-48eb-94b0-9132f4b93d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:11.114866 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d965f-89cb-48eb-94b0-9132f4b93d85 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:11.115193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d965f-89cb-48eb-94b0-9132f4b93d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:11.115511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d965f-89cb-48eb-94b0-9132f4b93d85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:11.122815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d965f-89cb-48eb-94b0-9132f4b93d85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:11.124270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d965f-89cb-48eb-94b0-9132f4b93d85 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-126d965f-89cb-48eb-94b0-9132f4b93d85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:21:11.136542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:11.137521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:11.143292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:11.143292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:11.143292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:21:11.143292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:21:11.143292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:21:11.143292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:21:11.143292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:21:11.143292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:21:11.143292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:21:11.143292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:11.143292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 544/1069] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 22:21:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:21:11.143880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d965f-89cb-48eb-94b0-9132f4b93d85 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:11.180250 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:11.195002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:11.196979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec22fa-2e88-48a3-bc15-bbba575cfc54 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:11.230999 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377c65b-ab9f-4983-9435-5be31e99944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:11.231543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c65b-ab9f-4983-9435-5be31e99944c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:11.231817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c65b-ab9f-4983-9435-5be31e99944c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:11.232088 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c65b-ab9f-4983-9435-5be31e99944c None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:11.232741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377c65b-ab9f-4983-9435-5be31e99944c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:11.233047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377c65b-ab9f-4983-9435-5be31e99944c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:11.234398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377c65b-ab9f-4983-9435-5be31e99944c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:11.243668 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 526/1070] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:21:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:11.249318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377c65b-ab9f-4983-9435-5be31e99944c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:11.254266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d965f-89cb-48eb-94b0-9132f4b93d85 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:11.288703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e2998-8f06-4406-8127-f03af10aa71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:11.289684 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e2998-8f06-4406-8127-f03af10aa71c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:11.289961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e2998-8f06-4406-8127-f03af10aa71c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:11.290226 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e2998-8f06-4406-8127-f03af10aa71c None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:11.290973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e2998-8f06-4406-8127-f03af10aa71c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:11.291640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e2998-8f06-4406-8127-f03af10aa71c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:11.293395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e2998-8f06-4406-8127-f03af10aa71c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:11.316197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 545/1071] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 22:21:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:11.317202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e2998-8f06-4406-8127-f03af10aa71c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:11.355616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377c65b-ab9f-4983-9435-5be31e99944c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:11.391000 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e912e4-5949-4158-81de-be5c0b61ab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:11.391677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e912e4-5949-4158-81de-be5c0b61ab33 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:11.391953 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e912e4-5949-4158-81de-be5c0b61ab33 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:11.392226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e912e4-5949-4158-81de-be5c0b61ab33 None admin] PATH_INFO: `/v3/users/ea078da3f15f44bb8bf1df3782c97ecf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:11.393395 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e912e4-5949-4158-81de-be5c0b61ab33 None admin] RBAC: Authorizing `identity:get_user(user_id=ea078da3f15f44bb8bf1df3782c97ecf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:11.394815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e912e4-5949-4158-81de-be5c0b61ab33 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:11.396455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 527/1072] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:11 2022] GET /identity/v3/users/ea078da3f15f44bb8bf1df3782c97ecf => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:11.402425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e912e4-5949-4158-81de-be5c0b61ab33 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:11.419575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e2998-8f06-4406-8127-f03af10aa71c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:11.420791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:11.421415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:11.461061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaad8d-4e63-42c7-a264-2ac372808635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:11.461734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaad8d-4e63-42c7-a264-2ac372808635 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:11.461951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaad8d-4e63-42c7-a264-2ac372808635 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:11.462219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaad8d-4e63-42c7-a264-2ac372808635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:11.472710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcaad8d-4e63-42c7-a264-2ac372808635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:11.474135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcaad8d-4e63-42c7-a264-2ac372808635 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-7fcaad8d-4e63-42c7-a264-2ac372808635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:21:11.489195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:11.490147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:21:11.491398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:21:11.491398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:11.491398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:11.491398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 546/1073] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:21:11.495796 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaad8d-4e63-42c7-a264-2ac372808635 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:11.512232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e912e4-5949-4158-81de-be5c0b61ab33 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:11.551401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11423a-dbf7-42ad-83a1-65d184b129e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:11.552040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11423a-dbf7-42ad-83a1-65d184b129e3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:11.552299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11423a-dbf7-42ad-83a1-65d184b129e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:11.552562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11423a-dbf7-42ad-83a1-65d184b129e3 None admin] PATH_INFO: `/v3/projects/10efcf0404a0473d9014b930ef11e96c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:11.553708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11423a-dbf7-42ad-83a1-65d184b129e3 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcf0404a0473d9014b930ef11e96c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:11.555241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11423a-dbf7-42ad-83a1-65d184b129e3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:11.561845 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 528/1074] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:21:11 2022] GET /identity/v3/projects/10efcf0404a0473d9014b930ef11e96c => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:11.563250 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11423a-dbf7-42ad-83a1-65d184b129e3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:11.599168 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaad8d-4e63-42c7-a264-2ac372808635 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:11.633263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62260c-d40e-4db9-81bb-f04ac9f1fd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:11.633866 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62260c-d40e-4db9-81bb-f04ac9f1fd83 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:11.634146 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62260c-d40e-4db9-81bb-f04ac9f1fd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:11.634418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62260c-d40e-4db9-81bb-f04ac9f1fd83 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:11.635046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62260c-d40e-4db9-81bb-f04ac9f1fd83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:11.635400 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62260c-d40e-4db9-81bb-f04ac9f1fd83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:11.636752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62260c-d40e-4db9-81bb-f04ac9f1fd83 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:11.649832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 547/1075] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:11.651386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:11.655254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62260c-d40e-4db9-81bb-f04ac9f1fd83 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:11.669323 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11423a-dbf7-42ad-83a1-65d184b129e3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:11.670600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:11.709979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268d773-8649-40a3-a091-c8a6e8070364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:11.710634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268d773-8649-40a3-a091-c8a6e8070364 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:11.710908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268d773-8649-40a3-a091-c8a6e8070364 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:11.711205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268d773-8649-40a3-a091-c8a6e8070364 None admin] PATH_INFO: `/v3/projects/10efcf0404a0473d9014b930ef11e96c/users/ea078da3f15f44bb8bf1df3782c97ecf/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:11.713131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268d773-8649-40a3-a091-c8a6e8070364 None admin] RBAC: Authorizing `identity:create_grant(project_id=10efcf0404a0473d9014b930ef11e96c, user_id=ea078da3f15f44bb8bf1df3782c97ecf, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:11.714539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268d773-8649-40a3-a091-c8a6e8070364 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:11.739114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 529/1076] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:21:11 2022] PUT /identity/v3/projects/10efcf0404a0473d9014b930ef11e96c/users/ea078da3f15f44bb8bf1df3782c97ecf/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:21:11.768852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62260c-d40e-4db9-81bb-f04ac9f1fd83 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:11.806668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399bc7b-9e90-4b55-8587-d86efee9a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:11.807340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399bc7b-9e90-4b55-8587-d86efee9a399 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:11.807617 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399bc7b-9e90-4b55-8587-d86efee9a399 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:11.807886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399bc7b-9e90-4b55-8587-d86efee9a399 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:11.815931 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399bc7b-9e90-4b55-8587-d86efee9a399 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:11.817376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399bc7b-9e90-4b55-8587-d86efee9a399 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5399bc7b-9e90-4b55-8587-d86efee9a399 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:21:11.829260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:11.830251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:11.831682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:21:11.831682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:21:11.831682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:21:11.831682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:21:11.831682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:21:11.831682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:21:11.831682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:21:11.831682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:11.835473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 548/1077] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:21:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:11.836737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268d773-8649-40a3-a091-c8a6e8070364 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:11.942107 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268d773-8649-40a3-a091-c8a6e8070364 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:11.976584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53481d06-7065-4b22-99db-1c2ba75ccc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:11.977183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53481d06-7065-4b22-99db-1c2ba75ccc24 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:11.977455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53481d06-7065-4b22-99db-1c2ba75ccc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:11.977719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53481d06-7065-4b22-99db-1c2ba75ccc24 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:11.978401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53481d06-7065-4b22-99db-1c2ba75ccc24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:11.978699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53481d06-7065-4b22-99db-1c2ba75ccc24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:11.980148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53481d06-7065-4b22-99db-1c2ba75ccc24 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:11.997051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 530/1078] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:21:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:12.003751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399bc7b-9e90-4b55-8587-d86efee9a399 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:12.080272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:12.106675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399bc7b-9e90-4b55-8587-d86efee9a399 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:12.140483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bb5f8-21d8-460d-84b5-5e1029e084e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:12.141306 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bb5f8-21d8-460d-84b5-5e1029e084e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:12.141689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bb5f8-21d8-460d-84b5-5e1029e084e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:12.142092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bb5f8-21d8-460d-84b5-5e1029e084e6 None admin] PATH_INFO: `/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/cc8bf701e94c403ab70fcffaeb81b65b/roles/dbd98afdf4814f1b864d9da8e7861ca5` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:12.145084 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bb5f8-21d8-460d-84b5-5e1029e084e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c5638056cea4e5397c6a25d434e5324, user_id=cc8bf701e94c403ab70fcffaeb81b65b, role_id=dbd98afdf4814f1b864d9da8e7861ca5)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:12.146629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bb5f8-21d8-460d-84b5-5e1029e084e6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:12.160993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 549/1079] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:21:12 2022] PUT /identity/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/cc8bf701e94c403ab70fcffaeb81b65b/roles/dbd98afdf4814f1b864d9da8e7861ca5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:21:12.462185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ece530-7d9a-4728-ba28-2865893fe3b4 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:12.462493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ece530-7d9a-4728-ba28-2865893fe3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:12.462879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ece530-7d9a-4728-ba28-2865893fe3b4 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:12.464362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 531/1080] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:12.469587 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b852b0-e656-47a4-b862-db394508187c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:12.469873 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b852b0-e656-47a4-b862-db394508187c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:12.470148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b852b0-e656-47a4-b862-db394508187c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:12.488677 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b1b852b0-e656-47a4-b862-db394508187c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:12.489858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b1b852b0-e656-47a4-b862-db394508187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:12.557332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 550/1081] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:12.579699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ece530-7d9a-4728-ba28-2865893fe3b4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:12.584178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:12.688017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ece530-7d9a-4728-ba28-2865893fe3b4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:12.724317 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211156f-78d6-4882-b7dd-84e394b351ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:12.725005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211156f-78d6-4882-b7dd-84e394b351ac None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:12.725282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211156f-78d6-4882-b7dd-84e394b351ac None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:12.725551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211156f-78d6-4882-b7dd-84e394b351ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:12.798003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211156f-78d6-4882-b7dd-84e394b351ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:12.799545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211156f-78d6-4882-b7dd-84e394b351ac None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:12.802467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:12.906916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 532/1082] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:21:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:21:12.912635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b852b0-e656-47a4-b862-db394508187c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:12.973486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:13.016425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b852b0-e656-47a4-b862-db394508187c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:13.049605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1d197-40db-4cd0-a1f4-3b01e694943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:13.050221 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1d197-40db-4cd0-a1f4-3b01e694943e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:13.050496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1d197-40db-4cd0-a1f4-3b01e694943e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:13.050763 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1d197-40db-4cd0-a1f4-3b01e694943e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:13.060487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1d197-40db-4cd0-a1f4-3b01e694943e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:13.061932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1d197-40db-4cd0-a1f4-3b01e694943e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-8ef1d197-40db-4cd0-a1f4-3b01e694943e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:21:13.076570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:13.077527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:21:13.083997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:21:13.083997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:13.083997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:13.083997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 551/1083] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:13.086009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211156f-78d6-4882-b7dd-84e394b351ac None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:13.190892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211156f-78d6-4882-b7dd-84e394b351ac None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:13.193329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:13.226564 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9bbd9-15c6-4740-97b0-030ff7ef53b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:13.227190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9bbd9-15c6-4740-97b0-030ff7ef53b0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:13.227468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9bbd9-15c6-4740-97b0-030ff7ef53b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:13.227733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9bbd9-15c6-4740-97b0-030ff7ef53b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:13.228363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9bbd9-15c6-4740-97b0-030ff7ef53b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:13.228659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9bbd9-15c6-4740-97b0-030ff7ef53b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:13.230003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9bbd9-15c6-4740-97b0-030ff7ef53b0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:13.247198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 533/1084] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:13.747556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c2dad-709c-4c68-a09c-641619fd2dd3 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:13.747838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c2dad-709c-4c68-a09c-641619fd2dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:13.748109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c2dad-709c-4c68-a09c-641619fd2dd3 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:13.749429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 552/1085] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:13.754918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3754ca-4fd9-481f-9be8-a0dd9c57cf46 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:13.755232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3754ca-4fd9-481f-9be8-a0dd9c57cf46 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:13.755507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3754ca-4fd9-481f-9be8-a0dd9c57cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:13.773018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-db3754ca-4fd9-481f-9be8-a0dd9c57cf46 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:13.774211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-db3754ca-4fd9-481f-9be8-a0dd9c57cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:13.838393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 534/1086] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:13.862640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c2dad-709c-4c68-a09c-641619fd2dd3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:13.962679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c2dad-709c-4c68-a09c-641619fd2dd3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:13.978536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:13.999214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93cf9c-0473-4867-86e8-97dde379fb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:13.999785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93cf9c-0473-4867-86e8-97dde379fb30 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:14.000057 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93cf9c-0473-4867-86e8-97dde379fb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:14.000324 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93cf9c-0473-4867-86e8-97dde379fb30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:14.010978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93cf9c-0473-4867-86e8-97dde379fb30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-fe93cf9c-0473-4867-86e8-97dde379fb30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:21:14.015607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:14.016690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:14.017532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 553/1087] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:21:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:14.023359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3754ca-4fd9-481f-9be8-a0dd9c57cf46 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:14.113006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:14.119846 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3754ca-4fd9-481f-9be8-a0dd9c57cf46 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:14.152863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6610ea5-1811-41e6-9ac4-4589ea2d2902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:14.153466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6610ea5-1811-41e6-9ac4-4589ea2d2902 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:14.153741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6610ea5-1811-41e6-9ac4-4589ea2d2902 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:14.154012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6610ea5-1811-41e6-9ac4-4589ea2d2902 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:14.154669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6610ea5-1811-41e6-9ac4-4589ea2d2902 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:14.154967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6610ea5-1811-41e6-9ac4-4589ea2d2902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:14.156357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6610ea5-1811-41e6-9ac4-4589ea2d2902 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:14.164946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 535/1088] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:21:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:14.169986 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5c63c-da5a-4739-b872-2d04091004bb None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:14.170265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5c63c-da5a-4739-b872-2d04091004bb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:14.170392 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6610ea5-1811-41e6-9ac4-4589ea2d2902 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:14.170531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5c63c-da5a-4739-b872-2d04091004bb None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:14.171882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 554/1089] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:14.176819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b950373-277d-4a12-9245-ad41157ec370 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:14.177101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b950373-277d-4a12-9245-ad41157ec370 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:14.177428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b950373-277d-4a12-9245-ad41157ec370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:14.194692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5b950373-277d-4a12-9245-ad41157ec370 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:14.195898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5b950373-277d-4a12-9245-ad41157ec370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:14.262395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 555/1090] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:21:14.271057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6610ea5-1811-41e6-9ac4-4589ea2d2902 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:14.285488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b950373-277d-4a12-9245-ad41157ec370 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:14.305835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3b922-3b11-4c77-ae14-81bf7e0607d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:14.306451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3b922-3b11-4c77-ae14-81bf7e0607d6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:14.306721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3b922-3b11-4c77-ae14-81bf7e0607d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:14.306982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3b922-3b11-4c77-ae14-81bf7e0607d6 None admin] PATH_INFO: `/v3/users/ea078da3f15f44bb8bf1df3782c97ecf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:14.308137 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3b922-3b11-4c77-ae14-81bf7e0607d6 None admin] RBAC: Authorizing `identity:get_user(user_id=ea078da3f15f44bb8bf1df3782c97ecf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:14.309565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3b922-3b11-4c77-ae14-81bf7e0607d6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:14.311141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 536/1091] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:14 2022] GET /identity/v3/users/ea078da3f15f44bb8bf1df3782c97ecf => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:14.316724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3b922-3b11-4c77-ae14-81bf7e0607d6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:14.340887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:14.384151 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b950373-277d-4a12-9245-ad41157ec370 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:14.391374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:14.414945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3b922-3b11-4c77-ae14-81bf7e0607d6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:14.418200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3d2da-e704-4846-bef3-8d917378a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:14.418815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d2da-e704-4846-bef3-8d917378a3ea None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:14.419174 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d2da-e704-4846-bef3-8d917378a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:14.419379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d2da-e704-4846-bef3-8d917378a3ea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:14.432139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3d2da-e704-4846-bef3-8d917378a3ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-ffa3d2da-e704-4846-bef3-8d917378a3ea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:21:14.436861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:14.437875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:14.438856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 556/1092] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Aug 7 22:21:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:21:14.443952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3d2da-e704-4846-bef3-8d917378a3ea None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:14.450743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f777cba-4cd8-426e-98e0-f96e0a682ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:14.451382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f777cba-4cd8-426e-98e0-f96e0a682ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:14.451661 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f777cba-4cd8-426e-98e0-f96e0a682ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:14.451932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f777cba-4cd8-426e-98e0-f96e0a682ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:14.518083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f777cba-4cd8-426e-98e0-f96e0a682ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:14.519456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f777cba-4cd8-426e-98e0-f96e0a682ca6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:14.542280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3d2da-e704-4846-bef3-8d917378a3ea None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:14.542992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:14.576350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5e9d9-74a2-4899-a0f4-f43d0979a8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:14.576943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5e9d9-74a2-4899-a0f4-f43d0979a8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:14.577221 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5e9d9-74a2-4899-a0f4-f43d0979a8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:14.577485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5e9d9-74a2-4899-a0f4-f43d0979a8f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:14.578138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5e9d9-74a2-4899-a0f4-f43d0979a8f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:14.578438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5e9d9-74a2-4899-a0f4-f43d0979a8f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:14.579839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5e9d9-74a2-4899-a0f4-f43d0979a8f8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:14.587598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 557/1093] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 22:21:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:14.593177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5e9d9-74a2-4899-a0f4-f43d0979a8f8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:14.621229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:14.627156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 537/1094] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:21:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 22:21:14.628421 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f777cba-4cd8-426e-98e0-f96e0a682ca6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:14.691133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5e9d9-74a2-4899-a0f4-f43d0979a8f8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:14.725722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9ba6b-1404-46df-9916-75f13995594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:14.726349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9ba6b-1404-46df-9916-75f13995594a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:14.726619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9ba6b-1404-46df-9916-75f13995594a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:14.726881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9ba6b-1404-46df-9916-75f13995594a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:14.727464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f777cba-4cd8-426e-98e0-f96e0a682ca6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:14.737686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9ba6b-1404-46df-9916-75f13995594a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:14.739105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9ba6b-1404-46df-9916-75f13995594a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:14.750563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-63d9ba6b-1404-46df-9916-75f13995594a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:21:14.752998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:14.754009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:21:14.755335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:21:14.755335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:14.755335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:14.755335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 558/1095] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:21:14.759826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9ba6b-1404-46df-9916-75f13995594a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:14.763948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310474af-5a26-44a8-860c-a6a558cb8d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:14.764575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310474af-5a26-44a8-860c-a6a558cb8d3e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:14.764849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310474af-5a26-44a8-860c-a6a558cb8d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:14.765118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310474af-5a26-44a8-860c-a6a558cb8d3e None admin] PATH_INFO: `/v3/projects/10efcf0404a0473d9014b930ef11e96c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:14.766230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310474af-5a26-44a8-860c-a6a558cb8d3e None admin] RBAC: Authorizing `identity:get_project(project_id=10efcf0404a0473d9014b930ef11e96c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:14.767681 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310474af-5a26-44a8-860c-a6a558cb8d3e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:14.770236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 538/1096] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:21:14 2022] GET /identity/v3/projects/10efcf0404a0473d9014b930ef11e96c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:14.775849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310474af-5a26-44a8-860c-a6a558cb8d3e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:14.840055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:14.859403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9ba6b-1404-46df-9916-75f13995594a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:14.874247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310474af-5a26-44a8-860c-a6a558cb8d3e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:14.891751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc11ce-ce2a-430d-b8b3-6eb1e78cce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:14.892347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc11ce-ce2a-430d-b8b3-6eb1e78cce60 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:14.892619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc11ce-ce2a-430d-b8b3-6eb1e78cce60 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:14.892885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc11ce-ce2a-430d-b8b3-6eb1e78cce60 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:14.894029 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc11ce-ce2a-430d-b8b3-6eb1e78cce60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:14.894324 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc11ce-ce2a-430d-b8b3-6eb1e78cce60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:14.895693 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc11ce-ce2a-430d-b8b3-6eb1e78cce60 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:14.907178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 559/1097] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:14.909454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcc251-4aa9-4f7a-8b63-01ecc45df521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:14.910071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcc251-4aa9-4f7a-8b63-01ecc45df521 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:14.910343 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcc251-4aa9-4f7a-8b63-01ecc45df521 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:14.910604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcc251-4aa9-4f7a-8b63-01ecc45df521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:14.911346 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcc251-4aa9-4f7a-8b63-01ecc45df521 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=10efcf0404a0473d9014b930ef11e96c, user.id=ea078da3f15f44bb8bf1df3782c97ecf) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:14.911651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcc251-4aa9-4f7a-8b63-01ecc45df521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:14.913046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcc251-4aa9-4f7a-8b63-01ecc45df521 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:14.913422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc11ce-ce2a-430d-b8b3-6eb1e78cce60 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:14.931115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 539/1098] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:21:14 2022] GET /identity/v3/role_assignments?user.id=ea078da3f15f44bb8bf1df3782c97ecf&scope.project.id=10efcf0404a0473d9014b930ef11e96c&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:15.017404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc11ce-ce2a-430d-b8b3-6eb1e78cce60 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:15.053003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110a864-e2c8-4169-890f-54af17ec2b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:15.053649 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110a864-e2c8-4169-890f-54af17ec2b0d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:15.053926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110a864-e2c8-4169-890f-54af17ec2b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:15.054192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110a864-e2c8-4169-890f-54af17ec2b0d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:15.062365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110a864-e2c8-4169-890f-54af17ec2b0d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:15.063837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110a864-e2c8-4169-890f-54af17ec2b0d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:15.067275 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-8110a864-e2c8-4169-890f-54af17ec2b0d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:21:15.077736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:15.079005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:15.080041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:15.080041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:15.080041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:21:15.080041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:21:15.080041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:21:15.080041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:21:15.080041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:21:15.080041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:21:15.080041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 22:21:15.080041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:15.083259 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 560/1099] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 22:21:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:21:15.085938 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcc251-4aa9-4f7a-8b63-01ecc45df521 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:15.143729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:15.186331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcc251-4aa9-4f7a-8b63-01ecc45df521 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:15.219302 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b289ee2-1345-48e7-88c2-fe97a5c72178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:15.219892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b289ee2-1345-48e7-88c2-fe97a5c72178 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:15.220166 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b289ee2-1345-48e7-88c2-fe97a5c72178 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:15.220433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b289ee2-1345-48e7-88c2-fe97a5c72178 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:15.221170 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b289ee2-1345-48e7-88c2-fe97a5c72178 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:15.221170 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b289ee2-1345-48e7-88c2-fe97a5c72178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:15.223369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b289ee2-1345-48e7-88c2-fe97a5c72178 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:15.241096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 540/1100] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 22:21:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:15.247062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110a864-e2c8-4169-890f-54af17ec2b0d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:15.343408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110a864-e2c8-4169-890f-54af17ec2b0d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:15.375871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c1f47-1da2-44a3-be20-7dba644df98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:15.376466 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1f47-1da2-44a3-be20-7dba644df98b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:15.376737 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1f47-1da2-44a3-be20-7dba644df98b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:15.377001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1f47-1da2-44a3-be20-7dba644df98b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:15.442114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:15.444673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c1f47-1da2-44a3-be20-7dba644df98b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:15.446451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c1f47-1da2-44a3-be20-7dba644df98b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:15.541290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 561/1101] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:21:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:21:15.547321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b289ee2-1345-48e7-88c2-fe97a5c72178 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:15.643910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b289ee2-1345-48e7-88c2-fe97a5c72178 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:15.657361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:15.677942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61d77-0571-4371-9629-1a19451772b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:15.678616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61d77-0571-4371-9629-1a19451772b9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:15.678893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61d77-0571-4371-9629-1a19451772b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:15.679190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61d77-0571-4371-9629-1a19451772b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:15.688859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc61d77-0571-4371-9629-1a19451772b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:15.690283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc61d77-0571-4371-9629-1a19451772b9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-5fc61d77-0571-4371-9629-1a19451772b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:21:15.704364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:15.705499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:21:15.706875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:21:15.706875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:21:15.706875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:15.706875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 541/1102] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:15.712098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c1f47-1da2-44a3-be20-7dba644df98b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:15.804734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:15.808116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c1f47-1da2-44a3-be20-7dba644df98b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:15.841994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed1d4c-ae26-4007-b669-c8538428121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:15.842576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed1d4c-ae26-4007-b669-c8538428121b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:15.842848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed1d4c-ae26-4007-b669-c8538428121b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:15.843136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed1d4c-ae26-4007-b669-c8538428121b None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:15.843764 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed1d4c-ae26-4007-b669-c8538428121b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:15.844060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed1d4c-ae26-4007-b669-c8538428121b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:15.845426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed1d4c-ae26-4007-b669-c8538428121b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:15.856319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 562/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:15.861888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61d77-0571-4371-9629-1a19451772b9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:15.959489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61d77-0571-4371-9629-1a19451772b9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:15.995923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9d85e-9a4c-4ea3-898b-b83f0398045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:15.996554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9d85e-9a4c-4ea3-898b-b83f0398045c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:15.996832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9d85e-9a4c-4ea3-898b-b83f0398045c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:15.997103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9d85e-9a4c-4ea3-898b-b83f0398045c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:16.004280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9d85e-9a4c-4ea3-898b-b83f0398045c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:16.005709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9d85e-9a4c-4ea3-898b-b83f0398045c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-7be9d85e-9a4c-4ea3-898b-b83f0398045c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:21:16.016608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:16.017452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:16.018971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:21:16.018971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:21:16.018971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:21:16.018971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:21:16.018971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:21:16.018971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:21:16.018971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:21:16.018971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:16.018971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 542/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:21:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:16.024185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed1d4c-ae26-4007-b669-c8538428121b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:16.122464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed1d4c-ae26-4007-b669-c8538428121b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:16.155457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87da8e-74ac-4a9a-81d8-f5942bfb11b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:16.156054 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87da8e-74ac-4a9a-81d8-f5942bfb11b0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:16.156333 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87da8e-74ac-4a9a-81d8-f5942bfb11b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:16.156605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87da8e-74ac-4a9a-81d8-f5942bfb11b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:16.157285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87da8e-74ac-4a9a-81d8-f5942bfb11b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:16.157591 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87da8e-74ac-4a9a-81d8-f5942bfb11b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:16.159028 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87da8e-74ac-4a9a-81d8-f5942bfb11b0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:16.170591 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 563/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:21:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:21:16.177289 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9d85e-9a4c-4ea3-898b-b83f0398045c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:16.204948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:16.275835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9d85e-9a4c-4ea3-898b-b83f0398045c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:16.309029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97b139-156f-4006-a090-3a53b39f2c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:16.309381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97b139-156f-4006-a090-3a53b39f2c9f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:16.309654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97b139-156f-4006-a090-3a53b39f2c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:16.309921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97b139-156f-4006-a090-3a53b39f2c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:16.310640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97b139-156f-4006-a090-3a53b39f2c9f None admin] RBAC: Adding query filter params (role.id=dbd98afdf4814f1b864d9da8e7861ca5, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=cc8bf701e94c403ab70fcffaeb81b65b) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:16.310941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97b139-156f-4006-a090-3a53b39f2c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:16.312375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97b139-156f-4006-a090-3a53b39f2c9f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:16.318578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 543/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:21:16 2022] GET /identity/v3/role_assignments?user.id=cc8bf701e94c403ab70fcffaeb81b65b&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=dbd98afdf4814f1b864d9da8e7861ca5 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:16.933242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da86d-3372-408b-9fe5-9516d22f37c8 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:16.933525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da86d-3372-408b-9fe5-9516d22f37c8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:16.933807 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da86d-3372-408b-9fe5-9516d22f37c8 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:16.935175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 564/1107] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:21:16.940588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8bcc9-fdff-4378-8fb1-d0f16daaeccb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:16.940869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8bcc9-fdff-4378-8fb1-d0f16daaeccb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:16.941145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8bcc9-fdff-4378-8fb1-d0f16daaeccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:16.959514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-93e8bcc9-fdff-4378-8fb1-d0f16daaeccb None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:16.960696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-93e8bcc9-fdff-4378-8fb1-d0f16daaeccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:17.032383 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 544/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:17.056925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278da86d-3372-408b-9fe5-9516d22f37c8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:17.078869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:17.161004 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278da86d-3372-408b-9fe5-9516d22f37c8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:17.192777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ea4c8-d93f-4674-ba2b-8a43c9e9fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:17.193326 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ea4c8-d93f-4674-ba2b-8a43c9e9fd53 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:17.193596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ea4c8-d93f-4674-ba2b-8a43c9e9fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:17.193859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ea4c8-d93f-4674-ba2b-8a43c9e9fd53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:17.194933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ea4c8-d93f-4674-ba2b-8a43c9e9fd53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:17.196359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ea4c8-d93f-4674-ba2b-8a43c9e9fd53 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:17.197887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 565/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:17.203638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8bcc9-fdff-4378-8fb1-d0f16daaeccb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:17.224843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:17.299239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8bcc9-fdff-4378-8fb1-d0f16daaeccb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:17.332613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0812103-ea6f-4a06-adfd-b3a8431ac41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:17.333192 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0812103-ea6f-4a06-adfd-b3a8431ac41c None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:17.333464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0812103-ea6f-4a06-adfd-b3a8431ac41c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:17.333729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0812103-ea6f-4a06-adfd-b3a8431ac41c None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:17.334361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0812103-ea6f-4a06-adfd-b3a8431ac41c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:17.335785 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0812103-ea6f-4a06-adfd-b3a8431ac41c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:17.355779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 545/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:21:17 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:21:19.369643 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e45bcd-c9ff-449f-aa02-a902d021b7ff None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:19.370178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e45bcd-c9ff-449f-aa02-a902d021b7ff None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:19.370178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e45bcd-c9ff-449f-aa02-a902d021b7ff None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:19.371525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 566/1111] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:19.376510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05d9d-f314-4ec5-9018-744ff73ae58b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:19.376934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05d9d-f314-4ec5-9018-744ff73ae58b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:19.377053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05d9d-f314-4ec5-9018-744ff73ae58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:19.395251 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ebf05d9d-f314-4ec5-9018-744ff73ae58b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:19.396413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ebf05d9d-f314-4ec5-9018-744ff73ae58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:19.464094 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 546/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:19.487547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e45bcd-c9ff-449f-aa02-a902d021b7ff None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:19.572184 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:19.585192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e45bcd-c9ff-449f-aa02-a902d021b7ff None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:19.616836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c2d7f-5c3b-4f46-b328-c0585aef9e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:19.617438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2d7f-5c3b-4f46-b328-c0585aef9e66 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:19.617711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2d7f-5c3b-4f46-b328-c0585aef9e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:19.617976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2d7f-5c3b-4f46-b328-c0585aef9e66 None admin] PATH_INFO: `/v3/roles/74caf7e4c7474d40b5657d5e42da5546` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:19.619345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c2d7f-5c3b-4f46-b328-c0585aef9e66 None admin] RBAC: Authorizing `identity:get_role(role_id=74caf7e4c7474d40b5657d5e42da5546)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:19.620727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c2d7f-5c3b-4f46-b328-c0585aef9e66 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:19.621943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 567/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:19 2022] GET /identity/v3/roles/74caf7e4c7474d40b5657d5e42da5546 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:19.628375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf05d9d-f314-4ec5-9018-744ff73ae58b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:19.636132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:19.727904 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf05d9d-f314-4ec5-9018-744ff73ae58b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:19.760622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79b5c9-0cc8-4228-9479-fbfb61a57955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:19.761225 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79b5c9-0cc8-4228-9479-fbfb61a57955 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:19.761499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79b5c9-0cc8-4228-9479-fbfb61a57955 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:19.761765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79b5c9-0cc8-4228-9479-fbfb61a57955 None admin] PATH_INFO: `/v3/users/25a7dfc7847441c4bcc3400d75c47aa4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:19.774799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79b5c9-0cc8-4228-9479-fbfb61a57955 None admin] RBAC: Authorizing `identity:get_user(user_id=25a7dfc7847441c4bcc3400d75c47aa4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:19.776240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79b5c9-0cc8-4228-9479-fbfb61a57955 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:19.777803 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 547/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:19 2022] GET /identity/v3/users/25a7dfc7847441c4bcc3400d75c47aa4 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:19.783800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c2d7f-5c3b-4f46-b328-c0585aef9e66 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:19.878973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c2d7f-5c3b-4f46-b328-c0585aef9e66 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:19.911618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f04138-3ad7-430f-876e-a07c73c64592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:19.912196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f04138-3ad7-430f-876e-a07c73c64592 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:19.912465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f04138-3ad7-430f-876e-a07c73c64592 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:19.912729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f04138-3ad7-430f-876e-a07c73c64592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:19.936536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:19.977051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f04138-3ad7-430f-876e-a07c73c64592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:19.978454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f04138-3ad7-430f-876e-a07c73c64592 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:20.074866 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 568/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:21:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 22:21:20.080903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79b5c9-0cc8-4228-9479-fbfb61a57955 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:20.140074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:20.176166 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79b5c9-0cc8-4228-9479-fbfb61a57955 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:20.208624 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e4f38-a68c-4510-88c9-bc210f0274ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:20.209229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4f38-a68c-4510-88c9-bc210f0274ba None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:20.209504 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4f38-a68c-4510-88c9-bc210f0274ba None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:20.209774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4f38-a68c-4510-88c9-bc210f0274ba None admin] PATH_INFO: `/v3/projects/10efcf0404a0473d9014b930ef11e96c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:20.210869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e4f38-a68c-4510-88c9-bc210f0274ba None admin] RBAC: Authorizing `identity:get_project(project_id=10efcf0404a0473d9014b930ef11e96c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:20.212307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e4f38-a68c-4510-88c9-bc210f0274ba None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:20.213906 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 548/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:21:20 2022] GET /identity/v3/projects/10efcf0404a0473d9014b930ef11e96c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:20.219898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f04138-3ad7-430f-876e-a07c73c64592 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:20.272822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:20.314525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f04138-3ad7-430f-876e-a07c73c64592 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:20.347931 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b98c75-ae9e-4c18-a300-472ebed47849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:20.348506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b98c75-ae9e-4c18-a300-472ebed47849 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:20.348781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b98c75-ae9e-4c18-a300-472ebed47849 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:20.349047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b98c75-ae9e-4c18-a300-472ebed47849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:20.349745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b98c75-ae9e-4c18-a300-472ebed47849 None admin] RBAC: Adding query filter params (role.id=74caf7e4c7474d40b5657d5e42da5546, scope.project.id=10efcf0404a0473d9014b930ef11e96c, user.id=25a7dfc7847441c4bcc3400d75c47aa4) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:20.350042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b98c75-ae9e-4c18-a300-472ebed47849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:20.351453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b98c75-ae9e-4c18-a300-472ebed47849 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:20.356535 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 569/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:21:20 2022] GET /identity/v3/role_assignments?user.id=25a7dfc7847441c4bcc3400d75c47aa4&scope.project.id=10efcf0404a0473d9014b930ef11e96c&role.id=74caf7e4c7474d40b5657d5e42da5546 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:22.296242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d496f1-f714-4185-99bf-4a68aad2abf6 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:22.296750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d496f1-f714-4185-99bf-4a68aad2abf6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:22.296750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d496f1-f714-4185-99bf-4a68aad2abf6 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:22.298110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 549/1118] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:22.303662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc821103-94d7-4d85-a7dd-f888fa1ed097 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:22.304051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc821103-94d7-4d85-a7dd-f888fa1ed097 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:22.304201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc821103-94d7-4d85-a7dd-f888fa1ed097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:22.322007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-dc821103-94d7-4d85-a7dd-f888fa1ed097 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:22.323196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dc821103-94d7-4d85-a7dd-f888fa1ed097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:22.386892 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 570/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:22.408328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d496f1-f714-4185-99bf-4a68aad2abf6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:22.507702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d496f1-f714-4185-99bf-4a68aad2abf6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:22.535918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:22.541112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63240e15-9674-4f8f-8b01-f2292e908b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:22.541721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63240e15-9674-4f8f-8b01-f2292e908b0b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:22.541997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63240e15-9674-4f8f-8b01-f2292e908b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:22.542267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63240e15-9674-4f8f-8b01-f2292e908b0b None admin] PATH_INFO: `/v3/roles/74caf7e4c7474d40b5657d5e42da5546` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:22.543676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63240e15-9674-4f8f-8b01-f2292e908b0b None admin] RBAC: Authorizing `identity:get_role(role_id=74caf7e4c7474d40b5657d5e42da5546)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:22.545030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63240e15-9674-4f8f-8b01-f2292e908b0b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:22.546379 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 550/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:22 2022] GET /identity/v3/roles/74caf7e4c7474d40b5657d5e42da5546 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:22.552722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc821103-94d7-4d85-a7dd-f888fa1ed097 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:22.600456 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:22.648075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc821103-94d7-4d85-a7dd-f888fa1ed097 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:22.680922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0298fb6-fd2d-4a5c-90a9-8bc9884c1396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:22.681528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0298fb6-fd2d-4a5c-90a9-8bc9884c1396 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:22.681798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0298fb6-fd2d-4a5c-90a9-8bc9884c1396 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:22.682061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0298fb6-fd2d-4a5c-90a9-8bc9884c1396 None admin] PATH_INFO: `/v3/users/25a7dfc7847441c4bcc3400d75c47aa4` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:22.683168 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0298fb6-fd2d-4a5c-90a9-8bc9884c1396 None admin] RBAC: Authorizing `identity:get_user(user_id=25a7dfc7847441c4bcc3400d75c47aa4)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:22.684569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0298fb6-fd2d-4a5c-90a9-8bc9884c1396 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:22.686087 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 571/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:22 2022] GET /identity/v3/users/25a7dfc7847441c4bcc3400d75c47aa4 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:22.691772 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63240e15-9674-4f8f-8b01-f2292e908b0b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:22.787459 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63240e15-9674-4f8f-8b01-f2292e908b0b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:22.819957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9124a5-0d43-45f9-bd6f-4112cb4d47fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:22.820506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9124a5-0d43-45f9-bd6f-4112cb4d47fd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:22.820780 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9124a5-0d43-45f9-bd6f-4112cb4d47fd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:22.821049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9124a5-0d43-45f9-bd6f-4112cb4d47fd None admin] PATH_INFO: `/v3/projects/10efcf0404a0473d9014b930ef11e96c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:22.822142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9124a5-0d43-45f9-bd6f-4112cb4d47fd None admin] RBAC: Authorizing `identity:get_project(project_id=10efcf0404a0473d9014b930ef11e96c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:22.823577 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9124a5-0d43-45f9-bd6f-4112cb4d47fd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:22.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 551/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:21:22 2022] GET /identity/v3/projects/10efcf0404a0473d9014b930ef11e96c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:22.830895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0298fb6-fd2d-4a5c-90a9-8bc9884c1396 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:22.925503 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0298fb6-fd2d-4a5c-90a9-8bc9884c1396 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:22.941663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:22.958206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fad67-0f4d-4a0a-a2e5-52bcbbfc3aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:22.958836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fad67-0f4d-4a0a-a2e5-52bcbbfc3aa7 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:22.959126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fad67-0f4d-4a0a-a2e5-52bcbbfc3aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:22.959395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fad67-0f4d-4a0a-a2e5-52bcbbfc3aa7 None admin] PATH_INFO: `/v3/projects/10efcf0404a0473d9014b930ef11e96c/users/25a7dfc7847441c4bcc3400d75c47aa4/roles/74caf7e4c7474d40b5657d5e42da5546` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:22.961454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fad67-0f4d-4a0a-a2e5-52bcbbfc3aa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=10efcf0404a0473d9014b930ef11e96c, user_id=25a7dfc7847441c4bcc3400d75c47aa4, role_id=74caf7e4c7474d40b5657d5e42da5546)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:22.962852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fad67-0f4d-4a0a-a2e5-52bcbbfc3aa7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:22.975475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 572/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:21:22 2022] PUT /identity/v3/projects/10efcf0404a0473d9014b930ef11e96c/users/25a7dfc7847441c4bcc3400d75c47aa4/roles/74caf7e4c7474d40b5657d5e42da5546 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:21:24.941112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1fd2e-885d-439a-8078-0d7c36c89baf None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:24.941650 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1fd2e-885d-439a-8078-0d7c36c89baf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:24.941650 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1fd2e-885d-439a-8078-0d7c36c89baf None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:24.942998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 552/1124] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:24.948158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f00211-cf37-41b8-b785-c3a2f58af1be None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:24.948578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f00211-cf37-41b8-b785-c3a2f58af1be None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:24.948769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f00211-cf37-41b8-b785-c3a2f58af1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:24.966723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-94f00211-cf37-41b8-b785-c3a2f58af1be None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:24.967906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-94f00211-cf37-41b8-b785-c3a2f58af1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:25.033408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 573/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:25.056441 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1fd2e-885d-439a-8078-0d7c36c89baf None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:25.122246 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:25.155948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1fd2e-885d-439a-8078-0d7c36c89baf None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:25.188401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbfba2-0312-421b-b38b-7e2b3d2c1c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:25.189013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbfba2-0312-421b-b38b-7e2b3d2c1c43 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:25.189291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbfba2-0312-421b-b38b-7e2b3d2c1c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:25.189561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbfba2-0312-421b-b38b-7e2b3d2c1c43 None admin] PATH_INFO: `/v3/roles/74caf7e4c7474d40b5657d5e42da5546` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:25.191555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbfba2-0312-421b-b38b-7e2b3d2c1c43 None admin] RBAC: Authorizing `identity:get_role(role_id=74caf7e4c7474d40b5657d5e42da5546)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:25.192864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbfba2-0312-421b-b38b-7e2b3d2c1c43 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:25.194160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 553/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:25 2022] GET /identity/v3/roles/74caf7e4c7474d40b5657d5e42da5546 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:25.199828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f00211-cf37-41b8-b785-c3a2f58af1be None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:25.293344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f00211-cf37-41b8-b785-c3a2f58af1be None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:25.303343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:25.328926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a6470-e801-4989-b731-13c0cf9a3292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:25.329537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a6470-e801-4989-b731-13c0cf9a3292 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:25.329810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a6470-e801-4989-b731-13c0cf9a3292 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:25.330076 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a6470-e801-4989-b731-13c0cf9a3292 None admin] PATH_INFO: `/v3/users/25a7dfc7847441c4bcc3400d75c47aa4` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:25.331191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a6470-e801-4989-b731-13c0cf9a3292 None admin] RBAC: Authorizing `identity:get_user(user_id=25a7dfc7847441c4bcc3400d75c47aa4)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:25.332598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a6470-e801-4989-b731-13c0cf9a3292 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:25.334132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 574/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:25 2022] GET /identity/v3/users/25a7dfc7847441c4bcc3400d75c47aa4 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:25.339818 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbfba2-0312-421b-b38b-7e2b3d2c1c43 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:25.435147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbfba2-0312-421b-b38b-7e2b3d2c1c43 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:25.468280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe5395-c1f4-4333-b21e-68b37f81140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:25.468800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe5395-c1f4-4333-b21e-68b37f81140a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:25.469072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe5395-c1f4-4333-b21e-68b37f81140a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:25.469341 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe5395-c1f4-4333-b21e-68b37f81140a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:25.472614 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:25.534688 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe5395-c1f4-4333-b21e-68b37f81140a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:25.536140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe5395-c1f4-4333-b21e-68b37f81140a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:25.629751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 554/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:21:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:21:25.635480 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a6470-e801-4989-b731-13c0cf9a3292 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:25.729494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a6470-e801-4989-b731-13c0cf9a3292 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:25.762404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1b61-a845-4c9a-88ce-de2a534b9d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:25.763005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1b61-a845-4c9a-88ce-de2a534b9d3d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:25.763304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1b61-a845-4c9a-88ce-de2a534b9d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:25.763572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1b61-a845-4c9a-88ce-de2a534b9d3d None admin] PATH_INFO: `/v3/projects/10efcf0404a0473d9014b930ef11e96c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:25.764653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a1b61-a845-4c9a-88ce-de2a534b9d3d None admin] RBAC: Authorizing `identity:get_project(project_id=10efcf0404a0473d9014b930ef11e96c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:25.766045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a1b61-a845-4c9a-88ce-de2a534b9d3d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:25.767651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 575/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:21:25 2022] GET /identity/v3/projects/10efcf0404a0473d9014b930ef11e96c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:25.773647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe5395-c1f4-4333-b21e-68b37f81140a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:25.807277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:25.869641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe5395-c1f4-4333-b21e-68b37f81140a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:25.902101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37400b-7177-48f0-9507-9013bce303c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:25.902680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37400b-7177-48f0-9507-9013bce303c8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:25.902955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37400b-7177-48f0-9507-9013bce303c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:25.903254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37400b-7177-48f0-9507-9013bce303c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:25.903968 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37400b-7177-48f0-9507-9013bce303c8 None admin] RBAC: Adding query filter params (role.id=74caf7e4c7474d40b5657d5e42da5546, scope.project.id=10efcf0404a0473d9014b930ef11e96c, user.id=25a7dfc7847441c4bcc3400d75c47aa4) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:25.904271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37400b-7177-48f0-9507-9013bce303c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:25.905662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37400b-7177-48f0-9507-9013bce303c8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:25.911764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 555/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:21:25 2022] GET /identity/v3/role_assignments?user.id=25a7dfc7847441c4bcc3400d75c47aa4&scope.project.id=10efcf0404a0473d9014b930ef11e96c&role.id=74caf7e4c7474d40b5657d5e42da5546 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:27.892681 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a46c0-50a0-4308-9ef9-a2f5e02bb827 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:27.893270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a46c0-50a0-4308-9ef9-a2f5e02bb827 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:27.893270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a46c0-50a0-4308-9ef9-a2f5e02bb827 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:27.894534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 576/1131] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:27.899714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c89e7-8bbf-4956-bce6-efb54aa839b0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:27.900139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c89e7-8bbf-4956-bce6-efb54aa839b0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:27.900241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c89e7-8bbf-4956-bce6-efb54aa839b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:27.918191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bb8c89e7-8bbf-4956-bce6-efb54aa839b0 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:27.919396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bb8c89e7-8bbf-4956-bce6-efb54aa839b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:27.982847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 556/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:28.006567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a46c0-50a0-4308-9ef9-a2f5e02bb827 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:28.052768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:28.110130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a46c0-50a0-4308-9ef9-a2f5e02bb827 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:28.142958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae2e4c-ba1a-44e2-a784-9dac2e4ddbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:28.144103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae2e4c-ba1a-44e2-a784-9dac2e4ddbbd None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:28.144399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae2e4c-ba1a-44e2-a784-9dac2e4ddbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:28.144664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae2e4c-ba1a-44e2-a784-9dac2e4ddbbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:28.145744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae2e4c-ba1a-44e2-a784-9dac2e4ddbbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:28.147175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae2e4c-ba1a-44e2-a784-9dac2e4ddbbd None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:28.148709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 577/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:28.154530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c89e7-8bbf-4956-bce6-efb54aa839b0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:28.184224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:28.251385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c89e7-8bbf-4956-bce6-efb54aa839b0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:28.285458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde68065-fcea-4af5-845e-91fcf409de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:28.286042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde68065-fcea-4af5-845e-91fcf409de42 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:28.286323 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde68065-fcea-4af5-845e-91fcf409de42 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:28.286592 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde68065-fcea-4af5-845e-91fcf409de42 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:28.287254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde68065-fcea-4af5-845e-91fcf409de42 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:28.288667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde68065-fcea-4af5-845e-91fcf409de42 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:28.313753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 557/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:21:28 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:21:30.314208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e48915-772d-44d9-b82d-0329c4f55653 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:30.314739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e48915-772d-44d9-b82d-0329c4f55653 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:30.314739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e48915-772d-44d9-b82d-0329c4f55653 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:30.316126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 578/1135] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:30.321910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb021d8-d3ab-4c36-b0be-ee71775ea98f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:30.322300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb021d8-d3ab-4c36-b0be-ee71775ea98f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:30.322457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb021d8-d3ab-4c36-b0be-ee71775ea98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:30.340552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dbb021d8-d3ab-4c36-b0be-ee71775ea98f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:30.341718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dbb021d8-d3ab-4c36-b0be-ee71775ea98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:30.406709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 558/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:30.431624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e48915-772d-44d9-b82d-0329c4f55653 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:30.532187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e48915-772d-44d9-b82d-0329c4f55653 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:30.544700 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:30.565930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650ce8f-00d5-459b-8593-42a722760ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:30.567111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650ce8f-00d5-459b-8593-42a722760ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:30.567390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650ce8f-00d5-459b-8593-42a722760ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:30.567655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650ce8f-00d5-459b-8593-42a722760ff7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:30.568744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650ce8f-00d5-459b-8593-42a722760ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:30.570149 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650ce8f-00d5-459b-8593-42a722760ff7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:30.571728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 579/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:21:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:30.577510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb021d8-d3ab-4c36-b0be-ee71775ea98f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:30.591251 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:30.673844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb021d8-d3ab-4c36-b0be-ee71775ea98f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:30.708662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929a1ae-a331-4c42-b904-00700b852a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:30.709288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929a1ae-a331-4c42-b904-00700b852a53 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:30.709565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929a1ae-a331-4c42-b904-00700b852a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:30.709833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929a1ae-a331-4c42-b904-00700b852a53 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:30.710461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929a1ae-a331-4c42-b904-00700b852a53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:30.711899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929a1ae-a331-4c42-b904-00700b852a53 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:30.732998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 559/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:21:30 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:21:32.755935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a602929-58e0-489f-a9a3-5c73b50a68ad None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:32.756484 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a602929-58e0-489f-a9a3-5c73b50a68ad None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:32.756484 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a602929-58e0-489f-a9a3-5c73b50a68ad None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:32.757795 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 580/1139] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:32.762897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3587d81-1b0e-44c1-b238-d165da711c61 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:32.763353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3587d81-1b0e-44c1-b238-d165da711c61 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:32.763445 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3587d81-1b0e-44c1-b238-d165da711c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:32.781602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d3587d81-1b0e-44c1-b238-d165da711c61 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:32.782801 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d3587d81-1b0e-44c1-b238-d165da711c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:32.842189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:32.848611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 560/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:32.871109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a602929-58e0-489f-a9a3-5c73b50a68ad None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:32.967533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a602929-58e0-489f-a9a3-5c73b50a68ad None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:33.002549 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb953b5-b02b-4742-9f5f-2aed185983bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:33.003205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb953b5-b02b-4742-9f5f-2aed185983bd None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:33.003737 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb953b5-b02b-4742-9f5f-2aed185983bd None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:33.004494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb953b5-b02b-4742-9f5f-2aed185983bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:33.014302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb953b5-b02b-4742-9f5f-2aed185983bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-4cb953b5-b02b-4742-9f5f-2aed185983bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:21:33.018911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:33.020563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:33.021846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 581/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:21:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:33.026707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3587d81-1b0e-44c1-b238-d165da711c61 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:33.126430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3587d81-1b0e-44c1-b238-d165da711c61 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:33.160231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbcd64-379e-41d7-8c64-da97d47eb87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:33.160829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbcd64-379e-41d7-8c64-da97d47eb87c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:33.161105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbcd64-379e-41d7-8c64-da97d47eb87c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:33.161375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbcd64-379e-41d7-8c64-da97d47eb87c None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:33.162038 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbcd64-379e-41d7-8c64-da97d47eb87c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:33.162340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbcd64-379e-41d7-8c64-da97d47eb87c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:33.163731 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbcd64-379e-41d7-8c64-da97d47eb87c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:33.171497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 561/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:21:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:33.177303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb953b5-b02b-4742-9f5f-2aed185983bd None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:33.218408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:33.274192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb953b5-b02b-4742-9f5f-2aed185983bd None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:33.305630 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0149e6-6f5a-40e0-b9e2-652ceceb7706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:33.306227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0149e6-6f5a-40e0-b9e2-652ceceb7706 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:33.306498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0149e6-6f5a-40e0-b9e2-652ceceb7706 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:33.306761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0149e6-6f5a-40e0-b9e2-652ceceb7706 None admin] PATH_INFO: `/v3/users/90157f59d99042fd8ff872255956e5c2` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:33.320145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0149e6-6f5a-40e0-b9e2-652ceceb7706 None admin] RBAC: Authorizing `identity:get_user(user_id=90157f59d99042fd8ff872255956e5c2)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:33.321547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0149e6-6f5a-40e0-b9e2-652ceceb7706 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:33.323071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 582/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:33 2022] GET /identity/v3/users/90157f59d99042fd8ff872255956e5c2 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:33.328660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbcd64-379e-41d7-8c64-da97d47eb87c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:33.386953 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:33.431582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbcd64-379e-41d7-8c64-da97d47eb87c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:33.469255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007d367-0571-46b4-929b-15f7984decb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:33.469854 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007d367-0571-46b4-929b-15f7984decb4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:33.470132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007d367-0571-46b4-929b-15f7984decb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:33.470403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007d367-0571-46b4-929b-15f7984decb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:33.535576 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007d367-0571-46b4-929b-15f7984decb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:33.537014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007d367-0571-46b4-929b-15f7984decb4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:33.592486 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:33.633222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 562/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:21:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:21:33.639236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0149e6-6f5a-40e0-b9e2-652ceceb7706 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:33.731197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:33.734696 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0149e6-6f5a-40e0-b9e2-652ceceb7706 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:33.774213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1baa96-5ecb-4fd7-9ccd-7e307216b82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:33.774867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1baa96-5ecb-4fd7-9ccd-7e307216b82a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:33.775119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1baa96-5ecb-4fd7-9ccd-7e307216b82a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:33.775388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1baa96-5ecb-4fd7-9ccd-7e307216b82a None admin] PATH_INFO: `/v3/projects/5fa38085bee1409bba3e03bbea0b98b2` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:33.776488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1baa96-5ecb-4fd7-9ccd-7e307216b82a None admin] RBAC: Authorizing `identity:get_project(project_id=5fa38085bee1409bba3e03bbea0b98b2)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:33.777910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1baa96-5ecb-4fd7-9ccd-7e307216b82a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:33.779571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 583/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:21:33 2022] GET /identity/v3/projects/5fa38085bee1409bba3e03bbea0b98b2 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:33.785795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007d367-0571-46b4-929b-15f7984decb4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:33.881359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007d367-0571-46b4-929b-15f7984decb4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:33.913682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e14d9-c5bc-41b3-be97-a7ad50996148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:33.914258 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e14d9-c5bc-41b3-be97-a7ad50996148 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:33.914530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e14d9-c5bc-41b3-be97-a7ad50996148 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:33.914795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e14d9-c5bc-41b3-be97-a7ad50996148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:33.915664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e14d9-c5bc-41b3-be97-a7ad50996148 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=5fa38085bee1409bba3e03bbea0b98b2, user.id=90157f59d99042fd8ff872255956e5c2) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:33.915966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e14d9-c5bc-41b3-be97-a7ad50996148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:33.917360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e14d9-c5bc-41b3-be97-a7ad50996148 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:33.922499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 563/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:21:33 2022] GET /identity/v3/role_assignments?user.id=90157f59d99042fd8ff872255956e5c2&scope.project.id=5fa38085bee1409bba3e03bbea0b98b2&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:35.886435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec1a5-fab3-41dc-8579-41a039669c2b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:35.887000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec1a5-fab3-41dc-8579-41a039669c2b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:35.887000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec1a5-fab3-41dc-8579-41a039669c2b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:35.888330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 584/1147] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:35.893629 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c89828-65ea-415d-bf2b-7d939b8d7eee None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:35.894053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c89828-65ea-415d-bf2b-7d939b8d7eee None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:35.894176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c89828-65ea-415d-bf2b-7d939b8d7eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:35.911765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-84c89828-65ea-415d-bf2b-7d939b8d7eee None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:35.912941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-84c89828-65ea-415d-bf2b-7d939b8d7eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:35.930168 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:35.979068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 564/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:36.002790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec1a5-fab3-41dc-8579-41a039669c2b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:36.100152 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec1a5-fab3-41dc-8579-41a039669c2b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:36.132473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dde82-8acb-44b8-8023-bac46e463a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:36.133078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dde82-8acb-44b8-8023-bac46e463a9c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:36.133351 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dde82-8acb-44b8-8023-bac46e463a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:36.133621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dde82-8acb-44b8-8023-bac46e463a9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:36.143124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dde82-8acb-44b8-8023-bac46e463a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-781dde82-8acb-44b8-8023-bac46e463a9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:21:36.147638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:36.148852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:36.149813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 585/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:21:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:36.154846 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c89828-65ea-415d-bf2b-7d939b8d7eee None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:36.249079 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c89828-65ea-415d-bf2b-7d939b8d7eee None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:36.280984 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141e0b3-cb37-418a-a0e1-47773fe41100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:36.281566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141e0b3-cb37-418a-a0e1-47773fe41100 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:36.281837 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141e0b3-cb37-418a-a0e1-47773fe41100 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:36.282100 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141e0b3-cb37-418a-a0e1-47773fe41100 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:36.282757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141e0b3-cb37-418a-a0e1-47773fe41100 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:36.283052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141e0b3-cb37-418a-a0e1-47773fe41100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:36.284418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141e0b3-cb37-418a-a0e1-47773fe41100 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:36.292584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 565/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:21:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:36.298219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dde82-8acb-44b8-8023-bac46e463a9c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:36.325771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:36.395873 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dde82-8acb-44b8-8023-bac46e463a9c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:36.428211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720defd-3a11-4506-957a-294d53942abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:36.428836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720defd-3a11-4506-957a-294d53942abf None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:36.429084 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720defd-3a11-4506-957a-294d53942abf None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:36.429348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720defd-3a11-4506-957a-294d53942abf None admin] PATH_INFO: `/v3/users/90157f59d99042fd8ff872255956e5c2` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:36.430425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720defd-3a11-4506-957a-294d53942abf None admin] RBAC: Authorizing `identity:get_user(user_id=90157f59d99042fd8ff872255956e5c2)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:36.431868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720defd-3a11-4506-957a-294d53942abf None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:36.433384 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 586/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:36 2022] GET /identity/v3/users/90157f59d99042fd8ff872255956e5c2 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:36.438952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141e0b3-cb37-418a-a0e1-47773fe41100 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:36.457027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:36.540430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141e0b3-cb37-418a-a0e1-47773fe41100 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:36.571912 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c704f-3b2a-4cc5-8a9a-f6530c544736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:36.572519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c704f-3b2a-4cc5-8a9a-f6530c544736 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:36.572791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c704f-3b2a-4cc5-8a9a-f6530c544736 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:36.573057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c704f-3b2a-4cc5-8a9a-f6530c544736 None admin] PATH_INFO: `/v3/projects/5fa38085bee1409bba3e03bbea0b98b2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:36.574144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c704f-3b2a-4cc5-8a9a-f6530c544736 None admin] RBAC: Authorizing `identity:get_project(project_id=5fa38085bee1409bba3e03bbea0b98b2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:36.575620 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c704f-3b2a-4cc5-8a9a-f6530c544736 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:36.577215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 566/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:21:36 2022] GET /identity/v3/projects/5fa38085bee1409bba3e03bbea0b98b2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:36.583562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720defd-3a11-4506-957a-294d53942abf None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:36.671986 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:36.678905 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720defd-3a11-4506-957a-294d53942abf None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:36.710893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d90b30-8e33-4d9b-a5b8-34c846458c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:36.711550 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d90b30-8e33-4d9b-a5b8-34c846458c15 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:36.711823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d90b30-8e33-4d9b-a5b8-34c846458c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:36.712086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d90b30-8e33-4d9b-a5b8-34c846458c15 None admin] PATH_INFO: `/v3/projects/5fa38085bee1409bba3e03bbea0b98b2/users/90157f59d99042fd8ff872255956e5c2/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:36.713934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d90b30-8e33-4d9b-a5b8-34c846458c15 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fa38085bee1409bba3e03bbea0b98b2, user_id=90157f59d99042fd8ff872255956e5c2, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:36.715370 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d90b30-8e33-4d9b-a5b8-34c846458c15 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:36.727994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 587/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:21:36 2022] PUT /identity/v3/projects/5fa38085bee1409bba3e03bbea0b98b2/users/90157f59d99042fd8ff872255956e5c2/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:21:38.704627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab94dcf-6f8b-46a7-88ed-a38a41ffd410 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:38.705176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab94dcf-6f8b-46a7-88ed-a38a41ffd410 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:38.705176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab94dcf-6f8b-46a7-88ed-a38a41ffd410 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:38.706497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 567/1154] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:38.712060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f3cf-848e-4264-aa48-f9b65fc081c0 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:38.712467 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f3cf-848e-4264-aa48-f9b65fc081c0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:38.712595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f3cf-848e-4264-aa48-f9b65fc081c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:38.730723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7a94f3cf-848e-4264-aa48-f9b65fc081c0 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:38.731917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7a94f3cf-848e-4264-aa48-f9b65fc081c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:38.795813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 588/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:38.818540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab94dcf-6f8b-46a7-88ed-a38a41ffd410 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:38.900753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:38.917823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab94dcf-6f8b-46a7-88ed-a38a41ffd410 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:38.948924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d0a92-a262-4464-ab07-63aaadea624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:38.949526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d0a92-a262-4464-ab07-63aaadea624d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:38.949798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d0a92-a262-4464-ab07-63aaadea624d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:38.950064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d0a92-a262-4464-ab07-63aaadea624d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:38.961306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d0a92-a262-4464-ab07-63aaadea624d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-576d0a92-a262-4464-ab07-63aaadea624d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:21:38.965895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:38.966991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:38.968159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 568/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:21:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:38.973772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94f3cf-848e-4264-aa48-f9b65fc081c0 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:39.055002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:39.071647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94f3cf-848e-4264-aa48-f9b65fc081c0 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:39.104235 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c3b2-8b1d-4f0f-911b-5480309d7526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:39.104822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c3b2-8b1d-4f0f-911b-5480309d7526 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:39.105094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c3b2-8b1d-4f0f-911b-5480309d7526 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:39.105356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c3b2-8b1d-4f0f-911b-5480309d7526 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:39.106001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599c3b2-8b1d-4f0f-911b-5480309d7526 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:39.106295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599c3b2-8b1d-4f0f-911b-5480309d7526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:39.107668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599c3b2-8b1d-4f0f-911b-5480309d7526 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:39.115365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 589/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:21:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:39.121098 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d0a92-a262-4464-ab07-63aaadea624d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:39.218533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d0a92-a262-4464-ab07-63aaadea624d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:39.250141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8f404-879d-4a37-b62b-e06b67c13c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:39.250751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8f404-879d-4a37-b62b-e06b67c13c73 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:39.251027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8f404-879d-4a37-b62b-e06b67c13c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:39.251325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8f404-879d-4a37-b62b-e06b67c13c73 None admin] PATH_INFO: `/v3/users/90157f59d99042fd8ff872255956e5c2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:39.252434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8f404-879d-4a37-b62b-e06b67c13c73 None admin] RBAC: Authorizing `identity:get_user(user_id=90157f59d99042fd8ff872255956e5c2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:39.254669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8f404-879d-4a37-b62b-e06b67c13c73 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:39.256258 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 569/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:39 2022] GET /identity/v3/users/90157f59d99042fd8ff872255956e5c2 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:39.261899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c3b2-8b1d-4f0f-911b-5480309d7526 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:39.356712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c3b2-8b1d-4f0f-911b-5480309d7526 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:39.389355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6f5c6-512c-492b-93c7-920b3d1cadd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:39.389942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6f5c6-512c-492b-93c7-920b3d1cadd7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:39.390217 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6f5c6-512c-492b-93c7-920b3d1cadd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:39.390485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6f5c6-512c-492b-93c7-920b3d1cadd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:39.404959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:39.454948 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6f5c6-512c-492b-93c7-920b3d1cadd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:39.456386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6f5c6-512c-492b-93c7-920b3d1cadd7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:39.549325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 590/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:21:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:21:39.555698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8f404-879d-4a37-b62b-e06b67c13c73 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:39.570353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:39.651891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8f404-879d-4a37-b62b-e06b67c13c73 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:39.683649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4b0aa-3365-4634-813e-da6e5252e793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:39.684254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4b0aa-3365-4634-813e-da6e5252e793 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:39.684529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4b0aa-3365-4634-813e-da6e5252e793 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:39.684798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4b0aa-3365-4634-813e-da6e5252e793 None admin] PATH_INFO: `/v3/projects/5fa38085bee1409bba3e03bbea0b98b2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:39.685892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4b0aa-3365-4634-813e-da6e5252e793 None admin] RBAC: Authorizing `identity:get_project(project_id=5fa38085bee1409bba3e03bbea0b98b2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:39.687330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4b0aa-3365-4634-813e-da6e5252e793 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:39.688920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 570/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:21:39 2022] GET /identity/v3/projects/5fa38085bee1409bba3e03bbea0b98b2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:39.695383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6f5c6-512c-492b-93c7-920b3d1cadd7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:39.740120 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:39.790811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6f5c6-512c-492b-93c7-920b3d1cadd7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:39.823271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247069e-d49c-4041-8eb3-3e64de461982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:39.823796 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247069e-d49c-4041-8eb3-3e64de461982 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:39.824068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247069e-d49c-4041-8eb3-3e64de461982 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:39.824331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247069e-d49c-4041-8eb3-3e64de461982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:39.825039 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247069e-d49c-4041-8eb3-3e64de461982 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=5fa38085bee1409bba3e03bbea0b98b2, user.id=90157f59d99042fd8ff872255956e5c2) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:39.825339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247069e-d49c-4041-8eb3-3e64de461982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:39.826734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247069e-d49c-4041-8eb3-3e64de461982 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:39.832356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 591/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:21:39 2022] GET /identity/v3/role_assignments?user.id=90157f59d99042fd8ff872255956e5c2&scope.project.id=5fa38085bee1409bba3e03bbea0b98b2&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:41.847675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0dbc0-d516-4322-a6d6-4b25d25a0a0d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:41.848817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0dbc0-d516-4322-a6d6-4b25d25a0a0d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:41.848817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0dbc0-d516-4322-a6d6-4b25d25a0a0d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:41.850076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 571/1162] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:41.855121 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6dca6-4300-4af6-b1f7-087fa9302c70 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:41.855544 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6dca6-4300-4af6-b1f7-087fa9302c70 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:41.855652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6dca6-4300-4af6-b1f7-087fa9302c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:41.873060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-16e6dca6-4300-4af6-b1f7-087fa9302c70 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:41.874213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-16e6dca6-4300-4af6-b1f7-087fa9302c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:41.937964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 592/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:41.959472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0dbc0-d516-4322-a6d6-4b25d25a0a0d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:42.039765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:42.058892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0dbc0-d516-4322-a6d6-4b25d25a0a0d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:42.091103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b6fd1-9bcd-4919-b383-536644470421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:42.091682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b6fd1-9bcd-4919-b383-536644470421 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:42.091953 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b6fd1-9bcd-4919-b383-536644470421 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:42.092217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b6fd1-9bcd-4919-b383-536644470421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:42.156253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b6fd1-9bcd-4919-b383-536644470421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:42.157632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b6fd1-9bcd-4919-b383-536644470421 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:42.232821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:42.251771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 572/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:21:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:21:42.258675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6dca6-4300-4af6-b1f7-087fa9302c70 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:42.298347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:42.354337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6dca6-4300-4af6-b1f7-087fa9302c70 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:42.388956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57467c09-1cea-44af-baee-70378442bab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:42.389705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57467c09-1cea-44af-baee-70378442bab8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:42.389984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57467c09-1cea-44af-baee-70378442bab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:42.390300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57467c09-1cea-44af-baee-70378442bab8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:42.396884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57467c09-1cea-44af-baee-70378442bab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:42.398345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57467c09-1cea-44af-baee-70378442bab8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-57467c09-1cea-44af-baee-70378442bab8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:42.410417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:42.411621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:42.412668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 593/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 22:21:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:42.417458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b6fd1-9bcd-4919-b383-536644470421 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:42.513657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b6fd1-9bcd-4919-b383-536644470421 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:42.548713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fc362-a027-4b78-bfef-fe5e62d8ab22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:42.549306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc362-a027-4b78-bfef-fe5e62d8ab22 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:42.549581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc362-a027-4b78-bfef-fe5e62d8ab22 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:42.549850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc362-a027-4b78-bfef-fe5e62d8ab22 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:42.550500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fc362-a027-4b78-bfef-fe5e62d8ab22 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:42.550794 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fc362-a027-4b78-bfef-fe5e62d8ab22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:42.552701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fc362-a027-4b78-bfef-fe5e62d8ab22 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:42.559713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 573/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 22:21:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:44.511986 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c28126-42b5-4d14-828e-739f425adead None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:44.512536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c28126-42b5-4d14-828e-739f425adead None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:44.512536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c28126-42b5-4d14-828e-739f425adead None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:44.513831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 594/1167] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:44.518952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b5055-1feb-4b98-9715-0555da6a2796 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:44.519405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b5055-1feb-4b98-9715-0555da6a2796 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:44.519527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b5055-1feb-4b98-9715-0555da6a2796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:44.542246 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-397b5055-1feb-4b98-9715-0555da6a2796 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:44.543452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-397b5055-1feb-4b98-9715-0555da6a2796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:44.581771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:44.607885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 574/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:44.630409 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c28126-42b5-4d14-828e-739f425adead None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:44.727211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:44.731297 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c28126-42b5-4d14-828e-739f425adead None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:44.763948 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0b7cb-d172-4da4-9669-36e8b54987e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:44.764476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0b7cb-d172-4da4-9669-36e8b54987e3 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:44.764748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0b7cb-d172-4da4-9669-36e8b54987e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:44.765013 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0b7cb-d172-4da4-9669-36e8b54987e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:44.765652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0b7cb-d172-4da4-9669-36e8b54987e3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:44.766996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0b7cb-d172-4da4-9669-36e8b54987e3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:44.782447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 595/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Sun Aug 7 22:21:44 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:21:46.766539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02746c7-bbd1-42b8-88ea-e4c50a9a0e6b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:46.767073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02746c7-bbd1-42b8-88ea-e4c50a9a0e6b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:46.767073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02746c7-bbd1-42b8-88ea-e4c50a9a0e6b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:46.768433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 575/1170] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:46.774316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4aab88-15d6-4288-a85c-7481d3697ab5 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:46.774732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4aab88-15d6-4288-a85c-7481d3697ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:46.774839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4aab88-15d6-4288-a85c-7481d3697ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:46.792247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0c4aab88-15d6-4288-a85c-7481d3697ab5 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:46.793404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0c4aab88-15d6-4288-a85c-7481d3697ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:46.856406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 596/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:46.879571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02746c7-bbd1-42b8-88ea-e4c50a9a0e6b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:46.976219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02746c7-bbd1-42b8-88ea-e4c50a9a0e6b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:47.009844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdd61a-49ce-4d38-b9bb-a33e065c7eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:47.010454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdd61a-49ce-4d38-b9bb-a33e065c7eed None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:47.010725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdd61a-49ce-4d38-b9bb-a33e065c7eed None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:47.010988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdd61a-49ce-4d38-b9bb-a33e065c7eed None admin] PATH_INFO: `/v3/domains/e4bc1ddf17fb4d2ab9ac610664af3c02` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:47.020899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdd61a-49ce-4d38-b9bb-a33e065c7eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=e4bc1ddf17fb4d2ab9ac610664af3c02)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:47.022262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdd61a-49ce-4d38-b9bb-a33e065c7eed None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:47.023864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 576/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Sun Aug 7 22:21:46 2022] GET /identity/v3/domains/e4bc1ddf17fb4d2ab9ac610664af3c02 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:47.029619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4aab88-15d6-4288-a85c-7481d3697ab5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:47.115253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:47.125654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4aab88-15d6-4288-a85c-7481d3697ab5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:47.158390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0a60e-27cb-45ed-9271-079d63a6b590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:47.158980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0a60e-27cb-45ed-9271-079d63a6b590 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:47.159291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0a60e-27cb-45ed-9271-079d63a6b590 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:47.159561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0a60e-27cb-45ed-9271-079d63a6b590 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:47.160184 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0a60e-27cb-45ed-9271-079d63a6b590 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:47.161616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0a60e-27cb-45ed-9271-079d63a6b590 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:47.186854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 597/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:21:47 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:21:49.218595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eca82-de0f-4b94-bb22-054638eb8da3 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:49.219138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eca82-de0f-4b94-bb22-054638eb8da3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:49.219138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eca82-de0f-4b94-bb22-054638eb8da3 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:49.220488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 577/1174] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:49.225633 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3544b5-77b9-4b62-82b0-4dc4167ed659 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:49.226022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3544b5-77b9-4b62-82b0-4dc4167ed659 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:49.226179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3544b5-77b9-4b62-82b0-4dc4167ed659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:49.244387 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-be3544b5-77b9-4b62-82b0-4dc4167ed659 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:49.245495 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-be3544b5-77b9-4b62-82b0-4dc4167ed659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:49.309966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 598/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:49.334355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eca82-de0f-4b94-bb22-054638eb8da3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:49.368709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:49.437180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eca82-de0f-4b94-bb22-054638eb8da3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:49.468948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11653ad2-47ea-431e-90d5-2e0add9e8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:49.469555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11653ad2-47ea-431e-90d5-2e0add9e8580 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:49.469828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11653ad2-47ea-431e-90d5-2e0add9e8580 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:49.470094 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11653ad2-47ea-431e-90d5-2e0add9e8580 None admin] PATH_INFO: `/v3/domains/e4bc1ddf17fb4d2ab9ac610664af3c02` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:49.471193 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11653ad2-47ea-431e-90d5-2e0add9e8580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e4bc1ddf17fb4d2ab9ac610664af3c02)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:49.472602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11653ad2-47ea-431e-90d5-2e0add9e8580 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:49.474677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 578/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Sun Aug 7 22:21:49 2022] GET /identity/v3/domains/e4bc1ddf17fb4d2ab9ac610664af3c02 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:49.480456 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3544b5-77b9-4b62-82b0-4dc4167ed659 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:49.546452 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:49.574721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3544b5-77b9-4b62-82b0-4dc4167ed659 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:49.606674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079cc3f-fbb0-4ef0-9237-3252a0f3b93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:49.607286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079cc3f-fbb0-4ef0-9237-3252a0f3b93b None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:49.607560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079cc3f-fbb0-4ef0-9237-3252a0f3b93b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:49.607823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079cc3f-fbb0-4ef0-9237-3252a0f3b93b None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:49.608440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079cc3f-fbb0-4ef0-9237-3252a0f3b93b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:49.609829 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079cc3f-fbb0-4ef0-9237-3252a0f3b93b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:49.629911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 599/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:21:49 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:21:51.641750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba363-71b5-4708-b6e9-0095bcf060df None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:51.642282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba363-71b5-4708-b6e9-0095bcf060df None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:51.642282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba363-71b5-4708-b6e9-0095bcf060df None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:51.643698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 579/1178] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:51.648794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55ef0e-70ea-4e00-ad6f-aafe44d3b4a7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:51.649208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55ef0e-70ea-4e00-ad6f-aafe44d3b4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:51.649336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55ef0e-70ea-4e00-ad6f-aafe44d3b4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:51.667691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6a55ef0e-70ea-4e00-ad6f-aafe44d3b4a7 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:51.668859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6a55ef0e-70ea-4e00-ad6f-aafe44d3b4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:51.733639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 600/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:51.757602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ba363-71b5-4708-b6e9-0095bcf060df None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:51.856591 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ba363-71b5-4708-b6e9-0095bcf060df None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:51.858061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:51.890482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fed423-d943-4a67-87e4-7170718c147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:51.891108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fed423-d943-4a67-87e4-7170718c147c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:51.891390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fed423-d943-4a67-87e4-7170718c147c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:51.891660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fed423-d943-4a67-87e4-7170718c147c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:51.901879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fed423-d943-4a67-87e4-7170718c147c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b3fed423-d943-4a67-87e4-7170718c147c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:21:51.906484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:51.907578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:51.908479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 580/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:21:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:51.913972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55ef0e-70ea-4e00-ad6f-aafe44d3b4a7 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:51.968400 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:52.010724 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55ef0e-70ea-4e00-ad6f-aafe44d3b4a7 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:52.043664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473da06e-9eb4-4f35-bba7-105993c78994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:52.044258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473da06e-9eb4-4f35-bba7-105993c78994 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:52.044534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473da06e-9eb4-4f35-bba7-105993c78994 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:52.044802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473da06e-9eb4-4f35-bba7-105993c78994 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:52.045459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473da06e-9eb4-4f35-bba7-105993c78994 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:52.045787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473da06e-9eb4-4f35-bba7-105993c78994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:52.047149 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473da06e-9eb4-4f35-bba7-105993c78994 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:52.055463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 601/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:21:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:52.061310 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fed423-d943-4a67-87e4-7170718c147c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:52.158376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fed423-d943-4a67-87e4-7170718c147c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:52.190885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a773897-1222-48e7-a726-da16582e07cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:52.191522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a773897-1222-48e7-a726-da16582e07cc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:52.191828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a773897-1222-48e7-a726-da16582e07cc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:52.192099 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a773897-1222-48e7-a726-da16582e07cc None admin] PATH_INFO: `/v3/users/b42a3baf1eec43339bfa3b6e58f13f05` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:52.204669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a773897-1222-48e7-a726-da16582e07cc None admin] RBAC: Authorizing `identity:get_user(user_id=b42a3baf1eec43339bfa3b6e58f13f05)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:52.206089 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a773897-1222-48e7-a726-da16582e07cc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:52.208258 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 581/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:52 2022] GET /identity/v3/users/b42a3baf1eec43339bfa3b6e58f13f05 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:52.213745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473da06e-9eb4-4f35-bba7-105993c78994 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:52.308980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473da06e-9eb4-4f35-bba7-105993c78994 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:52.327619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:52.343928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b410e8-000d-4998-8fac-00165ea65047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:52.344927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b410e8-000d-4998-8fac-00165ea65047 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:52.345216 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b410e8-000d-4998-8fac-00165ea65047 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:52.345490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b410e8-000d-4998-8fac-00165ea65047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:52.413114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b410e8-000d-4998-8fac-00165ea65047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:52.414520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b410e8-000d-4998-8fac-00165ea65047 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:52.508404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 602/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:21:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:21:52.514405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a773897-1222-48e7-a726-da16582e07cc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:52.535999 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:52.616468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a773897-1222-48e7-a726-da16582e07cc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:52.649717 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f29cd-7b63-4f90-b4f6-f92c4f4ea067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:52.650327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f29cd-7b63-4f90-b4f6-f92c4f4ea067 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:52.650603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f29cd-7b63-4f90-b4f6-f92c4f4ea067 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:52.650873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f29cd-7b63-4f90-b4f6-f92c4f4ea067 None admin] PATH_INFO: `/v3/projects/3f818f982c45428b8e59ca10d927cb0e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:52.652019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f29cd-7b63-4f90-b4f6-f92c4f4ea067 None admin] RBAC: Authorizing `identity:get_project(project_id=3f818f982c45428b8e59ca10d927cb0e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:52.653432 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f29cd-7b63-4f90-b4f6-f92c4f4ea067 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:52.655043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 582/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:21:52 2022] GET /identity/v3/projects/3f818f982c45428b8e59ca10d927cb0e => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:52.661085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b410e8-000d-4998-8fac-00165ea65047 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:52.681612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:52.756801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b410e8-000d-4998-8fac-00165ea65047 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:52.790397 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7433d2-c2bd-4bc3-9dc3-6f6757db6917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:52.790992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7433d2-c2bd-4bc3-9dc3-6f6757db6917 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:52.791298 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7433d2-c2bd-4bc3-9dc3-6f6757db6917 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:52.791571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7433d2-c2bd-4bc3-9dc3-6f6757db6917 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:52.792291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7433d2-c2bd-4bc3-9dc3-6f6757db6917 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=3f818f982c45428b8e59ca10d927cb0e, user.id=b42a3baf1eec43339bfa3b6e58f13f05) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:52.792597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7433d2-c2bd-4bc3-9dc3-6f6757db6917 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:52.794000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7433d2-c2bd-4bc3-9dc3-6f6757db6917 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:52.799270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 603/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:21:52 2022] GET /identity/v3/role_assignments?user.id=b42a3baf1eec43339bfa3b6e58f13f05&scope.project.id=3f818f982c45428b8e59ca10d927cb0e&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:54.768595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689df3b-7b45-4682-ba78-3c97ac96c8fe None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:54.769151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689df3b-7b45-4682-ba78-3c97ac96c8fe None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:54.769151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689df3b-7b45-4682-ba78-3c97ac96c8fe None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:54.771035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 583/1186] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:54.776066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52520490-6ed1-4756-94fc-e0015b90de97 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:54.776475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52520490-6ed1-4756-94fc-e0015b90de97 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:54.776609 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52520490-6ed1-4756-94fc-e0015b90de97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:54.794616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-52520490-6ed1-4756-94fc-e0015b90de97 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:54.795825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-52520490-6ed1-4756-94fc-e0015b90de97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:54.862772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 604/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:54.885224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689df3b-7b45-4682-ba78-3c97ac96c8fe None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:54.970346 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:54.983973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689df3b-7b45-4682-ba78-3c97ac96c8fe None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:55.019068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa297e-dbbe-43e0-8420-a8b108637be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:55.019651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa297e-dbbe-43e0-8420-a8b108637be6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:55.019929 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa297e-dbbe-43e0-8420-a8b108637be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:55.020196 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa297e-dbbe-43e0-8420-a8b108637be6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:55.029889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa297e-dbbe-43e0-8420-a8b108637be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a4aa297e-dbbe-43e0-8420-a8b108637be6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:21:55.034561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:55.036171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:21:55.037212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 584/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:21:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:55.042123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52520490-6ed1-4756-94fc-e0015b90de97 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:55.057301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:55.138318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52520490-6ed1-4756-94fc-e0015b90de97 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:55.171488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0122c57-d29b-48a8-923d-2a59fdfd579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:55.172075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0122c57-d29b-48a8-923d-2a59fdfd579b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:55.172348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0122c57-d29b-48a8-923d-2a59fdfd579b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:55.172616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0122c57-d29b-48a8-923d-2a59fdfd579b None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:55.173268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0122c57-d29b-48a8-923d-2a59fdfd579b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:55.173569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0122c57-d29b-48a8-923d-2a59fdfd579b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:55.174907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0122c57-d29b-48a8-923d-2a59fdfd579b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:55.182674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 605/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:21:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:55.188332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa297e-dbbe-43e0-8420-a8b108637be6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:55.283849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa297e-dbbe-43e0-8420-a8b108637be6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:55.315967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea10a3-bf07-4ecc-b031-ed938a0462d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:55.316563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea10a3-bf07-4ecc-b031-ed938a0462d0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:55.316858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea10a3-bf07-4ecc-b031-ed938a0462d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:55.317127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea10a3-bf07-4ecc-b031-ed938a0462d0 None admin] PATH_INFO: `/v3/users/b42a3baf1eec43339bfa3b6e58f13f05` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:55.318215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea10a3-bf07-4ecc-b031-ed938a0462d0 None admin] RBAC: Authorizing `identity:get_user(user_id=b42a3baf1eec43339bfa3b6e58f13f05)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:55.319646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea10a3-bf07-4ecc-b031-ed938a0462d0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:55.321159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 585/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:55 2022] GET /identity/v3/users/b42a3baf1eec43339bfa3b6e58f13f05 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:55.326780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0122c57-d29b-48a8-923d-2a59fdfd579b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:55.402419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:55.425895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0122c57-d29b-48a8-923d-2a59fdfd579b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:55.458137 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b543ace-69b7-44c3-ac95-7a0031ab046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:55.458738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543ace-69b7-44c3-ac95-7a0031ab046e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:55.459006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543ace-69b7-44c3-ac95-7a0031ab046e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:55.459297 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543ace-69b7-44c3-ac95-7a0031ab046e None admin] PATH_INFO: `/v3/projects/3f818f982c45428b8e59ca10d927cb0e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:55.460386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b543ace-69b7-44c3-ac95-7a0031ab046e None admin] RBAC: Authorizing `identity:get_project(project_id=3f818f982c45428b8e59ca10d927cb0e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:55.461785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b543ace-69b7-44c3-ac95-7a0031ab046e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:55.463410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 606/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:21:55 2022] GET /identity/v3/projects/3f818f982c45428b8e59ca10d927cb0e => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:55.469458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea10a3-bf07-4ecc-b031-ed938a0462d0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:55.487440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:55.565905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea10a3-bf07-4ecc-b031-ed938a0462d0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:55.598759 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bb89a-4057-4d74-bb68-281d787e3258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:55.599420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bb89a-4057-4d74-bb68-281d787e3258 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:55.599698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bb89a-4057-4d74-bb68-281d787e3258 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:55.599965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bb89a-4057-4d74-bb68-281d787e3258 None admin] PATH_INFO: `/v3/projects/3f818f982c45428b8e59ca10d927cb0e/users/b42a3baf1eec43339bfa3b6e58f13f05/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:55.601796 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bb89a-4057-4d74-bb68-281d787e3258 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f818f982c45428b8e59ca10d927cb0e, user_id=b42a3baf1eec43339bfa3b6e58f13f05, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:55.603294 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bb89a-4057-4d74-bb68-281d787e3258 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:55.615371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 586/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:21:55 2022] PUT /identity/v3/projects/3f818f982c45428b8e59ca10d927cb0e/users/b42a3baf1eec43339bfa3b6e58f13f05/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:21:57.566228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738828c-7158-4637-8bcc-feed29e29308 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:57.567564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738828c-7158-4637-8bcc-feed29e29308 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:57.567564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738828c-7158-4637-8bcc-feed29e29308 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:57.568649 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 607/1193] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:21:57.573826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccb970-06ef-4aca-a47b-b03dfc41366a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:57.574253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccb970-06ef-4aca-a47b-b03dfc41366a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:57.574353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccb970-06ef-4aca-a47b-b03dfc41366a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:57.592285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e2ccb970-06ef-4aca-a47b-b03dfc41366a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:21:57.593456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e2ccb970-06ef-4aca-a47b-b03dfc41366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:21:57.657066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 587/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:21:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:21:57.680090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738828c-7158-4637-8bcc-feed29e29308 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:57.778315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738828c-7158-4637-8bcc-feed29e29308 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:57.809697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca96958-15ce-44dd-85ea-60e734beb59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:57.810303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca96958-15ce-44dd-85ea-60e734beb59a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:57.810577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca96958-15ce-44dd-85ea-60e734beb59a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:57.810843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca96958-15ce-44dd-85ea-60e734beb59a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:57.821454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca96958-15ce-44dd-85ea-60e734beb59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-eca96958-15ce-44dd-85ea-60e734beb59a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:21:57.825998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:21:57.827187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:21:57.828092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 608/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:21:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:21:57.833485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccb970-06ef-4aca-a47b-b03dfc41366a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:57.841337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:57.929523 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccb970-06ef-4aca-a47b-b03dfc41366a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:57.963288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a6aa2-53b2-400f-908a-70a49f7eb536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:57.963869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a6aa2-53b2-400f-908a-70a49f7eb536 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:57.964143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a6aa2-53b2-400f-908a-70a49f7eb536 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:57.964407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a6aa2-53b2-400f-908a-70a49f7eb536 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:57.965054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a6aa2-53b2-400f-908a-70a49f7eb536 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:57.965350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a6aa2-53b2-400f-908a-70a49f7eb536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:57.966828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a6aa2-53b2-400f-908a-70a49f7eb536 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:57.974955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 588/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:21:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:57.980608 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca96958-15ce-44dd-85ea-60e734beb59a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:57.984461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:58.076874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca96958-15ce-44dd-85ea-60e734beb59a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:58.108725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a8a79-4ad7-462f-8b41-b0f228ff2e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:58.109331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a8a79-4ad7-462f-8b41-b0f228ff2e5e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:58.109602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a8a79-4ad7-462f-8b41-b0f228ff2e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:58.109868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a8a79-4ad7-462f-8b41-b0f228ff2e5e None admin] PATH_INFO: `/v3/users/b42a3baf1eec43339bfa3b6e58f13f05` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:58.110944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a8a79-4ad7-462f-8b41-b0f228ff2e5e None admin] RBAC: Authorizing `identity:get_user(user_id=b42a3baf1eec43339bfa3b6e58f13f05)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:58.112373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a8a79-4ad7-462f-8b41-b0f228ff2e5e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:58.114444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 609/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 22:21:57 2022] GET /identity/v3/users/b42a3baf1eec43339bfa3b6e58f13f05 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:58.120114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a6aa2-53b2-400f-908a-70a49f7eb536 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:58.183255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:58.215968 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a6aa2-53b2-400f-908a-70a49f7eb536 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:58.248037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cf82f-b44f-4c81-88fd-69e168a331ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:58.248630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cf82f-b44f-4c81-88fd-69e168a331ea None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:58.248906 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cf82f-b44f-4c81-88fd-69e168a331ea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:58.249173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cf82f-b44f-4c81-88fd-69e168a331ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:58.313230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cf82f-b44f-4c81-88fd-69e168a331ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:58.314655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cf82f-b44f-4c81-88fd-69e168a331ea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:58.375753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:58.408553 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 589/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:21:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:21:58.414432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a8a79-4ad7-462f-8b41-b0f228ff2e5e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:58.482287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:21:58.511509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a8a79-4ad7-462f-8b41-b0f228ff2e5e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:58.543307 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8fa3e-4d8a-45e8-90ff-a1828a568533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:58.543911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8fa3e-4d8a-45e8-90ff-a1828a568533 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:58.544187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8fa3e-4d8a-45e8-90ff-a1828a568533 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:58.544457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8fa3e-4d8a-45e8-90ff-a1828a568533 None admin] PATH_INFO: `/v3/projects/3f818f982c45428b8e59ca10d927cb0e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:58.545548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8fa3e-4d8a-45e8-90ff-a1828a568533 None admin] RBAC: Authorizing `identity:get_project(project_id=3f818f982c45428b8e59ca10d927cb0e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:58.546954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8fa3e-4d8a-45e8-90ff-a1828a568533 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:58.548599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 610/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 22:21:58 2022] GET /identity/v3/projects/3f818f982c45428b8e59ca10d927cb0e => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:21:58.555301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cf82f-b44f-4c81-88fd-69e168a331ea None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:21:58.652585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cf82f-b44f-4c81-88fd-69e168a331ea None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:21:58.685535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d118129-3bbd-4135-9252-b52a319de10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:21:58.686117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d118129-3bbd-4135-9252-b52a319de10a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:21:58.686390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d118129-3bbd-4135-9252-b52a319de10a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:21:58.686659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d118129-3bbd-4135-9252-b52a319de10a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:21:58.687408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d118129-3bbd-4135-9252-b52a319de10a None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=3f818f982c45428b8e59ca10d927cb0e, user.id=b42a3baf1eec43339bfa3b6e58f13f05) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:21:58.687712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d118129-3bbd-4135-9252-b52a319de10a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:21:58.689118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d118129-3bbd-4135-9252-b52a319de10a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:21:58.694625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 590/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:21:58 2022] GET /identity/v3/role_assignments?user.id=b42a3baf1eec43339bfa3b6e58f13f05&scope.project.id=3f818f982c45428b8e59ca10d927cb0e&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:22:08.539289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=30 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:08.692117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=84 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:53.747528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a39734-3e97-4944-a95d-dc1ade27dd40 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:53.748248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a39734-3e97-4944-a95d-dc1ade27dd40 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:53.748248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a39734-3e97-4944-a95d-dc1ade27dd40 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:53.749545 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 611/1201] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:22:53.757881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f75bdb-eacf-4f10-9a9d-1e60917b9cf0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:53.758391 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f75bdb-eacf-4f10-9a9d-1e60917b9cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:53.758391 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f75bdb-eacf-4f10-9a9d-1e60917b9cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:53.784517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-92f75bdb-eacf-4f10-9a9d-1e60917b9cf0 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:22:53.785729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-92f75bdb-eacf-4f10-9a9d-1e60917b9cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:22:53.881941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 591/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:22:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:22:53.911971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a39734-3e97-4944-a95d-dc1ade27dd40 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:54.053445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a39734-3e97-4944-a95d-dc1ade27dd40 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:54.097986 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7daa33-1f49-4d67-a06d-bffe26e97ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:54.099481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7daa33-1f49-4d67-a06d-bffe26e97ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:54.099955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7daa33-1f49-4d67-a06d-bffe26e97ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:54.100419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7daa33-1f49-4d67-a06d-bffe26e97ff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:54.118504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7daa33-1f49-4d67-a06d-bffe26e97ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:54.119982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7daa33-1f49-4d67-a06d-bffe26e97ff9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-6c7daa33-1f49-4d67-a06d-bffe26e97ff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:22:54.137903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:22:54.139143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:22:54.140202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:22:54.140202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:22:54.140202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:22:54.142225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 612/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:22:54.149266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f75bdb-eacf-4f10-9a9d-1e60917b9cf0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:54.283051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f75bdb-eacf-4f10-9a9d-1e60917b9cf0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:54.321491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:54.328148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de56c37-948c-46da-b459-ff1894d3cbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:54.328839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de56c37-948c-46da-b459-ff1894d3cbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:54.329225 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de56c37-948c-46da-b459-ff1894d3cbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:54.329537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de56c37-948c-46da-b459-ff1894d3cbd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:54.330265 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de56c37-948c-46da-b459-ff1894d3cbd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:22:54.330827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de56c37-948c-46da-b459-ff1894d3cbd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:54.332210 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de56c37-948c-46da-b459-ff1894d3cbd5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:54.345807 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 592/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:22:54.352966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7daa33-1f49-4d67-a06d-bffe26e97ff9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:54.427891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:54.498501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7daa33-1f49-4d67-a06d-bffe26e97ff9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:54.540273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb66f1c-7c85-4e7a-9f24-12bfffcc4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:54.540930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb66f1c-7c85-4e7a-9f24-12bfffcc4d66 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:54.541240 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb66f1c-7c85-4e7a-9f24-12bfffcc4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:54.541508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb66f1c-7c85-4e7a-9f24-12bfffcc4d66 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:54.542152 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb66f1c-7c85-4e7a-9f24-12bfffcc4d66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:54.546648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb66f1c-7c85-4e7a-9f24-12bfffcc4d66 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:54.572971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 613/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 22:22:54 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:22:56.831919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397529d4-c92d-4e83-9b65-1462b0cdbc24 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:56.832523 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397529d4-c92d-4e83-9b65-1462b0cdbc24 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:56.832613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397529d4-c92d-4e83-9b65-1462b0cdbc24 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:56.834329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 593/1206] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:22:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:22:56.840257 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e4b9-e2f4-42a1-961e-3e10b634ed5a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:56.841008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e4b9-e2f4-42a1-961e-3e10b634ed5a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:56.841008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e4b9-e2f4-42a1-961e-3e10b634ed5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:56.861887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5381e4b9-e2f4-42a1-961e-3e10b634ed5a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:22:56.863144 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5381e4b9-e2f4-42a1-961e-3e10b634ed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:22:56.948426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 614/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:22:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 22:22:56.973020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397529d4-c92d-4e83-9b65-1462b0cdbc24 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:57.097254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397529d4-c92d-4e83-9b65-1462b0cdbc24 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:57.139589 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b8ada-6ce3-4483-945f-538766abdd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:57.140297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b8ada-6ce3-4483-945f-538766abdd2e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:57.140630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b8ada-6ce3-4483-945f-538766abdd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:57.140914 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b8ada-6ce3-4483-945f-538766abdd2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:57.155513 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b8ada-6ce3-4483-945f-538766abdd2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2d3b8ada-6ce3-4483-945f-538766abdd2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:22:57.160773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:22:57.162300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:22:57.171303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 594/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:22:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:22:57.172043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381e4b9-e2f4-42a1-961e-3e10b634ed5a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:57.213407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:57.285944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381e4b9-e2f4-42a1-961e-3e10b634ed5a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:57.326274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331e2c0-f842-4ab4-870d-51ef79d33502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:57.327192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331e2c0-f842-4ab4-870d-51ef79d33502 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:57.327500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331e2c0-f842-4ab4-870d-51ef79d33502 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:57.327773 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331e2c0-f842-4ab4-870d-51ef79d33502 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:57.328541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331e2c0-f842-4ab4-870d-51ef79d33502 None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:22:57.328840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331e2c0-f842-4ab4-870d-51ef79d33502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:57.330316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331e2c0-f842-4ab4-870d-51ef79d33502 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:57.345161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 615/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:22:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:22:57.351068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b8ada-6ce3-4483-945f-538766abdd2e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:57.409991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:57.466399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b8ada-6ce3-4483-945f-538766abdd2e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:57.508821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dd0d3-7dc9-46ef-9bae-33202e348e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:57.509483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dd0d3-7dc9-46ef-9bae-33202e348e0c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:57.509780 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dd0d3-7dc9-46ef-9bae-33202e348e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:57.510065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dd0d3-7dc9-46ef-9bae-33202e348e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:57.525425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dd0d3-7dc9-46ef-9bae-33202e348e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:57.526921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dd0d3-7dc9-46ef-9bae-33202e348e0c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a18dd0d3-7dc9-46ef-9bae-33202e348e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:22:57.545071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:22:57.546276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:22:57.547402 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:22:57.547402 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:22:57.547402 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:22:57.548819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 595/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:22:57.555038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331e2c0-f842-4ab4-870d-51ef79d33502 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:57.672741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:57.676039 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331e2c0-f842-4ab4-870d-51ef79d33502 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:57.718347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b3b4c-6b7e-40b0-8dbd-479203c07d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:57.718948 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b3b4c-6b7e-40b0-8dbd-479203c07d58 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:57.719263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b3b4c-6b7e-40b0-8dbd-479203c07d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:57.719530 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b3b4c-6b7e-40b0-8dbd-479203c07d58 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:57.720172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b3b4c-6b7e-40b0-8dbd-479203c07d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:22:57.720471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b3b4c-6b7e-40b0-8dbd-479203c07d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:57.721816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b3b4c-6b7e-40b0-8dbd-479203c07d58 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:57.735274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 616/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:22:57.741787 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dd0d3-7dc9-46ef-9bae-33202e348e0c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:57.868204 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dd0d3-7dc9-46ef-9bae-33202e348e0c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:57.869807 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:57.908698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda303ad-c43d-41a6-b35e-8114c33b5cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:57.909425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda303ad-c43d-41a6-b35e-8114c33b5cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:57.909907 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda303ad-c43d-41a6-b35e-8114c33b5cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:57.910218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda303ad-c43d-41a6-b35e-8114c33b5cc5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:57.919631 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda303ad-c43d-41a6-b35e-8114c33b5cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:57.921086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda303ad-c43d-41a6-b35e-8114c33b5cc5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-eda303ad-c43d-41a6-b35e-8114c33b5cc5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:22:57.934370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:22:57.935534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:22:57.936507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:22:57.936507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:22:57.936507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:22:57.936507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:22:57.936507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:22:57.936507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:22:57.936507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:22:57.936507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:22:57.936507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 22:22:57.936507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:22:57.936507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 596/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:22:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:22:57.941636 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b3b4c-6b7e-40b0-8dbd-479203c07d58 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:58.074541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b3b4c-6b7e-40b0-8dbd-479203c07d58 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:58.113107 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31dc7-83df-4b21-97c9-14e877c1d44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:58.113737 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31dc7-83df-4b21-97c9-14e877c1d44b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:58.114078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31dc7-83df-4b21-97c9-14e877c1d44b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:58.114383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31dc7-83df-4b21-97c9-14e877c1d44b None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:58.117398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db31dc7-83df-4b21-97c9-14e877c1d44b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:22:58.117398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db31dc7-83df-4b21-97c9-14e877c1d44b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:58.117398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db31dc7-83df-4b21-97c9-14e877c1d44b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:58.137096 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 617/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Aug 7 22:22:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:22:58.143013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda303ad-c43d-41a6-b35e-8114c33b5cc5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:58.271876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda303ad-c43d-41a6-b35e-8114c33b5cc5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:58.313897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac07d7-5461-4e4c-b3d0-d214a4b3ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:58.314647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac07d7-5461-4e4c-b3d0-d214a4b3ae61 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:58.314951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac07d7-5461-4e4c-b3d0-d214a4b3ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:58.315334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac07d7-5461-4e4c-b3d0-d214a4b3ae61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:58.350982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:58.396234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac07d7-5461-4e4c-b3d0-d214a4b3ae61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:58.397908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac07d7-5461-4e4c-b3d0-d214a4b3ae61 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:58.527882 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 597/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:22:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:22:58.534126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31dc7-83df-4b21-97c9-14e877c1d44b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:58.563242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:58.671497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31dc7-83df-4b21-97c9-14e877c1d44b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:58.714787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01042d44-8dec-4435-94b4-bddc0dff92d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:58.715590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01042d44-8dec-4435-94b4-bddc0dff92d1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:58.715946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01042d44-8dec-4435-94b4-bddc0dff92d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:58.716302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01042d44-8dec-4435-94b4-bddc0dff92d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:58.730559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01042d44-8dec-4435-94b4-bddc0dff92d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:58.732239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01042d44-8dec-4435-94b4-bddc0dff92d1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-01042d44-8dec-4435-94b4-bddc0dff92d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:22:58.752388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:22:58.754837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:22:58.755814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:22:58.755814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:22:58.755814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:22:58.755814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 618/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:22:58.760587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac07d7-5461-4e4c-b3d0-d214a4b3ae61 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:58.833770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:58.880751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac07d7-5461-4e4c-b3d0-d214a4b3ae61 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:58.920020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0673f-c6a2-4ca9-ad38-429855621f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:58.921849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0673f-c6a2-4ca9-ad38-429855621f21 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:58.921849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0673f-c6a2-4ca9-ad38-429855621f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:58.921849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0673f-c6a2-4ca9-ad38-429855621f21 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:58.921849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0673f-c6a2-4ca9-ad38-429855621f21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:22:58.922209 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0673f-c6a2-4ca9-ad38-429855621f21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:58.923461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0673f-c6a2-4ca9-ad38-429855621f21 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:58.935015 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 598/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:22:58.940487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01042d44-8dec-4435-94b4-bddc0dff92d1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:59.025345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:59.062043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01042d44-8dec-4435-94b4-bddc0dff92d1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:59.112173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007939e1-7c14-404d-a12b-a3540be16a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:59.112728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007939e1-7c14-404d-a12b-a3540be16a5a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:59.113008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007939e1-7c14-404d-a12b-a3540be16a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:59.113279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007939e1-7c14-404d-a12b-a3540be16a5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:59.121646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007939e1-7c14-404d-a12b-a3540be16a5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:59.124661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007939e1-7c14-404d-a12b-a3540be16a5a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-007939e1-7c14-404d-a12b-a3540be16a5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:22:59.136665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:22:59.137725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:22:59.138726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:22:59.138726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:22:59.138726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:22:59.138726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:22:59.138726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:22:59.138726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:22:59.138726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:22:59.138726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:22:59.138726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 619/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:22:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:22:59.143716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0673f-c6a2-4ca9-ad38-429855621f21 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:59.252014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0673f-c6a2-4ca9-ad38-429855621f21 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:59.278760 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:59.293665 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c226d-7497-4ddd-a91e-a1ab3d72a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:59.294278 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c226d-7497-4ddd-a91e-a1ab3d72a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:59.294555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c226d-7497-4ddd-a91e-a1ab3d72a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:59.294836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c226d-7497-4ddd-a91e-a1ab3d72a6c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:59.295596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c226d-7497-4ddd-a91e-a1ab3d72a6c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:22:59.295901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c226d-7497-4ddd-a91e-a1ab3d72a6c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:59.297346 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c226d-7497-4ddd-a91e-a1ab3d72a6c9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:59.315076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 599/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:22:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:22:59.316389 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007939e1-7c14-404d-a12b-a3540be16a5a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:22:59.435028 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007939e1-7c14-404d-a12b-a3540be16a5a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:22:59.471043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:22:59.482489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39137db5-95ea-4e8e-bcef-7fbd119224f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:22:59.483207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39137db5-95ea-4e8e-bcef-7fbd119224f9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:22:59.483540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39137db5-95ea-4e8e-bcef-7fbd119224f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:22:59.483876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39137db5-95ea-4e8e-bcef-7fbd119224f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:22:59.484676 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39137db5-95ea-4e8e-bcef-7fbd119224f9 None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=90db0874a2f443768a9d9842beb2523c) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:22:59.485049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39137db5-95ea-4e8e-bcef-7fbd119224f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:22:59.486772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39137db5-95ea-4e8e-bcef-7fbd119224f9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:22:59.493928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 620/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:22:59 2022] GET /identity/v3/role_assignments?user.id=90db0874a2f443768a9d9842beb2523c&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:01.794113 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfa3fc-c2d8-47fd-ad9b-8faa3fe6e27c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:01.794680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfa3fc-c2d8-47fd-ad9b-8faa3fe6e27c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:01.794680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfa3fc-c2d8-47fd-ad9b-8faa3fe6e27c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:01.796059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 600/1220] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:23:01.801681 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682109e-528a-4d09-8d7e-0a8afc411a8e None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:01.802133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682109e-528a-4d09-8d7e-0a8afc411a8e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:01.802462 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682109e-528a-4d09-8d7e-0a8afc411a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:01.822185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6682109e-528a-4d09-8d7e-0a8afc411a8e None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:23:01.823579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6682109e-528a-4d09-8d7e-0a8afc411a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:23:01.898311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 621/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:23:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:23:01.921931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfa3fc-c2d8-47fd-ad9b-8faa3fe6e27c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:02.034594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfa3fc-c2d8-47fd-ad9b-8faa3fe6e27c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:02.071839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dda568-0678-4c05-9f47-cf815629505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:02.072526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dda568-0678-4c05-9f47-cf815629505d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:02.072814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dda568-0678-4c05-9f47-cf815629505d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:02.073131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dda568-0678-4c05-9f47-cf815629505d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:02.084498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dda568-0678-4c05-9f47-cf815629505d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-97dda568-0678-4c05-9f47-cf815629505d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:23:02.089714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:02.096055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:02.097134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 601/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:23:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:02.098015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682109e-528a-4d09-8d7e-0a8afc411a8e None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:02.205024 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682109e-528a-4d09-8d7e-0a8afc411a8e None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:02.233173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:02.247036 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0cace-3e4c-4f43-9bea-3fd619ba2817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:02.247860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0cace-3e4c-4f43-9bea-3fd619ba2817 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:02.248313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0cace-3e4c-4f43-9bea-3fd619ba2817 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:02.248675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0cace-3e4c-4f43-9bea-3fd619ba2817 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:02.249506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0cace-3e4c-4f43-9bea-3fd619ba2817 None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:02.249879 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0cace-3e4c-4f43-9bea-3fd619ba2817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:02.251338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0cace-3e4c-4f43-9bea-3fd619ba2817 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:02.260439 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 622/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:23:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:23:02.266497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dda568-0678-4c05-9f47-cf815629505d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:02.314424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:02.371551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dda568-0678-4c05-9f47-cf815629505d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:02.412040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e4514-84ba-46ef-9c7f-8a6fd6d331f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:02.412805 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e4514-84ba-46ef-9c7f-8a6fd6d331f4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:02.412968 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e4514-84ba-46ef-9c7f-8a6fd6d331f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:02.413237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e4514-84ba-46ef-9c7f-8a6fd6d331f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:02.423242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e4514-84ba-46ef-9c7f-8a6fd6d331f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:02.425217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e4514-84ba-46ef-9c7f-8a6fd6d331f4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-de4e4514-84ba-46ef-9c7f-8a6fd6d331f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:23:02.443520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:02.444712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:23:02.445617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:23:02.445617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:02.445617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:02.445617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 602/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:02.451324 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0cace-3e4c-4f43-9bea-3fd619ba2817 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:02.562402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0cace-3e4c-4f43-9bea-3fd619ba2817 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:02.599774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce9c6a-3a67-41fd-a739-c30df58699be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:02.600378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce9c6a-3a67-41fd-a739-c30df58699be None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:02.600654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce9c6a-3a67-41fd-a739-c30df58699be None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:02.600919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce9c6a-3a67-41fd-a739-c30df58699be None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:02.601557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce9c6a-3a67-41fd-a739-c30df58699be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:02.601854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce9c6a-3a67-41fd-a739-c30df58699be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:02.603238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce9c6a-3a67-41fd-a739-c30df58699be None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:02.621087 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 623/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:02.627002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e4514-84ba-46ef-9c7f-8a6fd6d331f4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:02.733082 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:02.742394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e4514-84ba-46ef-9c7f-8a6fd6d331f4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:02.779928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c63c-8a36-4cd7-813e-9e18a63efb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:02.780593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c63c-8a36-4cd7-813e-9e18a63efb2a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:02.780938 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c63c-8a36-4cd7-813e-9e18a63efb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:02.781175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c63c-8a36-4cd7-813e-9e18a63efb2a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:02.789618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08c63c-8a36-4cd7-813e-9e18a63efb2a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:02.791051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08c63c-8a36-4cd7-813e-9e18a63efb2a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-5e08c63c-8a36-4cd7-813e-9e18a63efb2a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:23:02.802096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:02.803596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:02.804551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:02.804551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:02.804551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:23:02.804551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:23:02.804551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:23:02.804551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:23:02.804551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:23:02.804551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:23:02.804551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 22:23:02.804551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:02.804551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 603/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:02.809205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce9c6a-3a67-41fd-a739-c30df58699be None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:02.857920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:02.924187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce9c6a-3a67-41fd-a739-c30df58699be None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:02.967661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb55b39-61ae-49ff-96cb-0dd72dba79c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:02.968330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb55b39-61ae-49ff-96cb-0dd72dba79c1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:02.968740 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb55b39-61ae-49ff-96cb-0dd72dba79c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:02.969053 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb55b39-61ae-49ff-96cb-0dd72dba79c1 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:02.969871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb55b39-61ae-49ff-96cb-0dd72dba79c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:02.970175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb55b39-61ae-49ff-96cb-0dd72dba79c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:02.971623 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb55b39-61ae-49ff-96cb-0dd72dba79c1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:02.991538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 624/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Aug 7 22:23:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:02.997655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c63c-8a36-4cd7-813e-9e18a63efb2a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:03.105995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c63c-8a36-4cd7-813e-9e18a63efb2a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:03.142483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a754b-c9b8-48a6-bf3f-8cf2f530ae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:03.143319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a754b-c9b8-48a6-bf3f-8cf2f530ae91 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:03.143531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a754b-c9b8-48a6-bf3f-8cf2f530ae91 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:03.143865 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a754b-c9b8-48a6-bf3f-8cf2f530ae91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:03.155420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a754b-c9b8-48a6-bf3f-8cf2f530ae91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:03.157065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a754b-c9b8-48a6-bf3f-8cf2f530ae91 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-261a754b-c9b8-48a6-bf3f-8cf2f530ae91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:23:03.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:03.175653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:23:03.176563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:23:03.176563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:03.176563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:03.176563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 604/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:03.181730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb55b39-61ae-49ff-96cb-0dd72dba79c1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:03.292023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb55b39-61ae-49ff-96cb-0dd72dba79c1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:03.294777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:03.332035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf5c05-cb3f-44b1-9830-a9a0c9f51e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:03.332769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf5c05-cb3f-44b1-9830-a9a0c9f51e1d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:03.333064 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf5c05-cb3f-44b1-9830-a9a0c9f51e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:03.333964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf5c05-cb3f-44b1-9830-a9a0c9f51e1d None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:03.334765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf5c05-cb3f-44b1-9830-a9a0c9f51e1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:03.335110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf5c05-cb3f-44b1-9830-a9a0c9f51e1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:03.336685 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf5c05-cb3f-44b1-9830-a9a0c9f51e1d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:03.348224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 625/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:03.354058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a754b-c9b8-48a6-bf3f-8cf2f530ae91 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:03.363862 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:03.462141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a754b-c9b8-48a6-bf3f-8cf2f530ae91 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:03.498247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb26c85-9829-4a25-991f-785f6f71674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:03.498935 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb26c85-9829-4a25-991f-785f6f71674f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:03.499275 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb26c85-9829-4a25-991f-785f6f71674f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:03.499581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb26c85-9829-4a25-991f-785f6f71674f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:03.506973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb26c85-9829-4a25-991f-785f6f71674f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:03.508834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb26c85-9829-4a25-991f-785f6f71674f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-dfb26c85-9829-4a25-991f-785f6f71674f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:23:03.520987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:03.522037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:03.522932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:23:03.522932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:23:03.522932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:23:03.522932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:23:03.522932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:23:03.522932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:23:03.522932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:23:03.522932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:03.527279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 605/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:23:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:03.528540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf5c05-cb3f-44b1-9830-a9a0c9f51e1d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:03.639189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf5c05-cb3f-44b1-9830-a9a0c9f51e1d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:03.674969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ece8d-72e1-47aa-bce2-d0d86fb48b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:03.675601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ece8d-72e1-47aa-bce2-d0d86fb48b2a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:03.675861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ece8d-72e1-47aa-bce2-d0d86fb48b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:03.676130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ece8d-72e1-47aa-bce2-d0d86fb48b2a None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:03.676803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ece8d-72e1-47aa-bce2-d0d86fb48b2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:03.677140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ece8d-72e1-47aa-bce2-d0d86fb48b2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:03.679280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ece8d-72e1-47aa-bce2-d0d86fb48b2a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:03.691533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 626/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:23:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:03.697620 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb26c85-9829-4a25-991f-785f6f71674f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:03.773053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:03.814671 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb26c85-9829-4a25-991f-785f6f71674f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:03.848830 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227baac-cf32-4671-9de4-7a426a7ecaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:03.850076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227baac-cf32-4671-9de4-7a426a7ecaf7 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:03.850350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227baac-cf32-4671-9de4-7a426a7ecaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:03.850617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227baac-cf32-4671-9de4-7a426a7ecaf7 None admin] PATH_INFO: `/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/90db0874a2f443768a9d9842beb2523c/roles/e2ec52fbc4a74d6086f0649d8cb3f51e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:03.866213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227baac-cf32-4671-9de4-7a426a7ecaf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c5638056cea4e5397c6a25d434e5324, user_id=90db0874a2f443768a9d9842beb2523c, role_id=e2ec52fbc4a74d6086f0649d8cb3f51e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:03.867698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227baac-cf32-4671-9de4-7a426a7ecaf7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:03.880545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 606/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:23:03 2022] PUT /identity/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/90db0874a2f443768a9d9842beb2523c/roles/e2ec52fbc4a74d6086f0649d8cb3f51e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:23:06.099766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7ebaf-e7b2-4a7b-a5ea-a51701602489 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:06.100336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7ebaf-e7b2-4a7b-a5ea-a51701602489 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:06.100336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7ebaf-e7b2-4a7b-a5ea-a51701602489 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:06.102056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 627/1233] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:23:06.107748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d2408-b83f-485b-8eee-b45b3d8a8224 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:06.108226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d2408-b83f-485b-8eee-b45b3d8a8224 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:06.108327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d2408-b83f-485b-8eee-b45b3d8a8224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:06.125584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-359d2408-b83f-485b-8eee-b45b3d8a8224 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:23:06.126767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-359d2408-b83f-485b-8eee-b45b3d8a8224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:23:06.192901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 607/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:23:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:23:06.216085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7ebaf-e7b2-4a7b-a5ea-a51701602489 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:06.242193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:06.329368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7ebaf-e7b2-4a7b-a5ea-a51701602489 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:06.366980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d8267-bbeb-44dc-be97-c27108de563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:06.367697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d8267-bbeb-44dc-be97-c27108de563d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:06.368079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d8267-bbeb-44dc-be97-c27108de563d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:06.368413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d8267-bbeb-44dc-be97-c27108de563d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:06.379746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d8267-bbeb-44dc-be97-c27108de563d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-cc3d8267-bbeb-44dc-be97-c27108de563d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:23:06.385603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:06.386629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:06.387974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 628/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 22:23:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:06.393629 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d2408-b83f-485b-8eee-b45b3d8a8224 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:06.445135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:06.506817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d2408-b83f-485b-8eee-b45b3d8a8224 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:06.544804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce0139-2ed0-4afc-8f38-f97f115ce56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:06.545430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce0139-2ed0-4afc-8f38-f97f115ce56e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:06.545686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce0139-2ed0-4afc-8f38-f97f115ce56e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:06.546028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce0139-2ed0-4afc-8f38-f97f115ce56e None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:06.546694 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce0139-2ed0-4afc-8f38-f97f115ce56e None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:06.547052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce0139-2ed0-4afc-8f38-f97f115ce56e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:06.548765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce0139-2ed0-4afc-8f38-f97f115ce56e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:06.557856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 608/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 22:23:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:23:06.563985 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d8267-bbeb-44dc-be97-c27108de563d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:06.668299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:06.685148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d8267-bbeb-44dc-be97-c27108de563d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:06.723717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfe2bd-7201-4c55-b06b-e07ea9d34e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:06.724457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfe2bd-7201-4c55-b06b-e07ea9d34e87 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:06.724783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfe2bd-7201-4c55-b06b-e07ea9d34e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:06.725085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfe2bd-7201-4c55-b06b-e07ea9d34e87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:06.736576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfe2bd-7201-4c55-b06b-e07ea9d34e87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:06.738157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfe2bd-7201-4c55-b06b-e07ea9d34e87 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a2bfe2bd-7201-4c55-b06b-e07ea9d34e87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:23:06.756614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:06.762980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:23:06.764239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:23:06.764239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:06.764239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:06.764239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 629/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:06.764522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce0139-2ed0-4afc-8f38-f97f115ce56e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:06.874310 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce0139-2ed0-4afc-8f38-f97f115ce56e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:06.886388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:06.920693 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d558c-cab0-4050-b542-2f6fa967efa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:06.921420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d558c-cab0-4050-b542-2f6fa967efa4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:06.921702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d558c-cab0-4050-b542-2f6fa967efa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:06.921983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d558c-cab0-4050-b542-2f6fa967efa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:06.922668 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d558c-cab0-4050-b542-2f6fa967efa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:06.922998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d558c-cab0-4050-b542-2f6fa967efa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:06.924522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d558c-cab0-4050-b542-2f6fa967efa4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:06.938692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 609/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:06.944603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfe2bd-7201-4c55-b06b-e07ea9d34e87 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:07.057721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfe2bd-7201-4c55-b06b-e07ea9d34e87 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:07.097645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfd486-2f77-48d9-900c-e4de6bef16d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:07.098282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd486-2f77-48d9-900c-e4de6bef16d2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:07.098660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd486-2f77-48d9-900c-e4de6bef16d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:07.099013 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd486-2f77-48d9-900c-e4de6bef16d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:07.102732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:07.108761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfd486-2f77-48d9-900c-e4de6bef16d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:07.110362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfd486-2f77-48d9-900c-e4de6bef16d2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-eedfd486-2f77-48d9-900c-e4de6bef16d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:23:07.123292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:07.125213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:07.126357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:07.126357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:07.126357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:23:07.126357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:23:07.126357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:23:07.126357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:23:07.126357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:23:07.126357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:23:07.126357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 22:23:07.126357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:07.126357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 630/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:07.130662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d558c-cab0-4050-b542-2f6fa967efa4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:07.249543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d558c-cab0-4050-b542-2f6fa967efa4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:07.286245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56268f2-3bcd-4ffb-9e51-252552bf2006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:07.287019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56268f2-3bcd-4ffb-9e51-252552bf2006 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:07.287318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56268f2-3bcd-4ffb-9e51-252552bf2006 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:07.287587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56268f2-3bcd-4ffb-9e51-252552bf2006 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:07.288309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56268f2-3bcd-4ffb-9e51-252552bf2006 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:07.288611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56268f2-3bcd-4ffb-9e51-252552bf2006 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:07.290012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56268f2-3bcd-4ffb-9e51-252552bf2006 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:07.307526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 610/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Aug 7 22:23:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:07.313399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfd486-2f77-48d9-900c-e4de6bef16d2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:07.424180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfd486-2f77-48d9-900c-e4de6bef16d2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:07.463197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb21e8-223f-4e8b-b26b-a17d4ff93333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:07.464010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb21e8-223f-4e8b-b26b-a17d4ff93333 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:07.464320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb21e8-223f-4e8b-b26b-a17d4ff93333 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:07.464556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb21e8-223f-4e8b-b26b-a17d4ff93333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:07.533565 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:07.542070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb21e8-223f-4e8b-b26b-a17d4ff93333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:07.543647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb21e8-223f-4e8b-b26b-a17d4ff93333 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:07.651061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 631/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:23:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 22:23:07.656756 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56268f2-3bcd-4ffb-9e51-252552bf2006 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:07.684490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:07.766202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56268f2-3bcd-4ffb-9e51-252552bf2006 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:07.804208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ca2ed-5b39-4f74-aeed-5e5b8e429d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:07.804816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ca2ed-5b39-4f74-aeed-5e5b8e429d9f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:07.805087 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ca2ed-5b39-4f74-aeed-5e5b8e429d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:07.805352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ca2ed-5b39-4f74-aeed-5e5b8e429d9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:07.817714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ca2ed-5b39-4f74-aeed-5e5b8e429d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:07.819893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ca2ed-5b39-4f74-aeed-5e5b8e429d9f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-858ca2ed-5b39-4f74-aeed-5e5b8e429d9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:23:07.835658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:07.837111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:23:07.838373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:23:07.838373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:07.838373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:07.838373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 611/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:07.842529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb21e8-223f-4e8b-b26b-a17d4ff93333 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:07.946295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:07.952495 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb21e8-223f-4e8b-b26b-a17d4ff93333 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:07.988707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a94ad-2157-4daf-9ca8-3b21d1118214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:07.989585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a94ad-2157-4daf-9ca8-3b21d1118214 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:07.990550 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a94ad-2157-4daf-9ca8-3b21d1118214 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:07.991629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a94ad-2157-4daf-9ca8-3b21d1118214 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:07.992376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a94ad-2157-4daf-9ca8-3b21d1118214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:07.992680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a94ad-2157-4daf-9ca8-3b21d1118214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:07.994134 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a94ad-2157-4daf-9ca8-3b21d1118214 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:08.010991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 632/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:08.011989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ca2ed-5b39-4f74-aeed-5e5b8e429d9f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:08.100877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:08.127466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ca2ed-5b39-4f74-aeed-5e5b8e429d9f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:08.169944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e87515-8769-44ea-b144-1b42c8523690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:08.170641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e87515-8769-44ea-b144-1b42c8523690 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:08.170903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e87515-8769-44ea-b144-1b42c8523690 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:08.171272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e87515-8769-44ea-b144-1b42c8523690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:08.179466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e87515-8769-44ea-b144-1b42c8523690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:08.181411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e87515-8769-44ea-b144-1b42c8523690 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-c8e87515-8769-44ea-b144-1b42c8523690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:23:08.195299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:08.196444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:08.202267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:23:08.202267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:23:08.202267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:23:08.202267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:23:08.202267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:23:08.202267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:23:08.202267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:23:08.202267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:08.202267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 612/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:23:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:23:08.203963 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a94ad-2157-4daf-9ca8-3b21d1118214 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:08.310968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a94ad-2157-4daf-9ca8-3b21d1118214 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:08.350208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da266e-6c60-47d9-87e9-c9a4c899922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:08.350878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da266e-6c60-47d9-87e9-c9a4c899922d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:08.351208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da266e-6c60-47d9-87e9-c9a4c899922d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:08.351510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da266e-6c60-47d9-87e9-c9a4c899922d None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:08.352218 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da266e-6c60-47d9-87e9-c9a4c899922d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:08.352524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da266e-6c60-47d9-87e9-c9a4c899922d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:08.354027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da266e-6c60-47d9-87e9-c9a4c899922d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:08.366728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 633/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:23:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:08.373184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e87515-8769-44ea-b144-1b42c8523690 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:08.477895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e87515-8769-44ea-b144-1b42c8523690 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:08.514315 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ff3ec-2438-4aa6-ab18-30ef4b7f38c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:08.515008 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ff3ec-2438-4aa6-ab18-30ef4b7f38c5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:08.515308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ff3ec-2438-4aa6-ab18-30ef4b7f38c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:08.515577 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ff3ec-2438-4aa6-ab18-30ef4b7f38c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:08.516304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ff3ec-2438-4aa6-ab18-30ef4b7f38c5 None admin] RBAC: Adding query filter params (role.id=e2ec52fbc4a74d6086f0649d8cb3f51e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=90db0874a2f443768a9d9842beb2523c) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:08.516604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ff3ec-2438-4aa6-ab18-30ef4b7f38c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:08.518011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ff3ec-2438-4aa6-ab18-30ef4b7f38c5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:08.527910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 613/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:23:08 2022] GET /identity/v3/role_assignments?user.id=90db0874a2f443768a9d9842beb2523c&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=e2ec52fbc4a74d6086f0649d8cb3f51e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:23:10.699988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dea0e5-e704-4dc1-8132-b4fbb5cb8852 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:10.700585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dea0e5-e704-4dc1-8132-b4fbb5cb8852 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:10.700585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dea0e5-e704-4dc1-8132-b4fbb5cb8852 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:10.702702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 634/1247] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:23:10.708145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813594b-4a54-4732-99ff-70eff1ad2a81 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:10.709213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813594b-4a54-4732-99ff-70eff1ad2a81 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:10.709213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813594b-4a54-4732-99ff-70eff1ad2a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:10.715715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:10.729274 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4813594b-4a54-4732-99ff-70eff1ad2a81 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:23:10.730416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4813594b-4a54-4732-99ff-70eff1ad2a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:23:10.805834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 614/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:23:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:23:10.830730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dea0e5-e704-4dc1-8132-b4fbb5cb8852 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:10.850982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:10.947637 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dea0e5-e704-4dc1-8132-b4fbb5cb8852 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:10.988823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedb3b8-41f6-4830-b3e0-c5b79465b258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:10.989410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedb3b8-41f6-4830-b3e0-c5b79465b258 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:10.989685 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedb3b8-41f6-4830-b3e0-c5b79465b258 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:10.989953 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedb3b8-41f6-4830-b3e0-c5b79465b258 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:11.002217 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedb3b8-41f6-4830-b3e0-c5b79465b258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-9eedb3b8-41f6-4830-b3e0-c5b79465b258 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:23:11.008422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:11.009815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:11.010726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 635/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:23:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:23:11.019140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813594b-4a54-4732-99ff-70eff1ad2a81 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:11.130890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813594b-4a54-4732-99ff-70eff1ad2a81 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:11.166128 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:11.171658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467eb2d-75cd-4ef5-893d-e5394fab5569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:11.172330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467eb2d-75cd-4ef5-893d-e5394fab5569 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:11.172656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467eb2d-75cd-4ef5-893d-e5394fab5569 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:11.172965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467eb2d-75cd-4ef5-893d-e5394fab5569 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:11.173718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467eb2d-75cd-4ef5-893d-e5394fab5569 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:11.174054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467eb2d-75cd-4ef5-893d-e5394fab5569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:11.175637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467eb2d-75cd-4ef5-893d-e5394fab5569 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:11.184625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 615/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:23:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:11.190557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedb3b8-41f6-4830-b3e0-c5b79465b258 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:11.284405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:11.313546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedb3b8-41f6-4830-b3e0-c5b79465b258 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:11.353960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02bd73-557f-408f-a4d8-3e3faf13bfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:11.354584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02bd73-557f-408f-a4d8-3e3faf13bfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:11.354856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02bd73-557f-408f-a4d8-3e3faf13bfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:11.355143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02bd73-557f-408f-a4d8-3e3faf13bfa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:11.367212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02bd73-557f-408f-a4d8-3e3faf13bfa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:11.369505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02bd73-557f-408f-a4d8-3e3faf13bfa3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-7b02bd73-557f-408f-a4d8-3e3faf13bfa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:23:11.386124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:11.387371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:23:11.388517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:23:11.388517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:11.388517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:11.388517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 636/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:11.393329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467eb2d-75cd-4ef5-893d-e5394fab5569 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:11.511315 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467eb2d-75cd-4ef5-893d-e5394fab5569 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:11.549875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665defa-9833-4e1f-b499-8fc418ce1614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:11.550403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665defa-9833-4e1f-b499-8fc418ce1614 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:11.550675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665defa-9833-4e1f-b499-8fc418ce1614 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:11.550947 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665defa-9833-4e1f-b499-8fc418ce1614 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:11.551601 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665defa-9833-4e1f-b499-8fc418ce1614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:11.551901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665defa-9833-4e1f-b499-8fc418ce1614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:11.553894 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665defa-9833-4e1f-b499-8fc418ce1614 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:11.567075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 616/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:11.573751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02bd73-557f-408f-a4d8-3e3faf13bfa3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:11.686891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02bd73-557f-408f-a4d8-3e3faf13bfa3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:11.718715 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:11.728698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f580e5-24bb-4a51-a548-0eef550157a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:11.729436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f580e5-24bb-4a51-a548-0eef550157a8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:11.729884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f580e5-24bb-4a51-a548-0eef550157a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:11.730201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f580e5-24bb-4a51-a548-0eef550157a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:11.739862 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f580e5-24bb-4a51-a548-0eef550157a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:11.741554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f580e5-24bb-4a51-a548-0eef550157a8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-75f580e5-24bb-4a51-a548-0eef550157a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:23:11.753097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:11.754172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:11.756205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:11.756205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:11.756205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:23:11.756205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:23:11.756205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:23:11.756205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:23:11.756205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:23:11.756205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:23:11.756205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 22:23:11.756205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:11.756205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 637/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:11.761463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665defa-9833-4e1f-b499-8fc418ce1614 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:11.821413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:11.867991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665defa-9833-4e1f-b499-8fc418ce1614 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:11.905745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd4272-e13b-4677-89a8-cebca92562e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:11.906431 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd4272-e13b-4677-89a8-cebca92562e2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:11.906703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd4272-e13b-4677-89a8-cebca92562e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:11.906973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd4272-e13b-4677-89a8-cebca92562e2 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:11.907813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd4272-e13b-4677-89a8-cebca92562e2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:11.908113 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd4272-e13b-4677-89a8-cebca92562e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:11.909620 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd4272-e13b-4677-89a8-cebca92562e2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:11.929097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 617/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Aug 7 22:23:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:11.934812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f580e5-24bb-4a51-a548-0eef550157a8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:12.052015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f580e5-24bb-4a51-a548-0eef550157a8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:12.094935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc40cfe-5904-42ae-8e7c-9b3606e03bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:12.095503 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc40cfe-5904-42ae-8e7c-9b3606e03bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:12.095825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc40cfe-5904-42ae-8e7c-9b3606e03bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:12.096092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc40cfe-5904-42ae-8e7c-9b3606e03bf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:12.161544 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:12.174533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc40cfe-5904-42ae-8e7c-9b3606e03bf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:12.175996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc40cfe-5904-42ae-8e7c-9b3606e03bf3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:12.280876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 638/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:23:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:23:12.287509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd4272-e13b-4677-89a8-cebca92562e2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:12.402534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd4272-e13b-4677-89a8-cebca92562e2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:12.418630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:12.442086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399004f3-f5ec-4f98-988b-75a5339191a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:12.442778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399004f3-f5ec-4f98-988b-75a5339191a5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:12.443675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399004f3-f5ec-4f98-988b-75a5339191a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:12.444045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399004f3-f5ec-4f98-988b-75a5339191a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:12.455881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399004f3-f5ec-4f98-988b-75a5339191a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:12.457658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399004f3-f5ec-4f98-988b-75a5339191a5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-399004f3-f5ec-4f98-988b-75a5339191a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:23:12.473540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:12.474901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:23:12.476105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:23:12.476105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:12.476105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:12.476105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 618/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:12.482951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc40cfe-5904-42ae-8e7c-9b3606e03bf3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:12.578384 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:12.593251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc40cfe-5904-42ae-8e7c-9b3606e03bf3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:12.632589 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f997-6946-45cd-a2c3-decff976f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:12.633184 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f997-6946-45cd-a2c3-decff976f10a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:12.633454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f997-6946-45cd-a2c3-decff976f10a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:12.633983 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f997-6946-45cd-a2c3-decff976f10a None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:12.634611 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393f997-6946-45cd-a2c3-decff976f10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:12.634906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393f997-6946-45cd-a2c3-decff976f10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:12.636290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393f997-6946-45cd-a2c3-decff976f10a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:12.649859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 639/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:23:12.656054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399004f3-f5ec-4f98-988b-75a5339191a5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:12.764069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399004f3-f5ec-4f98-988b-75a5339191a5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:12.803526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfb3c9-0a4f-4789-8261-24411addea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:12.804199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfb3c9-0a4f-4789-8261-24411addea06 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:12.804462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfb3c9-0a4f-4789-8261-24411addea06 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:12.804726 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfb3c9-0a4f-4789-8261-24411addea06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:12.811993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfb3c9-0a4f-4789-8261-24411addea06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:12.813467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfb3c9-0a4f-4789-8261-24411addea06 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2acfb3c9-0a4f-4789-8261-24411addea06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:23:12.825162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:12.826262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:12.827354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:23:12.827354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:23:12.827354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:23:12.827354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:23:12.827354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:23:12.827354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:23:12.827354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:23:12.827354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:12.827354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 619/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:23:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:12.832320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f997-6946-45cd-a2c3-decff976f10a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:12.935899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f997-6946-45cd-a2c3-decff976f10a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:12.969641 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b5c20-1651-4ab8-b814-b4e56a080638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:12.970244 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b5c20-1651-4ab8-b814-b4e56a080638 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:12.970520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b5c20-1651-4ab8-b814-b4e56a080638 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:12.970788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b5c20-1651-4ab8-b814-b4e56a080638 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:12.971512 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b5c20-1651-4ab8-b814-b4e56a080638 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:12.971816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b5c20-1651-4ab8-b814-b4e56a080638 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:12.973219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b5c20-1651-4ab8-b814-b4e56a080638 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:12.986298 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 640/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:23:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:12.992960 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfb3c9-0a4f-4789-8261-24411addea06 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:13.023354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:13.110705 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfb3c9-0a4f-4789-8261-24411addea06 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:13.147930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b9318-751c-4b4b-985e-2f7cc7d485b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:13.148521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9318-751c-4b4b-985e-2f7cc7d485b4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:13.148791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9318-751c-4b4b-985e-2f7cc7d485b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:13.149049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9318-751c-4b4b-985e-2f7cc7d485b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:13.149776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b9318-751c-4b4b-985e-2f7cc7d485b4 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=90db0874a2f443768a9d9842beb2523c) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:13.150047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b9318-751c-4b4b-985e-2f7cc7d485b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:13.151486 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b9318-751c-4b4b-985e-2f7cc7d485b4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:13.156901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 620/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:23:12 2022] GET /identity/v3/role_assignments?user.id=90db0874a2f443768a9d9842beb2523c&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:15.169118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5fa0e-80dd-4413-9706-79eeb8bba2dc None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:15.169632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5fa0e-80dd-4413-9706-79eeb8bba2dc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:15.169632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5fa0e-80dd-4413-9706-79eeb8bba2dc None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:15.170961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 641/1261] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:23:15.176107 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c84d5b-b30c-4b28-a401-215aa7a2c500 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:15.176472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c84d5b-b30c-4b28-a401-215aa7a2c500 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:15.176655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c84d5b-b30c-4b28-a401-215aa7a2c500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:15.194219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-89c84d5b-b30c-4b28-a401-215aa7a2c500 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:23:15.195449 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-89c84d5b-b30c-4b28-a401-215aa7a2c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:23:15.260273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 621/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:23:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:23:15.282315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5fa0e-80dd-4413-9706-79eeb8bba2dc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:15.293691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:15.381334 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5fa0e-80dd-4413-9706-79eeb8bba2dc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:15.414657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6070f4-395a-42ad-96fa-8e3121223ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:15.415290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6070f4-395a-42ad-96fa-8e3121223ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:15.415571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6070f4-395a-42ad-96fa-8e3121223ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:15.415843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6070f4-395a-42ad-96fa-8e3121223ec0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:15.425510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6070f4-395a-42ad-96fa-8e3121223ec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-7a6070f4-395a-42ad-96fa-8e3121223ec0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:23:15.430212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:15.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:15.432272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 642/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:23:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:15.437124 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c84d5b-b30c-4b28-a401-215aa7a2c500 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:15.455230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:15.532702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c84d5b-b30c-4b28-a401-215aa7a2c500 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:15.564667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345715ba-fdd9-456f-97be-5157a5188f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:15.565256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345715ba-fdd9-456f-97be-5157a5188f67 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:15.565530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345715ba-fdd9-456f-97be-5157a5188f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:15.565799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345715ba-fdd9-456f-97be-5157a5188f67 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:15.566452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345715ba-fdd9-456f-97be-5157a5188f67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:15.566751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345715ba-fdd9-456f-97be-5157a5188f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:15.568630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345715ba-fdd9-456f-97be-5157a5188f67 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:15.576351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 622/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:23:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:15.582102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6070f4-395a-42ad-96fa-8e3121223ec0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:15.648416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:15.680861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6070f4-395a-42ad-96fa-8e3121223ec0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:15.715984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d24a2e-b272-448f-b0f8-8f5f4ae192d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:15.716714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d24a2e-b272-448f-b0f8-8f5f4ae192d2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:15.717093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d24a2e-b272-448f-b0f8-8f5f4ae192d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:15.717406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d24a2e-b272-448f-b0f8-8f5f4ae192d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:15.728541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d24a2e-b272-448f-b0f8-8f5f4ae192d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:15.729973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d24a2e-b272-448f-b0f8-8f5f4ae192d2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-17d24a2e-b272-448f-b0f8-8f5f4ae192d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:23:15.746079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:15.747195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:23:15.748258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:23:15.748258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:15.748258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:15.748258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 643/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:15.753715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345715ba-fdd9-456f-97be-5157a5188f67 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:15.842443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:15.860919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345715ba-fdd9-456f-97be-5157a5188f67 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:15.893881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f592b8-5108-4605-b8dc-e12f5c5eee72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:15.894473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f592b8-5108-4605-b8dc-e12f5c5eee72 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:15.894749 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f592b8-5108-4605-b8dc-e12f5c5eee72 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:15.895020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f592b8-5108-4605-b8dc-e12f5c5eee72 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:15.895690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f592b8-5108-4605-b8dc-e12f5c5eee72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:15.895989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f592b8-5108-4605-b8dc-e12f5c5eee72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:15.897373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f592b8-5108-4605-b8dc-e12f5c5eee72 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:15.908640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 623/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:15.914291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d24a2e-b272-448f-b0f8-8f5f4ae192d2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:16.023943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d24a2e-b272-448f-b0f8-8f5f4ae192d2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:16.048857 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:16.063639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d494e0e-92c4-4cad-bcbb-ce62fd4072d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:16.064274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d494e0e-92c4-4cad-bcbb-ce62fd4072d7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:16.064536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d494e0e-92c4-4cad-bcbb-ce62fd4072d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:16.064805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d494e0e-92c4-4cad-bcbb-ce62fd4072d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:16.073558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d494e0e-92c4-4cad-bcbb-ce62fd4072d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:16.074986 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d494e0e-92c4-4cad-bcbb-ce62fd4072d7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-1d494e0e-92c4-4cad-bcbb-ce62fd4072d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:23:16.085703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:16.086777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:16.087799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:16.087799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:16.087799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:23:16.087799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:23:16.087799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:23:16.087799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:23:16.087799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:23:16.087799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:23:16.087799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 22:23:16.087799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:16.087799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 644/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:16.092687 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f592b8-5108-4605-b8dc-e12f5c5eee72 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:16.187660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f592b8-5108-4605-b8dc-e12f5c5eee72 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:16.219351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf741-e964-4e76-8aaf-e80c64bed6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:16.219930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf741-e964-4e76-8aaf-e80c64bed6fa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:16.220200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf741-e964-4e76-8aaf-e80c64bed6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:16.220462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf741-e964-4e76-8aaf-e80c64bed6fa None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:16.221164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bf741-e964-4e76-8aaf-e80c64bed6fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:16.221457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bf741-e964-4e76-8aaf-e80c64bed6fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:16.222842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bf741-e964-4e76-8aaf-e80c64bed6fa None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:16.231585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:16.239724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 624/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Aug 7 22:23:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:16.245903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d494e0e-92c4-4cad-bcbb-ce62fd4072d7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:16.346942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d494e0e-92c4-4cad-bcbb-ce62fd4072d7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:16.379608 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cebf14-2c52-4ed8-bfe7-7a4dd00e5cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:16.380218 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cebf14-2c52-4ed8-bfe7-7a4dd00e5cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:16.380518 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cebf14-2c52-4ed8-bfe7-7a4dd00e5cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:16.380786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cebf14-2c52-4ed8-bfe7-7a4dd00e5cb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:16.390975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cebf14-2c52-4ed8-bfe7-7a4dd00e5cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:16.392432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cebf14-2c52-4ed8-bfe7-7a4dd00e5cb8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-24cebf14-2c52-4ed8-bfe7-7a4dd00e5cb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:23:16.405821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:16.406886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:23:16.407923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:23:16.407923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:16.407923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:16.407923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 645/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:16.413174 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf741-e964-4e76-8aaf-e80c64bed6fa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:16.508549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf741-e964-4e76-8aaf-e80c64bed6fa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:16.542462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf41af-d519-4b04-bf3d-f24efd450a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:16.543046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf41af-d519-4b04-bf3d-f24efd450a1d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:16.543348 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf41af-d519-4b04-bf3d-f24efd450a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:16.543616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf41af-d519-4b04-bf3d-f24efd450a1d None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:16.544245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf41af-d519-4b04-bf3d-f24efd450a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:16.544542 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf41af-d519-4b04-bf3d-f24efd450a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:16.545897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf41af-d519-4b04-bf3d-f24efd450a1d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:16.556624 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 625/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:23:16.562103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cebf14-2c52-4ed8-bfe7-7a4dd00e5cb8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:16.592786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:16.659795 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cebf14-2c52-4ed8-bfe7-7a4dd00e5cb8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:16.691701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e949175-b004-4916-ab8f-49c6ad1795f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:16.692312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e949175-b004-4916-ab8f-49c6ad1795f0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:16.692584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e949175-b004-4916-ab8f-49c6ad1795f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:16.692848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e949175-b004-4916-ab8f-49c6ad1795f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:16.699156 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e949175-b004-4916-ab8f-49c6ad1795f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:16.700573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e949175-b004-4916-ab8f-49c6ad1795f0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-2e949175-b004-4916-ab8f-49c6ad1795f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:23:16.711711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:16.712935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:16.713836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:23:16.713836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:23:16.713836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:23:16.713836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:23:16.713836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:23:16.713836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:23:16.713836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:23:16.713836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:16.713836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 646/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:23:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:16.718660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf41af-d519-4b04-bf3d-f24efd450a1d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:16.778685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:16.818348 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf41af-d519-4b04-bf3d-f24efd450a1d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:16.850881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9b8a5-977f-4e5b-80fb-5165ae3b37b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:16.851488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9b8a5-977f-4e5b-80fb-5165ae3b37b8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:16.851762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9b8a5-977f-4e5b-80fb-5165ae3b37b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:16.852029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9b8a5-977f-4e5b-80fb-5165ae3b37b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:16.852713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9b8a5-977f-4e5b-80fb-5165ae3b37b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:16.853013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9b8a5-977f-4e5b-80fb-5165ae3b37b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:16.854420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9b8a5-977f-4e5b-80fb-5165ae3b37b8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:16.865814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 626/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:23:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:16.871820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e949175-b004-4916-ab8f-49c6ad1795f0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:16.962579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:16.971342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e949175-b004-4916-ab8f-49c6ad1795f0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:17.004003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ec4f5-ac4b-47ec-8db2-a137f49099be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:17.004653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ec4f5-ac4b-47ec-8db2-a137f49099be None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:17.004929 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ec4f5-ac4b-47ec-8db2-a137f49099be None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:17.005198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ec4f5-ac4b-47ec-8db2-a137f49099be None admin] PATH_INFO: `/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/90db0874a2f443768a9d9842beb2523c/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:17.007592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ec4f5-ac4b-47ec-8db2-a137f49099be None admin] RBAC: Authorizing `identity:create_grant(project_id=6c5638056cea4e5397c6a25d434e5324, user_id=90db0874a2f443768a9d9842beb2523c, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:17.009271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ec4f5-ac4b-47ec-8db2-a137f49099be None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:17.022057 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 647/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 22:23:16 2022] PUT /identity/v3/projects/6c5638056cea4e5397c6a25d434e5324/users/90db0874a2f443768a9d9842beb2523c/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:23:18.966458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62572f01-1228-4911-bf57-fd034ad2ba64 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:18.966985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62572f01-1228-4911-bf57-fd034ad2ba64 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:18.966985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62572f01-1228-4911-bf57-fd034ad2ba64 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:18.968361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 627/1274] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:23:18.973546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302e072-9fe5-4a20-8d53-0fc4de153009 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:18.973940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302e072-9fe5-4a20-8d53-0fc4de153009 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:18.974079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302e072-9fe5-4a20-8d53-0fc4de153009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:18.992908 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a302e072-9fe5-4a20-8d53-0fc4de153009 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:23:18.994079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a302e072-9fe5-4a20-8d53-0fc4de153009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:23:19.057983 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 648/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:23:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:23:19.081069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62572f01-1228-4911-bf57-fd034ad2ba64 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:19.176954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62572f01-1228-4911-bf57-fd034ad2ba64 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:19.193683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:19.210132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d70ea5-9d5d-4bec-9419-02a060c8e2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:19.210733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d70ea5-9d5d-4bec-9419-02a060c8e2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:19.211003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d70ea5-9d5d-4bec-9419-02a060c8e2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:19.211302 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d70ea5-9d5d-4bec-9419-02a060c8e2e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:19.220915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d70ea5-9d5d-4bec-9419-02a060c8e2e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-59d70ea5-9d5d-4bec-9419-02a060c8e2e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 22:23:19.225967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:19.227061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:19.228144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 628/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 22:23:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:19.234872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302e072-9fe5-4a20-8d53-0fc4de153009 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:19.313197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:19.331659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302e072-9fe5-4a20-8d53-0fc4de153009 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:19.364508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb359da4-9267-4de1-9c84-94f42a1f192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:19.365695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb359da4-9267-4de1-9c84-94f42a1f192a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:19.365966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb359da4-9267-4de1-9c84-94f42a1f192a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:19.366231 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb359da4-9267-4de1-9c84-94f42a1f192a None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:19.366881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb359da4-9267-4de1-9c84-94f42a1f192a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:19.367207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb359da4-9267-4de1-9c84-94f42a1f192a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:19.368547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb359da4-9267-4de1-9c84-94f42a1f192a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:19.376308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 649/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 22:23:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:19.381913 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d70ea5-9d5d-4bec-9419-02a060c8e2e9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:19.477584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d70ea5-9d5d-4bec-9419-02a060c8e2e9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:19.509898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf40077-9336-4e37-bee1-b15bc4afbfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:19.510489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf40077-9336-4e37-bee1-b15bc4afbfdf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:19.510759 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf40077-9336-4e37-bee1-b15bc4afbfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:19.511024 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf40077-9336-4e37-bee1-b15bc4afbfdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:19.520482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf40077-9336-4e37-bee1-b15bc4afbfdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:19.522429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf40077-9336-4e37-bee1-b15bc4afbfdf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-7bf40077-9336-4e37-bee1-b15bc4afbfdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:23:19.536151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:19.537823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:23:19.538962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:23:19.538962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:19.538962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:19.538962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 629/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:19.543351 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb359da4-9267-4de1-9c84-94f42a1f192a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:19.638368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb359da4-9267-4de1-9c84-94f42a1f192a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:19.670667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c8d73-0ae9-4f1c-a1d8-adbb35a0bfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:19.671277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c8d73-0ae9-4f1c-a1d8-adbb35a0bfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:19.671550 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c8d73-0ae9-4f1c-a1d8-adbb35a0bfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:19.671817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c8d73-0ae9-4f1c-a1d8-adbb35a0bfe0 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:19.672443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c8d73-0ae9-4f1c-a1d8-adbb35a0bfe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:19.672739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c8d73-0ae9-4f1c-a1d8-adbb35a0bfe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:19.674069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c8d73-0ae9-4f1c-a1d8-adbb35a0bfe0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:19.685486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 650/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:19.691159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf40077-9336-4e37-bee1-b15bc4afbfdf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:19.723945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:19.795765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf40077-9336-4e37-bee1-b15bc4afbfdf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:19.827332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fc28e-320b-4137-a06d-3321137c308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:19.827944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fc28e-320b-4137-a06d-3321137c308b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:19.828218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fc28e-320b-4137-a06d-3321137c308b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:19.828489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fc28e-320b-4137-a06d-3321137c308b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:19.836818 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fc28e-320b-4137-a06d-3321137c308b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:19.838242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fc28e-320b-4137-a06d-3321137c308b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-402fc28e-320b-4137-a06d-3321137c308b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 22:23:19.848852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:19.850512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:19.851777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:19.851777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:19.851777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 22:23:19.851777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 22:23:19.851777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 22:23:19.851777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 22:23:19.851777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 22:23:19.851777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 22:23:19.851777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 22:23:19.851777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:19.851777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 630/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:19.856230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c8d73-0ae9-4f1c-a1d8-adbb35a0bfe0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:19.859920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:19.952609 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c8d73-0ae9-4f1c-a1d8-adbb35a0bfe0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:19.985043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22161e4e-7e4f-4dab-9201-aea50ba1e2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:19.985610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22161e4e-7e4f-4dab-9201-aea50ba1e2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:19.985885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22161e4e-7e4f-4dab-9201-aea50ba1e2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:19.986150 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22161e4e-7e4f-4dab-9201-aea50ba1e2a0 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:19.986871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22161e4e-7e4f-4dab-9201-aea50ba1e2a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:19.987199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22161e4e-7e4f-4dab-9201-aea50ba1e2a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:19.988598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22161e4e-7e4f-4dab-9201-aea50ba1e2a0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:20.006281 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 651/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Aug 7 22:23:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:20.012154 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fc28e-320b-4137-a06d-3321137c308b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:20.099575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:20.109232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fc28e-320b-4137-a06d-3321137c308b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:20.141727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a14dc-d5e1-4eb0-9faa-423bc34b7c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:20.142315 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a14dc-d5e1-4eb0-9faa-423bc34b7c7b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:20.142592 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a14dc-d5e1-4eb0-9faa-423bc34b7c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:20.142861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a14dc-d5e1-4eb0-9faa-423bc34b7c7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:20.207096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a14dc-d5e1-4eb0-9faa-423bc34b7c7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:20.208528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a14dc-d5e1-4eb0-9faa-423bc34b7c7b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:20.292545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:20.303040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 631/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 22:23:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 22:23:20.308663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22161e4e-7e4f-4dab-9201-aea50ba1e2a0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:20.368304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:20.405696 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22161e4e-7e4f-4dab-9201-aea50ba1e2a0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:20.437992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30581cb5-456c-49e6-bd51-5dcef1a40b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:20.438597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30581cb5-456c-49e6-bd51-5dcef1a40b56 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:20.438872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30581cb5-456c-49e6-bd51-5dcef1a40b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:20.439164 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30581cb5-456c-49e6-bd51-5dcef1a40b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:20.448674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30581cb5-456c-49e6-bd51-5dcef1a40b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:20.450088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30581cb5-456c-49e6-bd51-5dcef1a40b56 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-30581cb5-456c-49e6-bd51-5dcef1a40b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 22:23:20.464380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:20.465475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 22:23:20.466620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 22:23:20.466620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 22:23:20.466620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:20.466620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 652/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:20.471263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a14dc-d5e1-4eb0-9faa-423bc34b7c7b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:20.565951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a14dc-d5e1-4eb0-9faa-423bc34b7c7b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:20.598304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba683820-e4d5-4de8-895e-c2b0b46cee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:20.598884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba683820-e4d5-4de8-895e-c2b0b46cee89 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:20.599185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba683820-e4d5-4de8-895e-c2b0b46cee89 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:20.600034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba683820-e4d5-4de8-895e-c2b0b46cee89 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:20.600663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba683820-e4d5-4de8-895e-c2b0b46cee89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:20.600958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba683820-e4d5-4de8-895e-c2b0b46cee89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:20.602304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba683820-e4d5-4de8-895e-c2b0b46cee89 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:20.612995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 632/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 22:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:20.618460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30581cb5-456c-49e6-bd51-5dcef1a40b56 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:20.719951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30581cb5-456c-49e6-bd51-5dcef1a40b56 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:20.736097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:20.757637 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad94519-d076-4ca0-82c9-27a476fce677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:20.758251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad94519-d076-4ca0-82c9-27a476fce677 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:20.758529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad94519-d076-4ca0-82c9-27a476fce677 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:20.758801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad94519-d076-4ca0-82c9-27a476fce677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:20.765421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad94519-d076-4ca0-82c9-27a476fce677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:20.766850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad94519-d076-4ca0-82c9-27a476fce677 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5ad94519-d076-4ca0-82c9-27a476fce677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 22:23:20.779105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:20.780169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:20.781375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 22:23:20.781375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 22:23:20.781375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 22:23:20.781375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 22:23:20.781375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 22:23:20.781375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 22:23:20.781375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 22:23:20.781375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 07 22:23:20.781375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 653/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 22:23:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 22:23:20.786028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba683820-e4d5-4de8-895e-c2b0b46cee89 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:20.834833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:20.883134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba683820-e4d5-4de8-895e-c2b0b46cee89 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:20.915427 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc85fa9-fe2e-40f1-9cfe-f7698b8135d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:20.916014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc85fa9-fe2e-40f1-9cfe-f7698b8135d4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:20.916292 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc85fa9-fe2e-40f1-9cfe-f7698b8135d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:20.916560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc85fa9-fe2e-40f1-9cfe-f7698b8135d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:20.917243 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc85fa9-fe2e-40f1-9cfe-f7698b8135d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:20.917543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc85fa9-fe2e-40f1-9cfe-f7698b8135d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:20.918948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc85fa9-fe2e-40f1-9cfe-f7698b8135d4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:20.931319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 633/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 22:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:20.937424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad94519-d076-4ca0-82c9-27a476fce677 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:21.036141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad94519-d076-4ca0-82c9-27a476fce677 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:21.067783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab0bc0-fd2e-4189-ad5e-d114905e9492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:21.068959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab0bc0-fd2e-4189-ad5e-d114905e9492 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:21.069224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab0bc0-fd2e-4189-ad5e-d114905e9492 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:21.069483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab0bc0-fd2e-4189-ad5e-d114905e9492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:21.070191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab0bc0-fd2e-4189-ad5e-d114905e9492 None admin] RBAC: Adding query filter params (role.id=04a6c1a4962b47aaa3a6a9602abbe31e, scope.project.id=6c5638056cea4e5397c6a25d434e5324, user.id=90db0874a2f443768a9d9842beb2523c) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:21.070488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab0bc0-fd2e-4189-ad5e-d114905e9492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:21.071916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab0bc0-fd2e-4189-ad5e-d114905e9492 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:21.077512 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 654/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 22:23:20 2022] GET /identity/v3/role_assignments?user.id=90db0874a2f443768a9d9842beb2523c&scope.project.id=6c5638056cea4e5397c6a25d434e5324&role.id=04a6c1a4962b47aaa3a6a9602abbe31e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:23.089903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d929773-8f46-46dc-9fcc-2ab0fb66aacf None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:23.090386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d929773-8f46-46dc-9fcc-2ab0fb66aacf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:23.090494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d929773-8f46-46dc-9fcc-2ab0fb66aacf None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:23.091805 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 634/1288] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:23:23.096735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bebb0-c173-4410-8a71-27d85a23f632 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:23.097179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bebb0-c173-4410-8a71-27d85a23f632 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:23.097275 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bebb0-c173-4410-8a71-27d85a23f632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:23.115741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-122bebb0-c173-4410-8a71-27d85a23f632 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:23:23.116908 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-122bebb0-c173-4410-8a71-27d85a23f632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:23:23.145130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:23.181044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 655/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:23:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:23:23.202280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d929773-8f46-46dc-9fcc-2ab0fb66aacf None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:23.300784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d929773-8f46-46dc-9fcc-2ab0fb66aacf None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:23.311690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:23.335280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a82243-5188-4de3-9abd-22e31a51f588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:23.335886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a82243-5188-4de3-9abd-22e31a51f588 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:23.336185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a82243-5188-4de3-9abd-22e31a51f588 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:23.336452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a82243-5188-4de3-9abd-22e31a51f588 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:23.337024 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a82243-5188-4de3-9abd-22e31a51f588 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:23.338370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a82243-5188-4de3-9abd-22e31a51f588 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e8a82243-5188-4de3-9abd-22e31a51f588 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:23.346663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:23.347874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:23.348724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 635/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 22:23:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:23.354112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bebb0-c173-4410-8a71-27d85a23f632 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:23.448739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bebb0-c173-4410-8a71-27d85a23f632 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:23.481933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56ab07-04e6-4314-8e71-37b48413627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:23.482519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56ab07-04e6-4314-8e71-37b48413627b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:23.482791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56ab07-04e6-4314-8e71-37b48413627b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:23.483056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56ab07-04e6-4314-8e71-37b48413627b None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:23.483699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56ab07-04e6-4314-8e71-37b48413627b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:23.483994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56ab07-04e6-4314-8e71-37b48413627b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:23.485320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56ab07-04e6-4314-8e71-37b48413627b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:23.489903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 656/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Aug 7 22:23:23 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:23.495404 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a82243-5188-4de3-9abd-22e31a51f588 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:23.591921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a82243-5188-4de3-9abd-22e31a51f588 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:23.624189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124e61c-b9ee-43b7-b6bb-6ca53b7ec822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:23.624768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124e61c-b9ee-43b7-b6bb-6ca53b7ec822 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:23.625046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124e61c-b9ee-43b7-b6bb-6ca53b7ec822 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:23.625317 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124e61c-b9ee-43b7-b6bb-6ca53b7ec822 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:23.625933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124e61c-b9ee-43b7-b6bb-6ca53b7ec822 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:23.626232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124e61c-b9ee-43b7-b6bb-6ca53b7ec822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:23.627606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124e61c-b9ee-43b7-b6bb-6ca53b7ec822 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:23.631882 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 636/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Aug 7 22:23:23 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:25.626966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d43af-3eb8-4025-b0eb-605266656aa7 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:25.627537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d43af-3eb8-4025-b0eb-605266656aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:25.627537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d43af-3eb8-4025-b0eb-605266656aa7 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:25.628837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 657/1293] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:23:25.634094 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d903d-8990-4760-b0aa-71056f8deb7a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:25.634768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d903d-8990-4760-b0aa-71056f8deb7a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:25.634900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d903d-8990-4760-b0aa-71056f8deb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:25.652758 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e11d903d-8990-4760-b0aa-71056f8deb7a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:23:25.653926 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e11d903d-8990-4760-b0aa-71056f8deb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:23:25.683215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:25.720702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 637/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:23:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:23:25.746195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d43af-3eb8-4025-b0eb-605266656aa7 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:25.784572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:25.862040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d43af-3eb8-4025-b0eb-605266656aa7 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:25.893882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00ed25-64ff-41d4-8f63-fb56eb06a333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:25.894415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00ed25-64ff-41d4-8f63-fb56eb06a333 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:25.894686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00ed25-64ff-41d4-8f63-fb56eb06a333 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:25.894949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00ed25-64ff-41d4-8f63-fb56eb06a333 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:25.895603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00ed25-64ff-41d4-8f63-fb56eb06a333 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:25.897414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00ed25-64ff-41d4-8f63-fb56eb06a333 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:25.910941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 658/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 22:23:25 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:23:27.870552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5d85-88d6-4532-84ae-2babc65d1d9c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:27.871110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5d85-88d6-4532-84ae-2babc65d1d9c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:27.871110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5d85-88d6-4532-84ae-2babc65d1d9c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:27.872460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 638/1296] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:23:27.877669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5523e-3365-4f79-81d1-7242986f21e8 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:27.878064 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5523e-3365-4f79-81d1-7242986f21e8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:27.878204 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5523e-3365-4f79-81d1-7242986f21e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:27.895843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3dd5523e-3365-4f79-81d1-7242986f21e8 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:23:27.897560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3dd5523e-3365-4f79-81d1-7242986f21e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:23:27.966471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 659/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:23:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:23:27.989236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed5d85-88d6-4532-84ae-2babc65d1d9c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:28.087103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed5d85-88d6-4532-84ae-2babc65d1d9c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:28.121197 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9cdcc-8cb3-48f7-bdd1-12b5ea33531f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:28.121755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9cdcc-8cb3-48f7-bdd1-12b5ea33531f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:28.122032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9cdcc-8cb3-48f7-bdd1-12b5ea33531f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:28.122302 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9cdcc-8cb3-48f7-bdd1-12b5ea33531f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:28.122880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9cdcc-8cb3-48f7-bdd1-12b5ea33531f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:28.124279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9cdcc-8cb3-48f7-bdd1-12b5ea33531f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-26a9cdcc-8cb3-48f7-bdd1-12b5ea33531f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:28.132813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:28.134037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:28.135397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 639/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 22:23:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:28.140125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5523e-3365-4f79-81d1-7242986f21e8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:28.158311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:28.236479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5523e-3365-4f79-81d1-7242986f21e8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:28.270139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771b454-1c9a-4e99-83ea-47eaaf98a49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:28.270732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b454-1c9a-4e99-83ea-47eaaf98a49d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:28.271004 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b454-1c9a-4e99-83ea-47eaaf98a49d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:28.271896 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b454-1c9a-4e99-83ea-47eaaf98a49d None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:28.272493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771b454-1c9a-4e99-83ea-47eaaf98a49d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:28.272791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771b454-1c9a-4e99-83ea-47eaaf98a49d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:28.274129 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771b454-1c9a-4e99-83ea-47eaaf98a49d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:28.279008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 660/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Aug 7 22:23:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:23:28.284864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9cdcc-8cb3-48f7-bdd1-12b5ea33531f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:28.315163 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:28.382356 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9cdcc-8cb3-48f7-bdd1-12b5ea33531f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:28.414824 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdf87f-4aad-4a50-88e5-f485a310a94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:28.415433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdf87f-4aad-4a50-88e5-f485a310a94f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:28.415710 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdf87f-4aad-4a50-88e5-f485a310a94f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:28.415977 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdf87f-4aad-4a50-88e5-f485a310a94f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:28.416661 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdf87f-4aad-4a50-88e5-f485a310a94f None admin] RBAC: Adding query filter params (interface=public, service_id=31b7a5437c0d465696ab4fe9c82dcc97, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:28.416967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdf87f-4aad-4a50-88e5-f485a310a94f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:28.418301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdf87f-4aad-4a50-88e5-f485a310a94f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:28.423151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 640/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 22:23:28 2022] GET /identity/v3/endpoints?service_id=31b7a5437c0d465696ab4fe9c82dcc97&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:28.428730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771b454-1c9a-4e99-83ea-47eaaf98a49d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:28.506684 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:28.525713 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771b454-1c9a-4e99-83ea-47eaaf98a49d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:28.558187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c52cc0-1f90-41cd-8bab-5427b0469c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:28.558772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c52cc0-1f90-41cd-8bab-5427b0469c6b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:28.559046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c52cc0-1f90-41cd-8bab-5427b0469c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:28.559345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c52cc0-1f90-41cd-8bab-5427b0469c6b None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:28.559937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c52cc0-1f90-41cd-8bab-5427b0469c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:28.561265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c52cc0-1f90-41cd-8bab-5427b0469c6b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:28.567731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 661/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 22:23:28 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:23:30.549435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370e34a-9677-4d9a-99bf-75adb6eea70a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:30.550020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370e34a-9677-4d9a-99bf-75adb6eea70a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:30.550020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370e34a-9677-4d9a-99bf-75adb6eea70a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:30.551368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 641/1302] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:23:30.557037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbb676-6063-4950-87e0-c5521d38379d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:30.557461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbb676-6063-4950-87e0-c5521d38379d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:30.557567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbb676-6063-4950-87e0-c5521d38379d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:30.574963 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-36dbb676-6063-4950-87e0-c5521d38379d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:23:30.576158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-36dbb676-6063-4950-87e0-c5521d38379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:23:30.639929 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 662/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:23:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 22:23:30.662701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370e34a-9677-4d9a-99bf-75adb6eea70a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:30.760263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:30.767947 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370e34a-9677-4d9a-99bf-75adb6eea70a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:30.802837 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef55934-f675-47ee-8a8a-76dab16e5be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:30.803418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef55934-f675-47ee-8a8a-76dab16e5be0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:30.803688 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef55934-f675-47ee-8a8a-76dab16e5be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:30.803949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef55934-f675-47ee-8a8a-76dab16e5be0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:30.804518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef55934-f675-47ee-8a8a-76dab16e5be0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:30.805855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef55934-f675-47ee-8a8a-76dab16e5be0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4ef55934-f675-47ee-8a8a-76dab16e5be0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 22:23:30.814116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 22:23:30.815358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 07 22:23:30.816267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 642/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 22:23:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 22:23:30.821376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbb676-6063-4950-87e0-c5521d38379d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:30.895725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:30.918880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbb676-6063-4950-87e0-c5521d38379d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:30.950241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b345cc-0e58-4914-b339-6638f93ab931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:30.950824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b345cc-0e58-4914-b339-6638f93ab931 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:30.951107 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b345cc-0e58-4914-b339-6638f93ab931 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:30.951384 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b345cc-0e58-4914-b339-6638f93ab931 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:30.951994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b345cc-0e58-4914-b339-6638f93ab931 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:23:30.952288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b345cc-0e58-4914-b339-6638f93ab931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:30.953613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b345cc-0e58-4914-b339-6638f93ab931 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:30.958441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 663/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Aug 7 22:23:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:23:30.964758 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef55934-f675-47ee-8a8a-76dab16e5be0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:23:31.061943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef55934-f675-47ee-8a8a-76dab16e5be0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:23:31.093903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5cdb4-160e-4558-9fe4-3fc4834d4486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:23:31.094485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5cdb4-160e-4558-9fe4-3fc4834d4486 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:23:31.094755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5cdb4-160e-4558-9fe4-3fc4834d4486 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:23:31.095016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5cdb4-160e-4558-9fe4-3fc4834d4486 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:23:31.095691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5cdb4-160e-4558-9fe4-3fc4834d4486 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:23:31.097037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5cdb4-160e-4558-9fe4-3fc4834d4486 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:23:31.116219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 643/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:23:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:23:40.955543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=30 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:23:41.112009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:34.008426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e1066-333b-44e9-906d-bf6d8884c576 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:34.009725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e1066-333b-44e9-906d-bf6d8884c576 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:34.010304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e1066-333b-44e9-906d-bf6d8884c576 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:34.013194 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 664/1307] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:24:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:24:34.018178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a16517-f244-49de-846a-53ce23232fb4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:34.018563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a16517-f244-49de-846a-53ce23232fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:34.018651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a16517-f244-49de-846a-53ce23232fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:34.131541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d0a16517-f244-49de-846a-53ce23232fb4 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:24:34.133086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d0a16517-f244-49de-846a-53ce23232fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:34.267167 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 644/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:24:34.306421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11810a3-3587-4619-aebb-7cc435ef2c5a None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:34.306695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11810a3-3587-4619-aebb-7cc435ef2c5a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:34.307273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11810a3-3587-4619-aebb-7cc435ef2c5a None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:34.308837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 665/1309] 10.222.0.15 () {54 vars in 965 bytes} [Sun Aug 7 22:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:24:34.315027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c743-0851-4cea-8ed4-05f6206db515 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:34.317217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c743-0851-4cea-8ed4-05f6206db515 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:34.317572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c743-0851-4cea-8ed4-05f6206db515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:34.410337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9fc2c743-0851-4cea-8ed4-05f6206db515 None None] MFA Rules not processed for user `8c68d5fdc4a946499ae86cdff0149470`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:24:34.411561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9fc2c743-0851-4cea-8ed4-05f6206db515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:34.432763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:34.495292 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 645/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Sun Aug 7 22:24:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:24:34.504858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11810a3-3587-4619-aebb-7cc435ef2c5a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:24:34.506916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f11810a3-3587-4619-aebb-7cc435ef2c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:34.642503 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11810a3-3587-4619-aebb-7cc435ef2c5a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:24:34.722386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabfb49-724b-40df-86d2-9a2e0bce518b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:24:34.722999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabfb49-724b-40df-86d2-9a2e0bce518b service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:34.723324 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabfb49-724b-40df-86d2-9a2e0bce518b service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:34.723599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabfb49-724b-40df-86d2-9a2e0bce518b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:34.725877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-efabfb49-724b-40df-86d2-9a2e0bce518b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:34.782806 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:34.845561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabfb49-724b-40df-86d2-9a2e0bce518b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:24:34.847115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabfb49-724b-40df-86d2-9a2e0bce518b service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:24:34.866843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 666/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:24:37.239311 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad126d4-c541-45cf-bb07-c33050bd4686 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:37.240462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad126d4-c541-45cf-bb07-c33050bd4686 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:37.240462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad126d4-c541-45cf-bb07-c33050bd4686 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:37.241861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 646/1312] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:24:37.247301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2dd5f-c6a5-485b-8e98-cda13bc2cfc2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:37.247728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2dd5f-c6a5-485b-8e98-cda13bc2cfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:37.247823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2dd5f-c6a5-485b-8e98-cda13bc2cfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:37.334445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-9dc2dd5f-c6a5-485b-8e98-cda13bc2cfc2 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:24:37.335673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9dc2dd5f-c6a5-485b-8e98-cda13bc2cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:37.432112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 667/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:24:37.470607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad126d4-c541-45cf-bb07-c33050bd4686 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:24:37.472299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4ad126d4-c541-45cf-bb07-c33050bd4686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:37.585390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad126d4-c541-45cf-bb07-c33050bd4686 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:24:37.665363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:37.668022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a107e-14a1-425a-b56e-9602a6489e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:24:37.668658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a107e-14a1-425a-b56e-9602a6489e85 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:37.668958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a107e-14a1-425a-b56e-9602a6489e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:37.669532 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a107e-14a1-425a-b56e-9602a6489e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:37.671641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-984a107e-14a1-425a-b56e-9602a6489e85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:37.781056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a107e-14a1-425a-b56e-9602a6489e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:24:37.782493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a107e-14a1-425a-b56e-9602a6489e85 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:24:37.800070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 647/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:24:40.085672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110683-c501-4700-b176-50c4c087c602 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:40.086181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110683-c501-4700-b176-50c4c087c602 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:40.086275 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110683-c501-4700-b176-50c4c087c602 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:40.087606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 668/1315] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:24:40.092712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f5e57-898e-4117-aace-e680fc451068 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:40.093149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f5e57-898e-4117-aace-e680fc451068 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:40.093246 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f5e57-898e-4117-aace-e680fc451068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:40.158009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-185f5e57-898e-4117-aace-e680fc451068 None None] MFA Rules not processed for user `304b0ae1b9db410cb161ec2c8982cfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:24:40.159149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-185f5e57-898e-4117-aace-e680fc451068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:40.209447 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:40.252461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 648/1316] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:24:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:24:40.297566 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46110683-c501-4700-b176-50c4c087c602 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:24:40.299102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-46110683-c501-4700-b176-50c4c087c602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:40.308814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:40.401065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46110683-c501-4700-b176-50c4c087c602 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:24:40.471494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947994d1-35c0-46a6-ac57-f8220db7ad32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:24:40.472031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947994d1-35c0-46a6-ac57-f8220db7ad32 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:40.472306 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947994d1-35c0-46a6-ac57-f8220db7ad32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:40.472573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947994d1-35c0-46a6-ac57-f8220db7ad32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:40.474170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-947994d1-35c0-46a6-ac57-f8220db7ad32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:40.535844 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:40.584246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947994d1-35c0-46a6-ac57-f8220db7ad32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:24:40.585665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947994d1-35c0-46a6-ac57-f8220db7ad32 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:24:40.603660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 669/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:24:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:24:43.166201 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2184d6-13e5-45a2-88e4-d8cce0879512 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:43.166756 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2184d6-13e5-45a2-88e4-d8cce0879512 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:43.166756 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2184d6-13e5-45a2-88e4-d8cce0879512 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:43.168122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 649/1318] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:24:43.173387 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485aa31-76ba-4f84-b2a9-76aad99213fa None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:43.173826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485aa31-76ba-4f84-b2a9-76aad99213fa None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:43.173938 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485aa31-76ba-4f84-b2a9-76aad99213fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:43.238050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1485aa31-76ba-4f84-b2a9-76aad99213fa None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:24:43.239869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1485aa31-76ba-4f84-b2a9-76aad99213fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:43.336129 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 670/1319] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:24:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:24:43.375030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2184d6-13e5-45a2-88e4-d8cce0879512 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:24:43.376580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fa2184d6-13e5-45a2-88e4-d8cce0879512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:43.477686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2184d6-13e5-45a2-88e4-d8cce0879512 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:24:43.549696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d85108-f301-4fae-a3c6-1873c815c032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:24:43.550290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d85108-f301-4fae-a3c6-1873c815c032 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:43.550568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d85108-f301-4fae-a3c6-1873c815c032 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:43.550838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d85108-f301-4fae-a3c6-1873c815c032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:43.552476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-42d85108-f301-4fae-a3c6-1873c815c032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:43.560691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:43.660086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d85108-f301-4fae-a3c6-1873c815c032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:24:43.662042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d85108-f301-4fae-a3c6-1873c815c032 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:24:43.679438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 650/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:24:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:24:46.308359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9c900-a727-4791-a004-ac863affea7c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:46.308886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9c900-a727-4791-a004-ac863affea7c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:46.308886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9c900-a727-4791-a004-ac863affea7c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:46.310351 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 671/1321] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:24:46.315330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337aa95d-6a11-44f7-adfc-bd49f4e66012 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:46.315757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337aa95d-6a11-44f7-adfc-bd49f4e66012 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:46.315942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337aa95d-6a11-44f7-adfc-bd49f4e66012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:46.382855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-337aa95d-6a11-44f7-adfc-bd49f4e66012 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:24:46.384101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-337aa95d-6a11-44f7-adfc-bd49f4e66012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:46.448495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:46.491300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 651/1322] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:24:46.544323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf2ea8-a61f-4284-86af-b7b790cf7832 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:46.544603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf2ea8-a61f-4284-86af-b7b790cf7832 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:46.544874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf2ea8-a61f-4284-86af-b7b790cf7832 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:46.546216 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 672/1323] 10.222.0.15 () {54 vars in 965 bytes} [Sun Aug 7 22:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:24:46.552871 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac658a2d-7a05-497d-a7eb-92056534abf0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:46.553158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac658a2d-7a05-497d-a7eb-92056534abf0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:46.553431 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac658a2d-7a05-497d-a7eb-92056534abf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:46.631420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ac658a2d-7a05-497d-a7eb-92056534abf0 None None] MFA Rules not processed for user `8c68d5fdc4a946499ae86cdff0149470`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:24:46.632659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ac658a2d-7a05-497d-a7eb-92056534abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:46.710535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 652/1324] 10.222.0.15 () {58 vars in 1062 bytes} [Sun Aug 7 22:24:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:24:46.719721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf2ea8-a61f-4284-86af-b7b790cf7832 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:24:46.721859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6adf2ea8-a61f-4284-86af-b7b790cf7832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:46.742638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:46.827822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf2ea8-a61f-4284-86af-b7b790cf7832 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:24:46.902840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d14bd-e59d-482b-b5c0-455b754215a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:24:46.903391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d14bd-e59d-482b-b5c0-455b754215a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:46.903666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d14bd-e59d-482b-b5c0-455b754215a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:46.903932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d14bd-e59d-482b-b5c0-455b754215a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:46.905503 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-293d14bd-e59d-482b-b5c0-455b754215a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:46.976685 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:47.018671 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d14bd-e59d-482b-b5c0-455b754215a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:24:47.020175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d14bd-e59d-482b-b5c0-455b754215a0 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:24:47.040372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 673/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:24:49.300127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a74b98-ccd5-4a37-a987-b410e3903b39 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:49.300701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a74b98-ccd5-4a37-a987-b410e3903b39 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:49.300701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a74b98-ccd5-4a37-a987-b410e3903b39 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:49.302254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 653/1326] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:24:49.308238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571de2fd-c7ed-4076-a861-773aae7be615 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:49.308865 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571de2fd-c7ed-4076-a861-773aae7be615 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:49.308865 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571de2fd-c7ed-4076-a861-773aae7be615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:49.376008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-571de2fd-c7ed-4076-a861-773aae7be615 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:24:49.377197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-571de2fd-c7ed-4076-a861-773aae7be615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:49.471656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 674/1327] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:24:49.511189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a74b98-ccd5-4a37-a987-b410e3903b39 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:24:49.512728 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-46a74b98-ccd5-4a37-a987-b410e3903b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:49.578301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:49.621959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a74b98-ccd5-4a37-a987-b410e3903b39 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:24:49.695615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a2a91-d7f3-42a6-a2aa-7eae7516e164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:24:49.696217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a2a91-d7f3-42a6-a2aa-7eae7516e164 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:49.696499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a2a91-d7f3-42a6-a2aa-7eae7516e164 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:49.696765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a2a91-d7f3-42a6-a2aa-7eae7516e164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:49.698355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-034a2a91-d7f3-42a6-a2aa-7eae7516e164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:49.806556 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:49.809057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a2a91-d7f3-42a6-a2aa-7eae7516e164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:24:49.810531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a2a91-d7f3-42a6-a2aa-7eae7516e164 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:24:49.828708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 654/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:24:51.874029 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5446b-b9af-40d4-876b-b1208294b0cb None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:51.874588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5446b-b9af-40d4-876b-b1208294b0cb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:51.874588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5446b-b9af-40d4-876b-b1208294b0cb None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:51.875987 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 675/1329] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:24:51.881975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb0342-dbc4-4838-b316-1a30d9d9c2eb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:51.882374 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb0342-dbc4-4838-b316-1a30d9d9c2eb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:51.882680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb0342-dbc4-4838-b316-1a30d9d9c2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:51.947991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e5eb0342-dbc4-4838-b316-1a30d9d9c2eb None None] MFA Rules not processed for user `304b0ae1b9db410cb161ec2c8982cfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:24:51.949119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e5eb0342-dbc4-4838-b316-1a30d9d9c2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:52.049420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 655/1330] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:24:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:24:52.087609 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5446b-b9af-40d4-876b-b1208294b0cb None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:24:52.089119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1dc5446b-b9af-40d4-876b-b1208294b0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:52.119659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:52.214937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5446b-b9af-40d4-876b-b1208294b0cb None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:24:52.293265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf073e85-4c9a-4d32-9e3b-09d9f95e8cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:24:52.293857 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf073e85-4c9a-4d32-9e3b-09d9f95e8cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:52.294127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf073e85-4c9a-4d32-9e3b-09d9f95e8cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:52.294390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf073e85-4c9a-4d32-9e3b-09d9f95e8cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:52.295979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cf073e85-4c9a-4d32-9e3b-09d9f95e8cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:52.370383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:52.403928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf073e85-4c9a-4d32-9e3b-09d9f95e8cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:24:52.405295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf073e85-4c9a-4d32-9e3b-09d9f95e8cb5 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:24:52.423384 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 676/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:24:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:24:54.658181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fdaea-de4a-4bf4-bb33-406c3cda7fbb None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:54.658743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fdaea-de4a-4bf4-bb33-406c3cda7fbb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:54.658743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fdaea-de4a-4bf4-bb33-406c3cda7fbb None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:54.660611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 656/1332] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:24:54.665722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f4af5-acdf-4584-8a95-d5be5f674edd None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:54.666163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f4af5-acdf-4584-8a95-d5be5f674edd None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:54.666261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f4af5-acdf-4584-8a95-d5be5f674edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:54.731773 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c62f4af5-acdf-4584-8a95-d5be5f674edd None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:24:54.732975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c62f4af5-acdf-4584-8a95-d5be5f674edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:54.826848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 677/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:24:54.862802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fdaea-de4a-4bf4-bb33-406c3cda7fbb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:24:54.864329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-468fdaea-de4a-4bf4-bb33-406c3cda7fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:54.933837 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:54.968496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fdaea-de4a-4bf4-bb33-406c3cda7fbb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:24:55.042461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddaef0-71ff-4a64-ba01-56d039ff3dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:24:55.043057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddaef0-71ff-4a64-ba01-56d039ff3dab service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:55.043361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddaef0-71ff-4a64-ba01-56d039ff3dab service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:55.043627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddaef0-71ff-4a64-ba01-56d039ff3dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:55.045195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-48ddaef0-71ff-4a64-ba01-56d039ff3dab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:55.151727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddaef0-71ff-4a64-ba01-56d039ff3dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:24:55.153153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddaef0-71ff-4a64-ba01-56d039ff3dab service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:24:55.162775 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:55.171152 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 657/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:24:57.214821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4ec2c-bfd6-4226-937b-3fa67bee19df None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:57.215388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4ec2c-bfd6-4226-937b-3fa67bee19df None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:57.215388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4ec2c-bfd6-4226-937b-3fa67bee19df None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:57.216704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 678/1335] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:24:57.221708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285326-2a02-4f2e-a84e-5587b532eef4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:57.222086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285326-2a02-4f2e-a84e-5587b532eef4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:57.222321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285326-2a02-4f2e-a84e-5587b532eef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:57.287314 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2e285326-2a02-4f2e-a84e-5587b532eef4 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:24:57.288512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2e285326-2a02-4f2e-a84e-5587b532eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:57.386416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 658/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:24:57.427066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4ec2c-bfd6-4226-937b-3fa67bee19df None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:24:57.428894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a6d4ec2c-bfd6-4226-937b-3fa67bee19df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:57.468671 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:57.531368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4ec2c-bfd6-4226-937b-3fa67bee19df None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:24:57.602177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47449b7d-8e43-4a7d-a88c-50da1bdb0eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:24:57.602705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47449b7d-8e43-4a7d-a88c-50da1bdb0eac service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:24:57.602979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47449b7d-8e43-4a7d-a88c-50da1bdb0eac service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:24:57.603279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47449b7d-8e43-4a7d-a88c-50da1bdb0eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:24:57.604845 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-47449b7d-8e43-4a7d-a88c-50da1bdb0eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:24:57.686020 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:24:57.711196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47449b7d-8e43-4a7d-a88c-50da1bdb0eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:24:57.712610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47449b7d-8e43-4a7d-a88c-50da1bdb0eac service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:24:57.730267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 679/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:00.326168 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77479712-cefb-4e33-954f-aabb34839dbb None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:00.326687 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77479712-cefb-4e33-954f-aabb34839dbb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:00.326797 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77479712-cefb-4e33-954f-aabb34839dbb None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:00.328104 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 659/1338] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:00.333631 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221bc60-f563-46c0-86bb-32f380372a76 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:00.334038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221bc60-f563-46c0-86bb-32f380372a76 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:00.334178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221bc60-f563-46c0-86bb-32f380372a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:00.399310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4221bc60-f563-46c0-86bb-32f380372a76 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:00.400499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4221bc60-f563-46c0-86bb-32f380372a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:00.493636 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 680/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:00.530179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77479712-cefb-4e33-954f-aabb34839dbb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:00.531738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-77479712-cefb-4e33-954f-aabb34839dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:00.608850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:00.642008 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77479712-cefb-4e33-954f-aabb34839dbb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:00.714006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70367966-4a93-46ff-a149-acd4dac35633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:00.714606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70367966-4a93-46ff-a149-acd4dac35633 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:00.714880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70367966-4a93-46ff-a149-acd4dac35633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:00.715182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70367966-4a93-46ff-a149-acd4dac35633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:00.716762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-70367966-4a93-46ff-a149-acd4dac35633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:00.828211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70367966-4a93-46ff-a149-acd4dac35633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:00.829640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70367966-4a93-46ff-a149-acd4dac35633 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:00.847815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 660/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:04.880210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976a8ea-e8c1-4d11-a3db-56192b3cd4c0 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:04.880815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976a8ea-e8c1-4d11-a3db-56192b3cd4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:04.880815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976a8ea-e8c1-4d11-a3db-56192b3cd4c0 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:04.882092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 681/1341] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:04.887599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fef47-3955-4f6e-9fc0-f4ccda3a0c2f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:04.888024 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fef47-3955-4f6e-9fc0-f4ccda3a0c2f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:04.888294 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fef47-3955-4f6e-9fc0-f4ccda3a0c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:04.894550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:04.954803 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9e8fef47-3955-4f6e-9fc0-f4ccda3a0c2f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:04.956054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9e8fef47-3955-4f6e-9fc0-f4ccda3a0c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:05.057405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 661/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:05.095712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976a8ea-e8c1-4d11-a3db-56192b3cd4c0 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:05.097763 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7976a8ea-e8c1-4d11-a3db-56192b3cd4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:05.146419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:05.201029 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976a8ea-e8c1-4d11-a3db-56192b3cd4c0 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:05.273287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250b0f4-6cd8-4bae-937f-a011fefed147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:05.273890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250b0f4-6cd8-4bae-937f-a011fefed147 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:05.274165 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250b0f4-6cd8-4bae-937f-a011fefed147 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:05.274431 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250b0f4-6cd8-4bae-937f-a011fefed147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:05.276040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8250b0f4-6cd8-4bae-937f-a011fefed147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:05.366732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:05.383078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250b0f4-6cd8-4bae-937f-a011fefed147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:05.384778 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250b0f4-6cd8-4bae-937f-a011fefed147 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:05.403471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 682/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:08.022243 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742234e3-6645-4a60-ba3b-d2dd11d3adeb None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:08.022800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742234e3-6645-4a60-ba3b-d2dd11d3adeb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:08.022800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742234e3-6645-4a60-ba3b-d2dd11d3adeb None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:08.024198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 662/1344] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:08.029910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db1801-3ce9-430d-ac76-b2c7f73f2a07 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:08.030414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db1801-3ce9-430d-ac76-b2c7f73f2a07 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:08.030510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db1801-3ce9-430d-ac76-b2c7f73f2a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:08.101553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e1db1801-3ce9-430d-ac76-b2c7f73f2a07 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:08.102771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e1db1801-3ce9-430d-ac76-b2c7f73f2a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:08.200450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 683/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:08.238205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742234e3-6645-4a60-ba3b-d2dd11d3adeb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:08.239891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-742234e3-6645-4a60-ba3b-d2dd11d3adeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:08.328615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:08.345133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742234e3-6645-4a60-ba3b-d2dd11d3adeb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:08.418585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ee98b-a0d8-48b4-9683-f57d5e80c4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:08.419123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ee98b-a0d8-48b4-9683-f57d5e80c4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:08.419402 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ee98b-a0d8-48b4-9683-f57d5e80c4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:08.419669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ee98b-a0d8-48b4-9683-f57d5e80c4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:08.421240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e90ee98b-a0d8-48b4-9683-f57d5e80c4a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:08.528749 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ee98b-a0d8-48b4-9683-f57d5e80c4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:08.530145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ee98b-a0d8-48b4-9683-f57d5e80c4a6 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:08.547767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 663/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:12.496346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239e7c4-ab16-4b34-80d9-6e97de4a69a4 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:12.496878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239e7c4-ab16-4b34-80d9-6e97de4a69a4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:12.496878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239e7c4-ab16-4b34-80d9-6e97de4a69a4 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:12.498207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 684/1347] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:12.503498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22b2e7-a097-420c-afa8-c02d80c8479e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:12.503916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22b2e7-a097-420c-afa8-c02d80c8479e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:12.504046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22b2e7-a097-420c-afa8-c02d80c8479e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:12.519406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:12.571161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4c22b2e7-a097-420c-afa8-c02d80c8479e None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:12.572365 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4c22b2e7-a097-420c-afa8-c02d80c8479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:12.670061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 664/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:12.707859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239e7c4-ab16-4b34-80d9-6e97de4a69a4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:12.709386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a239e7c4-ab16-4b34-80d9-6e97de4a69a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:12.787339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:12.835554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239e7c4-ab16-4b34-80d9-6e97de4a69a4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:12.913072 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc4cc9-3aed-47af-b7e1-c94b71d12e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:12.913687 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc4cc9-3aed-47af-b7e1-c94b71d12e95 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:12.913961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc4cc9-3aed-47af-b7e1-c94b71d12e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:12.914225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc4cc9-3aed-47af-b7e1-c94b71d12e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:12.915920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7afc4cc9-3aed-47af-b7e1-c94b71d12e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:13.028422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:13.033848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc4cc9-3aed-47af-b7e1-c94b71d12e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:13.035329 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc4cc9-3aed-47af-b7e1-c94b71d12e95 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:13.055050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 685/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:17.912515 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba67020-a7fe-4a99-a4f7-2e6cd36429f2 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:17.912956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba67020-a7fe-4a99-a4f7-2e6cd36429f2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:17.913258 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba67020-a7fe-4a99-a4f7-2e6cd36429f2 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:17.915716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 665/1350] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:17.925375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4b0e-12de-4228-b6b7-83017bbc8565 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:17.926273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4b0e-12de-4228-b6b7-83017bbc8565 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:17.926765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4b0e-12de-4228-b6b7-83017bbc8565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:18.061345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-89eb4b0e-12de-4228-b6b7-83017bbc8565 None None] MFA Rules not processed for user `90db0874a2f443768a9d9842beb2523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:18.062602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-89eb4b0e-12de-4228-b6b7-83017bbc8565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:18.174981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 686/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:25:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:22.285942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661adafe-324a-43d7-8f24-acb02b3aa8f1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:22.286460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661adafe-324a-43d7-8f24-acb02b3aa8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:22.286460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661adafe-324a-43d7-8f24-acb02b3aa8f1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:22.288026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 666/1352] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:22.293027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee552d-e889-4cb1-b674-3cda945cee1d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:22.293436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee552d-e889-4cb1-b674-3cda945cee1d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:22.293675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee552d-e889-4cb1-b674-3cda945cee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:22.352199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:22.377872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a4ee552d-e889-4cb1-b674-3cda945cee1d None None] MFA Rules not processed for user `90db0874a2f443768a9d9842beb2523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:22.379220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a4ee552d-e889-4cb1-b674-3cda945cee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:22.498575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 687/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:25:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:25:22.668007 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=59 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:23.904470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b35eb0-605d-4f5c-8d97-dbc0b6eb215c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:23.905002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b35eb0-605d-4f5c-8d97-dbc0b6eb215c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:23.905236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b35eb0-605d-4f5c-8d97-dbc0b6eb215c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:23.906658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 667/1354] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:23.912318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0729ce-7ecb-429b-808d-3a9dec60e0d9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:23.912760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0729ce-7ecb-429b-808d-3a9dec60e0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:23.912992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0729ce-7ecb-429b-808d-3a9dec60e0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:23.993085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6a0729ce-7ecb-429b-808d-3a9dec60e0d9 None None] MFA Rules not processed for user `90db0874a2f443768a9d9842beb2523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:23.994301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6a0729ce-7ecb-429b-808d-3a9dec60e0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:24.038715 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:24.104928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 688/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:25:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:27.436918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8b3d9-62fc-49bc-8881-56ce2258f82c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:27.437774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8b3d9-62fc-49bc-8881-56ce2258f82c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:27.438185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8b3d9-62fc-49bc-8881-56ce2258f82c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:27.440881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 668/1356] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:27.447875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df185b2-9e9c-42c0-84c7-46d61823f8ad None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:27.447875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df185b2-9e9c-42c0-84c7-46d61823f8ad None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:27.448452 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df185b2-9e9c-42c0-84c7-46d61823f8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:27.537918 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7df185b2-9e9c-42c0-84c7-46d61823f8ad None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:27.539592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7df185b2-9e9c-42c0-84c7-46d61823f8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:27.646670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 689/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:27.709859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe042-346c-489d-83ec-35d8d2b2fb85 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:27.710330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe042-346c-489d-83ec-35d8d2b2fb85 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:27.711058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe042-346c-489d-83ec-35d8d2b2fb85 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:27.713091 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 669/1358] 10.222.0.15 () {54 vars in 962 bytes} [Sun Aug 7 22:25:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:27.720420 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe6acc-ac1a-42bf-9bd9-b3585759e99e None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:27.720708 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe6acc-ac1a-42bf-9bd9-b3585759e99e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:27.720984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe6acc-ac1a-42bf-9bd9-b3585759e99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:27.739391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:27.806706 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8afe6acc-ac1a-42bf-9bd9-b3585759e99e None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:27.808063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8afe6acc-ac1a-42bf-9bd9-b3585759e99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:27.939929 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 690/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Sun Aug 7 22:25:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:27.947691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe042-346c-489d-83ec-35d8d2b2fb85 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:27.949230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cdbbe042-346c-489d-83ec-35d8d2b2fb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:28.104044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe042-346c-489d-83ec-35d8d2b2fb85 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:28.181671 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:28.225164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07b7ab-52e5-4a0a-bf0b-729cefa12c6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:28.225781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07b7ab-52e5-4a0a-bf0b-729cefa12c6e service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:28.226072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07b7ab-52e5-4a0a-bf0b-729cefa12c6e service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:28.226329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07b7ab-52e5-4a0a-bf0b-729cefa12c6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:28.228190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cc07b7ab-52e5-4a0a-bf0b-729cefa12c6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:28.322695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07b7ab-52e5-4a0a-bf0b-729cefa12c6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:28.324323 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07b7ab-52e5-4a0a-bf0b-729cefa12c6e service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:28.343190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 670/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:30.560798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8930-7d93-4739-afc6-d06cf8a36d5e None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:30.561442 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8930-7d93-4739-afc6-d06cf8a36d5e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:30.561442 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8930-7d93-4739-afc6-d06cf8a36d5e None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:30.562849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 691/1361] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:30.568533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b5b0-49c9-4a29-bcf5-ecd101d11a88 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:30.569150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b5b0-49c9-4a29-bcf5-ecd101d11a88 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:30.569150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b5b0-49c9-4a29-bcf5-ecd101d11a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:30.638666 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1669b5b0-49c9-4a29-bcf5-ecd101d11a88 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:30.639981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1669b5b0-49c9-4a29-bcf5-ecd101d11a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:30.680707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:30.763227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 671/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:30.802066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc8930-7d93-4739-afc6-d06cf8a36d5e None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:30.804210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-bbbc8930-7d93-4739-afc6-d06cf8a36d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:30.894482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:30.989879 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc8930-7d93-4739-afc6-d06cf8a36d5e None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:31.127116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275aa2b-4211-4da7-a6b3-ace1a32097ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:31.127751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275aa2b-4211-4da7-a6b3-ace1a32097ac service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:31.128027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275aa2b-4211-4da7-a6b3-ace1a32097ac service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:31.128293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275aa2b-4211-4da7-a6b3-ace1a32097ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:31.129914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a275aa2b-4211-4da7-a6b3-ace1a32097ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:31.155796 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:31.227316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275aa2b-4211-4da7-a6b3-ace1a32097ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:31.229082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275aa2b-4211-4da7-a6b3-ace1a32097ac service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:31.247779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 692/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:33.618329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23bf4b-a6de-46f7-b6ab-0509318d9bbf None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:33.618877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23bf4b-a6de-46f7-b6ab-0509318d9bbf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:33.618877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23bf4b-a6de-46f7-b6ab-0509318d9bbf None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:33.620301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 672/1364] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:33.625633 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeafd73-a128-4006-991c-19c9ecdf22cb None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:33.626097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeafd73-a128-4006-991c-19c9ecdf22cb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:33.626187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeafd73-a128-4006-991c-19c9ecdf22cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:33.713182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0eeafd73-a128-4006-991c-19c9ecdf22cb None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:33.714842 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0eeafd73-a128-4006-991c-19c9ecdf22cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:33.819427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:33.823125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 693/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:33.868566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef0cba-98c8-44ff-b785-8fa9165aa797 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:33.868815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef0cba-98c8-44ff-b785-8fa9165aa797 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:33.869246 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef0cba-98c8-44ff-b785-8fa9165aa797 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:33.871044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 673/1366] 10.222.0.15 () {54 vars in 962 bytes} [Sun Aug 7 22:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:33.876646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd5b0e-5e64-418b-b8f0-2aaee1ec68ff None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:33.876929 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd5b0e-5e64-418b-b8f0-2aaee1ec68ff None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:33.877192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd5b0e-5e64-418b-b8f0-2aaee1ec68ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:33.960328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d0fd5b0e-5e64-418b-b8f0-2aaee1ec68ff None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:33.961555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d0fd5b0e-5e64-418b-b8f0-2aaee1ec68ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:34.088380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 694/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Sun Aug 7 22:25:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:34.096034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef0cba-98c8-44ff-b785-8fa9165aa797 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:34.097534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e9ef0cba-98c8-44ff-b785-8fa9165aa797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:34.260070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef0cba-98c8-44ff-b785-8fa9165aa797 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:34.281744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:34.385955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1261a2e-bafc-4cf5-9334-b4f1635541c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:34.386583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1261a2e-bafc-4cf5-9334-b4f1635541c7 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:34.387002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1261a2e-bafc-4cf5-9334-b4f1635541c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:34.387464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1261a2e-bafc-4cf5-9334-b4f1635541c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:34.389169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a1261a2e-bafc-4cf5-9334-b4f1635541c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:34.483823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1261a2e-bafc-4cf5-9334-b4f1635541c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:34.486041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1261a2e-bafc-4cf5-9334-b4f1635541c7 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:34.506142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 674/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:35.509473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabed9e-104a-4c13-b4ef-36690ed9bc91 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:35.510043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabed9e-104a-4c13-b4ef-36690ed9bc91 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:35.510043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabed9e-104a-4c13-b4ef-36690ed9bc91 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:35.511387 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 695/1369] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:35.517178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375447fc-678c-4b7b-926b-0a9a892c55c9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:35.517864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375447fc-678c-4b7b-926b-0a9a892c55c9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:35.517864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375447fc-678c-4b7b-926b-0a9a892c55c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:35.551328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:35.588684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-375447fc-678c-4b7b-926b-0a9a892c55c9 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:35.589879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-375447fc-678c-4b7b-926b-0a9a892c55c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:35.694688 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 675/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:36.039802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ee530-0fa0-486f-920b-f75f77633e11 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:36.040086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ee530-0fa0-486f-920b-f75f77633e11 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:36.040360 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ee530-0fa0-486f-920b-f75f77633e11 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:36.041949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 696/1371] 10.222.0.15 () {54 vars in 964 bytes} [Sun Aug 7 22:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:36.046690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cba2b-4b27-4f13-bfad-253926c4cdec None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:36.047044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cba2b-4b27-4f13-bfad-253926c4cdec None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:36.047534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cba2b-4b27-4f13-bfad-253926c4cdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:36.150903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-309cba2b-4b27-4f13-bfad-253926c4cdec None None] MFA Rules not processed for user `1cfe1875cce3436eac2ac8f4d6db88bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:36.152132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-309cba2b-4b27-4f13-bfad-253926c4cdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:36.201521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:36.241995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ee530-0fa0-486f-920b-f75f77633e11 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:36.243523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-303ee530-0fa0-486f-920b-f75f77633e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:36.252692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 676/1372] 10.222.0.15 () {58 vars in 1061 bytes} [Sun Aug 7 22:25:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:36.301440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:36.358537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ee530-0fa0-486f-920b-f75f77633e11 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:36.439826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e000c-9bd4-48ec-b264-4113d2ec8668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:36.440424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e000c-9bd4-48ec-b264-4113d2ec8668 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:36.440693 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e000c-9bd4-48ec-b264-4113d2ec8668 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:36.440954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e000c-9bd4-48ec-b264-4113d2ec8668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:36.442717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-135e000c-9bd4-48ec-b264-4113d2ec8668 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:36.543361 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:36.558525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e000c-9bd4-48ec-b264-4113d2ec8668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:36.560207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e000c-9bd4-48ec-b264-4113d2ec8668 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:36.580477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031cade-09e9-46de-8233-c4ca1832c33d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:36.581031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 697/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:36.581133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031cade-09e9-46de-8233-c4ca1832c33d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:36.581133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031cade-09e9-46de-8233-c4ca1832c33d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:36.582478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 677/1374] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:25:36.587780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5574924-f8f8-4d15-bbb9-b161f7951b83 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:36.588068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5574924-f8f8-4d15-bbb9-b161f7951b83 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:36.588340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5574924-f8f8-4d15-bbb9-b161f7951b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:36.670511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c5574924-f8f8-4d15-bbb9-b161f7951b83 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:36.671777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c5574924-f8f8-4d15-bbb9-b161f7951b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:36.787784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 698/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:36.832614 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031cade-09e9-46de-8233-c4ca1832c33d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:36.835656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3031cade-09e9-46de-8233-c4ca1832c33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:37.058757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031cade-09e9-46de-8233-c4ca1832c33d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:37.111473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:37.174182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8489b-1842-4882-8029-c65b1fe10e77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:37.174782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8489b-1842-4882-8029-c65b1fe10e77 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:37.175051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8489b-1842-4882-8029-c65b1fe10e77 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:37.175345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8489b-1842-4882-8029-c65b1fe10e77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:37.176922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-26b8489b-1842-4882-8029-c65b1fe10e77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:37.267691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8489b-1842-4882-8029-c65b1fe10e77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:37.269450 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8489b-1842-4882-8029-c65b1fe10e77 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:37.290520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 678/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:39.326062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b986e3-a7b5-48b7-b0ea-9b808eb509f8 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:39.326612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b986e3-a7b5-48b7-b0ea-9b808eb509f8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:39.326612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b986e3-a7b5-48b7-b0ea-9b808eb509f8 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:39.327970 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 699/1377] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:39.333198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeecf5-10ee-42bc-9344-6ae7acef9508 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:39.333637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeecf5-10ee-42bc-9344-6ae7acef9508 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:39.333748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeecf5-10ee-42bc-9344-6ae7acef9508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:39.405891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-74aeecf5-10ee-42bc-9344-6ae7acef9508 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:39.407636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-74aeecf5-10ee-42bc-9344-6ae7acef9508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:39.414238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:39.518274 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 679/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:39.569730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b986e3-a7b5-48b7-b0ea-9b808eb509f8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:39.572043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a6b986e3-a7b5-48b7-b0ea-9b808eb509f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:39.646105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:39.732891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b986e3-a7b5-48b7-b0ea-9b808eb509f8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:39.845086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308ab62-54fc-445f-90ff-7746d227c7cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:39.845674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308ab62-54fc-445f-90ff-7746d227c7cb service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:39.845945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308ab62-54fc-445f-90ff-7746d227c7cb service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:39.846211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308ab62-54fc-445f-90ff-7746d227c7cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:39.847816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0308ab62-54fc-445f-90ff-7746d227c7cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:39.866691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:39.954990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308ab62-54fc-445f-90ff-7746d227c7cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:39.956709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308ab62-54fc-445f-90ff-7746d227c7cb service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:39.975173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 700/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:42.079888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bca96-0160-4a25-854b-b1ea58c6bcf2 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:42.080501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bca96-0160-4a25-854b-b1ea58c6bcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:42.080866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bca96-0160-4a25-854b-b1ea58c6bcf2 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:42.083125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 680/1380] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:42.089102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3559de6-0472-4714-aadf-0dd576357062 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:42.089668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3559de6-0472-4714-aadf-0dd576357062 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:42.090082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3559de6-0472-4714-aadf-0dd576357062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:42.164729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c3559de6-0472-4714-aadf-0dd576357062 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:42.166145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c3559de6-0472-4714-aadf-0dd576357062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:42.267187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:42.275438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 701/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:42.317047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bca96-0160-4a25-854b-b1ea58c6bcf2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:42.318545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e46bca96-0160-4a25-854b-b1ea58c6bcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:42.472734 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:42.484131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bca96-0160-4a25-854b-b1ea58c6bcf2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:42.603275 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f545df-8f25-4714-b4bb-ea5d9b8309a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:42.603880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f545df-8f25-4714-b4bb-ea5d9b8309a3 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:42.604154 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f545df-8f25-4714-b4bb-ea5d9b8309a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:42.604419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f545df-8f25-4714-b4bb-ea5d9b8309a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:42.605984 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f3f545df-8f25-4714-b4bb-ea5d9b8309a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:42.700198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f545df-8f25-4714-b4bb-ea5d9b8309a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:42.701794 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f545df-8f25-4714-b4bb-ea5d9b8309a3 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:42.713589 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:42.723815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 681/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:44.997087 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d0b34-e762-44d2-8800-d884c6037a4d None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:44.997563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d0b34-e762-44d2-8800-d884c6037a4d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:44.997802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d0b34-e762-44d2-8800-d884c6037a4d None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:44.999398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 702/1383] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:45.004675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297569a-65db-405f-90d0-97ecfa80d3a6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:45.005199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297569a-65db-405f-90d0-97ecfa80d3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:45.005199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297569a-65db-405f-90d0-97ecfa80d3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:45.081516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e297569a-65db-405f-90d0-97ecfa80d3a6 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:45.082723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e297569a-65db-405f-90d0-97ecfa80d3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:45.184360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 682/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:45.226644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d0b34-e762-44d2-8800-d884c6037a4d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:45.228217 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4b5d0b34-e762-44d2-8800-d884c6037a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:45.379135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d0b34-e762-44d2-8800-d884c6037a4d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:45.467292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:45.514179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214e9b8-f744-41fc-b511-41f9751341a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:45.514808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214e9b8-f744-41fc-b511-41f9751341a2 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:45.515120 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214e9b8-f744-41fc-b511-41f9751341a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:45.515920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214e9b8-f744-41fc-b511-41f9751341a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:45.517535 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e214e9b8-f744-41fc-b511-41f9751341a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:45.611012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214e9b8-f744-41fc-b511-41f9751341a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:45.612629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214e9b8-f744-41fc-b511-41f9751341a2 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:45.631289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 703/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:48.242687 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c00c5-b4b8-4231-abdb-47d4573defd1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:48.243263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c00c5-b4b8-4231-abdb-47d4573defd1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:48.243263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c00c5-b4b8-4231-abdb-47d4573defd1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:48.244577 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 683/1386] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:48.250501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494805f-19d1-4019-867a-a13db39bcb47 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:48.251105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494805f-19d1-4019-867a-a13db39bcb47 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:48.251105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494805f-19d1-4019-867a-a13db39bcb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:48.318479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3494805f-19d1-4019-867a-a13db39bcb47 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:48.319743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3494805f-19d1-4019-867a-a13db39bcb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:48.353375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:48.423202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 704/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:48.467340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c00c5-b4b8-4231-abdb-47d4573defd1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:48.469925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6e4c00c5-b4b8-4231-abdb-47d4573defd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:48.559473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:48.649498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c00c5-b4b8-4231-abdb-47d4573defd1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:48.771769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ccbf4-4784-442a-9284-785ca58c7732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:48.772348 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ccbf4-4784-442a-9284-785ca58c7732 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:48.772642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ccbf4-4784-442a-9284-785ca58c7732 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:48.772915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ccbf4-4784-442a-9284-785ca58c7732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:48.774485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-af2ccbf4-4784-442a-9284-785ca58c7732 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:48.811719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:48.867214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ccbf4-4784-442a-9284-785ca58c7732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:48.868844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ccbf4-4784-442a-9284-785ca58c7732 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:48.887605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 684/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:50.901711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067657e3-2fde-4ee2-be66-373b8a18a687 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:50.902256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067657e3-2fde-4ee2-be66-373b8a18a687 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:50.902256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067657e3-2fde-4ee2-be66-373b8a18a687 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:50.903611 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 705/1389] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:50.908706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939d5e4-e2b2-430c-b8af-8034d29340b0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:50.909138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939d5e4-e2b2-430c-b8af-8034d29340b0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:50.909283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939d5e4-e2b2-430c-b8af-8034d29340b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:50.974261 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3939d5e4-e2b2-430c-b8af-8034d29340b0 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:50.975482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3939d5e4-e2b2-430c-b8af-8034d29340b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:51.076953 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 685/1390] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:51.120699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067657e3-2fde-4ee2-be66-373b8a18a687 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:51.122194 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-067657e3-2fde-4ee2-be66-373b8a18a687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:51.268201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067657e3-2fde-4ee2-be66-373b8a18a687 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:51.285410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:51.381375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed3463-d018-4fd5-9d2a-d6b4fc7a5428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:51.382234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed3463-d018-4fd5-9d2a-d6b4fc7a5428 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:51.382520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed3463-d018-4fd5-9d2a-d6b4fc7a5428 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:51.382787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed3463-d018-4fd5-9d2a-d6b4fc7a5428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:51.384479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-23ed3463-d018-4fd5-9d2a-d6b4fc7a5428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:51.473439 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed3463-d018-4fd5-9d2a-d6b4fc7a5428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:51.475018 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed3463-d018-4fd5-9d2a-d6b4fc7a5428 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:51.493096 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 706/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:51.612746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b50f5-696e-451e-b44c-b81d8bc17a10 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:51.613027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b50f5-696e-451e-b44c-b81d8bc17a10 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:51.613299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b50f5-696e-451e-b44c-b81d8bc17a10 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:51.614686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 686/1392] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:51.620413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede41a0-26ad-449b-9a8b-4eb184b8a817 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:51.620948 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede41a0-26ad-449b-9a8b-4eb184b8a817 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:51.621218 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede41a0-26ad-449b-9a8b-4eb184b8a817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:51.650921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:51.697950 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-bede41a0-26ad-449b-9a8b-4eb184b8a817 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:51.699227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-bede41a0-26ad-449b-9a8b-4eb184b8a817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:51.797229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 707/1393] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:51.852673 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5cdb5-b917-41ef-b7a4-bf521d83b949 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:51.853051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5cdb5-b917-41ef-b7a4-bf521d83b949 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:51.853382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5cdb5-b917-41ef-b7a4-bf521d83b949 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:51.854805 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 687/1394] 10.222.0.15 () {54 vars in 966 bytes} [Sun Aug 7 22:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:51.859922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ae4f6-830d-4c78-a561-f160dc22bdf0 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:51.860209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ae4f6-830d-4c78-a561-f160dc22bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:51.860483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ae4f6-830d-4c78-a561-f160dc22bdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:51.936022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-800ae4f6-830d-4c78-a561-f160dc22bdf0 None None] MFA Rules not processed for user `c6639f15880c4c718f41cd84cb79c750`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:51.937218 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-800ae4f6-830d-4c78-a561-f160dc22bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:51.977295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:52.014166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 708/1395] 10.222.0.15 () {58 vars in 1063 bytes} [Sun Aug 7 22:25:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:52.022462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5cdb5-b917-41ef-b7a4-bf521d83b949 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:52.024020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-27e5cdb5-b917-41ef-b7a4-bf521d83b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:52.038406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:52.129496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5cdb5-b917-41ef-b7a4-bf521d83b949 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:52.202148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24fe65-b6f0-4b86-83c5-ad4488491193 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6639f15880c4c718f41cd84cb79c750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:52.203315 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24fe65-b6f0-4b86-83c5-ad4488491193 service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:52.203588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24fe65-b6f0-4b86-83c5-ad4488491193 service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:52.203849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24fe65-b6f0-4b86-83c5-ad4488491193 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:52.205441 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3c24fe65-b6f0-4b86-83c5-ad4488491193 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:52.272851 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:52.316876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24fe65-b6f0-4b86-83c5-ad4488491193 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:52.318554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24fe65-b6f0-4b86-83c5-ad4488491193 service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:52.336887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 688/1396] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:53.069548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038b4bf-5521-4b5d-9e53-2e171dab1c5c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:53.070017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038b4bf-5521-4b5d-9e53-2e171dab1c5c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:53.070259 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038b4bf-5521-4b5d-9e53-2e171dab1c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:53.140739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5038b4bf-5521-4b5d-9e53-2e171dab1c5c None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:53.141926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5038b4bf-5521-4b5d-9e53-2e171dab1c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:53.243196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 709/1397] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:53.290959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af633e33-ff1b-468f-98bc-decff57ecd0e None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:53.291496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af633e33-ff1b-468f-98bc-decff57ecd0e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:53.291604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af633e33-ff1b-468f-98bc-decff57ecd0e None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:53.292877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 689/1398] 10.222.0.15 () {54 vars in 943 bytes} [Sun Aug 7 22:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:53.299426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3abba-a5f3-4f93-bccb-f8382b10cb73 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:53.299712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3abba-a5f3-4f93-bccb-f8382b10cb73 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:53.300016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3abba-a5f3-4f93-bccb-f8382b10cb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:53.368606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:53.377140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1dc3abba-a5f3-4f93-bccb-f8382b10cb73 None None] MFA Rules not processed for user `c30e49a1967e48c9b45f56454ffc1297`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:53.378352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1dc3abba-a5f3-4f93-bccb-f8382b10cb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:53.485662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 710/1399] 10.222.0.15 () {58 vars in 1040 bytes} [Sun Aug 7 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:25:53.495113 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af633e33-ff1b-468f-98bc-decff57ecd0e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:53.496742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-af633e33-ff1b-468f-98bc-decff57ecd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:53.642946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af633e33-ff1b-468f-98bc-decff57ecd0e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:53.656161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed76310-b8a9-40b9-b823-69f6d0b1f3e7 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:53.656543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed76310-b8a9-40b9-b823-69f6d0b1f3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:53.657472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed76310-b8a9-40b9-b823-69f6d0b1f3e7 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:53.658826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 711/1400] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:25:53.664067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5588bb-4e1e-4328-b030-eb0461d6a3e2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:53.664374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5588bb-4e1e-4328-b030-eb0461d6a3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:53.664663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5588bb-4e1e-4328-b030-eb0461d6a3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:53.685609 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:53.751728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ec5588bb-4e1e-4328-b030-eb0461d6a3e2 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:53.752924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ec5588bb-4e1e-4328-b030-eb0461d6a3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:53.764318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594b304-f719-4093-b692-a4bb6851695f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:53.765508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594b304-f719-4093-b692-a4bb6851695f service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:53.765908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594b304-f719-4093-b692-a4bb6851695f service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:53.766314 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594b304-f719-4093-b692-a4bb6851695f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:53.768170 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7594b304-f719-4093-b692-a4bb6851695f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:53.814722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:53.850643 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 712/1401] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:53.855288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594b304-f719-4093-b692-a4bb6851695f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:53.855288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594b304-f719-4093-b692-a4bb6851695f service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:53.863260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 690/1402] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:25:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:25:53.896280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5588bb-4e1e-4328-b030-eb0461d6a3e2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:53.897520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ec5588bb-4e1e-4328-b030-eb0461d6a3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:54.028987 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5588bb-4e1e-4328-b030-eb0461d6a3e2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:54.114780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:54.172767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371c044-be32-4836-b1f1-6389507054f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:54.173415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371c044-be32-4836-b1f1-6389507054f7 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:54.173748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371c044-be32-4836-b1f1-6389507054f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:54.174078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371c044-be32-4836-b1f1-6389507054f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:54.175923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e371c044-be32-4836-b1f1-6389507054f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:54.283359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371c044-be32-4836-b1f1-6389507054f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:54.285117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371c044-be32-4836-b1f1-6389507054f7 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:54.305127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 713/1403] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:56.468491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68772fde-3ff7-4e83-b33c-269175e2cee2 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:56.469102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68772fde-3ff7-4e83-b33c-269175e2cee2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:56.469102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68772fde-3ff7-4e83-b33c-269175e2cee2 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:56.474766 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 691/1404] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:56.477190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99cdf-f665-4ace-9a40-b35b5a27d4a8 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:56.478046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99cdf-f665-4ace-9a40-b35b5a27d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:56.478318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99cdf-f665-4ace-9a40-b35b5a27d4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:56.560465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d7e99cdf-f665-4ace-9a40-b35b5a27d4a8 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:56.563257 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d7e99cdf-f665-4ace-9a40-b35b5a27d4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:56.611457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:56.675124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 714/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:56.721565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68772fde-3ff7-4e83-b33c-269175e2cee2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:56.723352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-68772fde-3ff7-4e83-b33c-269175e2cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:56.803309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:56.888812 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68772fde-3ff7-4e83-b33c-269175e2cee2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:57.036910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80cc80-f784-46de-91dd-bd9597c59c25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:57.037518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80cc80-f784-46de-91dd-bd9597c59c25 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:57.037790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80cc80-f784-46de-91dd-bd9597c59c25 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:57.038053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80cc80-f784-46de-91dd-bd9597c59c25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:57.039796 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8b80cc80-f784-46de-91dd-bd9597c59c25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:57.077806 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:57.145037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80cc80-f784-46de-91dd-bd9597c59c25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:57.146959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80cc80-f784-46de-91dd-bd9597c59c25 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:25:57.167213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 692/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:25:59.300771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3d4b7-d8ba-41aa-86d0-d5b42502b435 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:59.301336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3d4b7-d8ba-41aa-86d0-d5b42502b435 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:59.301336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3d4b7-d8ba-41aa-86d0-d5b42502b435 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:59.302834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 715/1407] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:25:59.307926 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4b27a-0a40-4749-977f-295d94529c1f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:59.308374 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4b27a-0a40-4749-977f-295d94529c1f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:59.308469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4b27a-0a40-4749-977f-295d94529c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:59.380116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5aa4b27a-0a40-4749-977f-295d94529c1f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:25:59.381314 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5aa4b27a-0a40-4749-977f-295d94529c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:59.500819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 693/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:25:59.546654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3d4b7-d8ba-41aa-86d0-d5b42502b435 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:25:59.548222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9ee3d4b7-d8ba-41aa-86d0-d5b42502b435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:59.711502 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3d4b7-d8ba-41aa-86d0-d5b42502b435 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:25:59.734159 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:25:59.838006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117121d-95d2-43f1-af09-9e5446e60b63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:25:59.838905 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117121d-95d2-43f1-af09-9e5446e60b63 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:25:59.839379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117121d-95d2-43f1-af09-9e5446e60b63 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:25:59.839813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117121d-95d2-43f1-af09-9e5446e60b63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:25:59.841616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9117121d-95d2-43f1-af09-9e5446e60b63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:25:59.966902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117121d-95d2-43f1-af09-9e5446e60b63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:25:59.969986 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117121d-95d2-43f1-af09-9e5446e60b63 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:00.023393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 716/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:09.498762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:10.001479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=88 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:16.221941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa82ea-6aa1-448c-b8db-10ada76352ba None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:16.222479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa82ea-6aa1-448c-b8db-10ada76352ba None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:16.222479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa82ea-6aa1-448c-b8db-10ada76352ba None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:16.223784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 694/1410] 10.222.0.15 () {54 vars in 918 bytes} [Sun Aug 7 22:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:16.228913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005a6e7-7637-4546-b2f0-a29b9a9826fb None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:16.229384 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005a6e7-7637-4546-b2f0-a29b9a9826fb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:16.229489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005a6e7-7637-4546-b2f0-a29b9a9826fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:16.304596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d005a6e7-7637-4546-b2f0-a29b9a9826fb None None] MFA Rules not processed for user `90db0874a2f443768a9d9842beb2523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:16.305802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d005a6e7-7637-4546-b2f0-a29b9a9826fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:16.410258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 717/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Sun Aug 7 22:26:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:16.424415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef64c84-2d82-4b61-9fea-0911953073bd None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:16.424696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef64c84-2d82-4b61-9fea-0911953073bd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:16.424966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef64c84-2d82-4b61-9fea-0911953073bd None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:16.426283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 695/1412] 10.222.0.15 () {54 vars in 918 bytes} [Sun Aug 7 22:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:16.430701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c30e2-ce99-4584-b8b0-3c73c5d0659a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:16.430990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c30e2-ce99-4584-b8b0-3c73c5d0659a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:16.431299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c30e2-ce99-4584-b8b0-3c73c5d0659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:16.503248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:16.506598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-496c30e2-ce99-4584-b8b0-3c73c5d0659a None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:16.508525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-496c30e2-ce99-4584-b8b0-3c73c5d0659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:16.623992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 718/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Sun Aug 7 22:26:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:19.079774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6acb4c-d671-49e2-aab5-ccaf1efeccfa None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:19.080287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6acb4c-d671-49e2-aab5-ccaf1efeccfa None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:19.080287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6acb4c-d671-49e2-aab5-ccaf1efeccfa None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:19.081607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:19.086867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098379ce-ea4b-430a-8c71-95ba6d70e3ed None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:19.087285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098379ce-ea4b-430a-8c71-95ba6d70e3ed None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:19.087501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098379ce-ea4b-430a-8c71-95ba6d70e3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:19.152794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-098379ce-ea4b-430a-8c71-95ba6d70e3ed None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:19.154003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-098379ce-ea4b-430a-8c71-95ba6d70e3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:19.207936 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:19.249013 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:19.292086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6acb4c-d671-49e2-aab5-ccaf1efeccfa None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:19.293738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-eb6acb4c-d671-49e2-aab5-ccaf1efeccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:19.436905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6acb4c-d671-49e2-aab5-ccaf1efeccfa None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:19.509648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:19.549407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdb95d-43e4-4826-8620-e2263b36852e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:19.550011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb95d-43e4-4826-8620-e2263b36852e service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:19.550282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb95d-43e4-4826-8620-e2263b36852e service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:19.550549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb95d-43e4-4826-8620-e2263b36852e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:19.552158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-39fdb95d-43e4-4826-8620-e2263b36852e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:19.640012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdb95d-43e4-4826-8620-e2263b36852e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:19.641616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdb95d-43e4-4826-8620-e2263b36852e service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:19.659334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 697/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:20.553993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01188851-2b29-4652-a217-0b320ffe92fe None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:20.554573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01188851-2b29-4652-a217-0b320ffe92fe None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:20.554573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01188851-2b29-4652-a217-0b320ffe92fe None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:20.555894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 22:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:20.560899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d6a21-4758-4d54-8bba-f87efd050f52 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:20.561286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d6a21-4758-4d54-8bba-f87efd050f52 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:20.561442 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d6a21-4758-4d54-8bba-f87efd050f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:20.636602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e95d6a21-4758-4d54-8bba-f87efd050f52 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:20.637795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e95d6a21-4758-4d54-8bba-f87efd050f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:20.664369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:20.733408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 22:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:20.889609 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01188851-2b29-4652-a217-0b320ffe92fe None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:20.891038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-01188851-2b29-4652-a217-0b320ffe92fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:21.034576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01188851-2b29-4652-a217-0b320ffe92fe None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:21.078360 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:21.149679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc51d90-0f2f-4d4e-a42c-4bcaea972915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:21.150191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc51d90-0f2f-4d4e-a42c-4bcaea972915 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:21.150463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc51d90-0f2f-4d4e-a42c-4bcaea972915 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:21.150728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc51d90-0f2f-4d4e-a42c-4bcaea972915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:21.152325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-afc51d90-0f2f-4d4e-a42c-4bcaea972915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:21.239440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc51d90-0f2f-4d4e-a42c-4bcaea972915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:21.241006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc51d90-0f2f-4d4e-a42c-4bcaea972915 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:21.259143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 721/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:22.127464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a892f-1acf-4992-8e47-b8c094979427 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:22.128021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a892f-1acf-4992-8e47-b8c094979427 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:22.128021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a892f-1acf-4992-8e47-b8c094979427 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:22.129383 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 22:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:22.134443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038a07c-b980-4df4-bccc-c14d4b9bd464 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:22.134846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038a07c-b980-4df4-bccc-c14d4b9bd464 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:22.134979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038a07c-b980-4df4-bccc-c14d4b9bd464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:22.305904 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:22.328310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1038a07c-b980-4df4-bccc-c14d4b9bd464 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:22.329496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1038a07c-b980-4df4-bccc-c14d4b9bd464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:22.421735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 22:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:22.574370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a892f-1acf-4992-8e47-b8c094979427 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:22.576489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-be8a892f-1acf-4992-8e47-b8c094979427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:22.718576 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a892f-1acf-4992-8e47-b8c094979427 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:22.731367 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:22.830847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742bc96-e50d-46a4-a9f2-b6bf13cce7ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:22.831417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742bc96-e50d-46a4-a9f2-b6bf13cce7ef service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:22.831698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742bc96-e50d-46a4-a9f2-b6bf13cce7ef service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:22.831969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742bc96-e50d-46a4-a9f2-b6bf13cce7ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:22.833559 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c742bc96-e50d-46a4-a9f2-b6bf13cce7ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:22.921546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742bc96-e50d-46a4-a9f2-b6bf13cce7ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:22.923183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742bc96-e50d-46a4-a9f2-b6bf13cce7ef service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:22.941065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 700/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:23.823281 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66a3d3-1592-4c68-b68b-8be9cdc5e5ee None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:23.823868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66a3d3-1592-4c68-b68b-8be9cdc5e5ee None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:23.823868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66a3d3-1592-4c68-b68b-8be9cdc5e5ee None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:23.825157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 22:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:23.830307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbd106-7c29-4dd3-ae8a-2aa1c8fca382 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:23.830735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbd106-7c29-4dd3-ae8a-2aa1c8fca382 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:23.830833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbd106-7c29-4dd3-ae8a-2aa1c8fca382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:23.850773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:23.906482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8efbd106-7c29-4dd3-ae8a-2aa1c8fca382 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:23.907680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8efbd106-7c29-4dd3-ae8a-2aa1c8fca382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:24.004250 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 22:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:24.152982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66a3d3-1592-4c68-b68b-8be9cdc5e5ee None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:24.155015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0c66a3d3-1592-4c68-b68b-8be9cdc5e5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:24.260911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:24.297268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66a3d3-1592-4c68-b68b-8be9cdc5e5ee None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:24.407838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd79f1-eeff-4af7-add1-cee56a6497c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:24.408370 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd79f1-eeff-4af7-add1-cee56a6497c5 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:24.408646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd79f1-eeff-4af7-add1-cee56a6497c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:24.408914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd79f1-eeff-4af7-add1-cee56a6497c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:24.410486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-68bd79f1-eeff-4af7-add1-cee56a6497c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:24.485245 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:24.499250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd79f1-eeff-4af7-add1-cee56a6497c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:24.500827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd79f1-eeff-4af7-add1-cee56a6497c5 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:24.519309 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 724/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:25.373514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aefb0-12ba-46e7-8aae-24d239817197 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:25.374086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aefb0-12ba-46e7-8aae-24d239817197 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:25.374086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aefb0-12ba-46e7-8aae-24d239817197 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:25.375470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 22:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:25.380405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6f594-c4e3-4f0a-b8cb-b6ea7099f79f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:25.380803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6f594-c4e3-4f0a-b8cb-b6ea7099f79f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:25.380960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6f594-c4e3-4f0a-b8cb-b6ea7099f79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:25.454435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f5a6f594-c4e3-4f0a-b8cb-b6ea7099f79f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:25.455649 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f5a6f594-c4e3-4f0a-b8cb-b6ea7099f79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:25.550170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 22:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:25.699915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aefb0-12ba-46e7-8aae-24d239817197 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:25.701895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-382aefb0-12ba-46e7-8aae-24d239817197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:25.789724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:25.850971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aefb0-12ba-46e7-8aae-24d239817197 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:25.961004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bea75f-8833-47f6-8df7-1c3a390ea024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:25.961562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea75f-8833-47f6-8df7-1c3a390ea024 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:25.961836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea75f-8833-47f6-8df7-1c3a390ea024 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:25.962105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea75f-8833-47f6-8df7-1c3a390ea024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:25.963712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-42bea75f-8833-47f6-8df7-1c3a390ea024 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:26.013555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:26.054043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea75f-8833-47f6-8df7-1c3a390ea024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:26.055664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea75f-8833-47f6-8df7-1c3a390ea024 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:26.080777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 703/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:26.873250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf5dad-4b13-45f7-8c8c-302e3d31b90d None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:26.873796 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf5dad-4b13-45f7-8c8c-302e3d31b90d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:26.873914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf5dad-4b13-45f7-8c8c-302e3d31b90d None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:26.875204 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 22:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:26.880008 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14841eaf-948e-414d-873a-e292d359df81 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:26.880416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14841eaf-948e-414d-873a-e292d359df81 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:26.880547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14841eaf-948e-414d-873a-e292d359df81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:26.953795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-14841eaf-948e-414d-873a-e292d359df81 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:26.954967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-14841eaf-948e-414d-873a-e292d359df81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:27.052978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 22:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:27.202146 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf5dad-4b13-45f7-8c8c-302e3d31b90d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:27.203613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f1bf5dad-4b13-45f7-8c8c-302e3d31b90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:27.251223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:27.345878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf5dad-4b13-45f7-8c8c-302e3d31b90d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:27.456969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e962c9f-3ade-422d-a169-dbc3ebdf1295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:27.457477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e962c9f-3ade-422d-a169-dbc3ebdf1295 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:27.457749 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e962c9f-3ade-422d-a169-dbc3ebdf1295 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:27.458014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e962c9f-3ade-422d-a169-dbc3ebdf1295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:27.459618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9e962c9f-3ade-422d-a169-dbc3ebdf1295 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:27.466374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:27.547619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e962c9f-3ade-422d-a169-dbc3ebdf1295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:27.549215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e962c9f-3ade-422d-a169-dbc3ebdf1295 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:27.567728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 727/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:28.383142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc59e2c-f4c5-4a3e-9bc4-0e81db5ca2f6 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:28.383702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc59e2c-f4c5-4a3e-9bc4-0e81db5ca2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:28.383702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc59e2c-f4c5-4a3e-9bc4-0e81db5ca2f6 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:28.385037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 22:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:28.389989 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2144-faff-46c5-8f4d-583bc5a0c06f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:28.390415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2144-faff-46c5-8f4d-583bc5a0c06f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:28.390513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2144-faff-46c5-8f4d-583bc5a0c06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:28.465079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-aa1b2144-faff-46c5-8f4d-583bc5a0c06f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:28.466780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-aa1b2144-faff-46c5-8f4d-583bc5a0c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:28.533268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:28.561614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 22:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:28.717710 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc59e2c-f4c5-4a3e-9bc4-0e81db5ca2f6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:28.719176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ddc59e2c-f4c5-4a3e-9bc4-0e81db5ca2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:28.737139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:28.862558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc59e2c-f4c5-4a3e-9bc4-0e81db5ca2f6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:28.947515 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:28.979341 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127ff63-7da9-47c3-96d6-833274ef060f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:28.979857 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127ff63-7da9-47c3-96d6-833274ef060f service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:28.980132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127ff63-7da9-47c3-96d6-833274ef060f service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:28.980399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127ff63-7da9-47c3-96d6-833274ef060f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:28.982011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7127ff63-7da9-47c3-96d6-833274ef060f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:29.070340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127ff63-7da9-47c3-96d6-833274ef060f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:29.071968 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127ff63-7da9-47c3-96d6-833274ef060f service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:29.090394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 706/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:29.885374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804791ed-c753-4782-afe1-28d9e07693af None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:29.885933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804791ed-c753-4782-afe1-28d9e07693af None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:29.885933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804791ed-c753-4782-afe1-28d9e07693af None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:29.887271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 22:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:29.892746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9a8bd-0082-4888-8822-296b882c5c22 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:29.893172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9a8bd-0082-4888-8822-296b882c5c22 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:29.893288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9a8bd-0082-4888-8822-296b882c5c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:29.967450 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9be9a8bd-0082-4888-8822-296b882c5c22 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:29.968744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9be9a8bd-0082-4888-8822-296b882c5c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:30.011134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:30.065081 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 22:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:30.217949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804791ed-c753-4782-afe1-28d9e07693af None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:30.219386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-804791ed-c753-4782-afe1-28d9e07693af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:30.358878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804791ed-c753-4782-afe1-28d9e07693af None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:30.411403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:30.470139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c1ddf-1747-4f2c-999e-51c82110db80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:30.470663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c1ddf-1747-4f2c-999e-51c82110db80 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:30.470957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c1ddf-1747-4f2c-999e-51c82110db80 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:30.471252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c1ddf-1747-4f2c-999e-51c82110db80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:30.472819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fa0c1ddf-1747-4f2c-999e-51c82110db80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:30.559150 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c1ddf-1747-4f2c-999e-51c82110db80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:30.561203 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c1ddf-1747-4f2c-999e-51c82110db80 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:30.579421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 730/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:31.376073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a096b0-ba79-48f8-ac9d-8b06ed398f18 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:31.376645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a096b0-ba79-48f8-ac9d-8b06ed398f18 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:31.376645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a096b0-ba79-48f8-ac9d-8b06ed398f18 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:31.377958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 22:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:31.383349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ada1d-1c3a-474e-ac1c-2813bb439c82 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:31.383787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ada1d-1c3a-474e-ac1c-2813bb439c82 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:31.383974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ada1d-1c3a-474e-ac1c-2813bb439c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:31.458078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2e5ada1d-1c3a-474e-ac1c-2813bb439c82 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:31.459289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2e5ada1d-1c3a-474e-ac1c-2813bb439c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:31.461227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:31.553287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 22:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:31.702646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a096b0-ba79-48f8-ac9d-8b06ed398f18 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:31.704129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-24a096b0-ba79-48f8-ac9d-8b06ed398f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:31.849457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a096b0-ba79-48f8-ac9d-8b06ed398f18 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:31.876293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:31.961219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262652b2-0438-4070-acc4-aa824990948c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:31.961746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262652b2-0438-4070-acc4-aa824990948c service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:31.962016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262652b2-0438-4070-acc4-aa824990948c service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:31.962281 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262652b2-0438-4070-acc4-aa824990948c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:31.963871 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-262652b2-0438-4070-acc4-aa824990948c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:32.051885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262652b2-0438-4070-acc4-aa824990948c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:32.053478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262652b2-0438-4070-acc4-aa824990948c service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:32.070769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 709/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:33.951461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c0d3d-8199-412a-8133-4c065f0d43a2 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:33.951977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c0d3d-8199-412a-8133-4c065f0d43a2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:33.951977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c0d3d-8199-412a-8133-4c065f0d43a2 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:33.953254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:33.958643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd62638-6f73-4f2d-8e38-b7102d5d9fb5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:33.959045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd62638-6f73-4f2d-8e38-b7102d5d9fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:33.959216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd62638-6f73-4f2d-8e38-b7102d5d9fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:34.000370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:34.025824 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cdd62638-6f73-4f2d-8e38-b7102d5d9fb5 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:34.027021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cdd62638-6f73-4f2d-8e38-b7102d5d9fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:34.124237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:34.163330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c0d3d-8199-412a-8133-4c065f0d43a2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:34.164868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-862c0d3d-8199-412a-8133-4c065f0d43a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:34.266574 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c0d3d-8199-412a-8133-4c065f0d43a2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:34.297016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:34.339209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25476e86-c8f0-468e-a66a-13e905139716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:34.339798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25476e86-c8f0-468e-a66a-13e905139716 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:34.340071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25476e86-c8f0-468e-a66a-13e905139716 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:34.340336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25476e86-c8f0-468e-a66a-13e905139716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:34.341929 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-25476e86-c8f0-468e-a66a-13e905139716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:34.448480 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25476e86-c8f0-468e-a66a-13e905139716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:34.449895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25476e86-c8f0-468e-a66a-13e905139716 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:34.467885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 733/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:36.674084 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd150490-c165-4b7f-912b-5ea38dc08996 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:36.674656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd150490-c165-4b7f-912b-5ea38dc08996 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:36.674656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd150490-c165-4b7f-912b-5ea38dc08996 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:36.675994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:36.681099 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405b5e5-761d-463e-8dd7-5993e2f8ae86 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:36.681486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405b5e5-761d-463e-8dd7-5993e2f8ae86 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:36.681635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405b5e5-761d-463e-8dd7-5993e2f8ae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:36.749689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2405b5e5-761d-463e-8dd7-5993e2f8ae86 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:36.750887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2405b5e5-761d-463e-8dd7-5993e2f8ae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:36.764213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:36.846401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:36.884200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd150490-c165-4b7f-912b-5ea38dc08996 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:36.885733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bd150490-c165-4b7f-912b-5ea38dc08996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:36.987853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd150490-c165-4b7f-912b-5ea38dc08996 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:37.000732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:37.066157 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2008a-14e0-4fce-877e-503670c0ed00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:37.066750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2008a-14e0-4fce-877e-503670c0ed00 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:37.067022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2008a-14e0-4fce-877e-503670c0ed00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:37.067322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2008a-14e0-4fce-877e-503670c0ed00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:37.068885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d9e2008a-14e0-4fce-877e-503670c0ed00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:37.175248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2008a-14e0-4fce-877e-503670c0ed00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:37.176668 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2008a-14e0-4fce-877e-503670c0ed00 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:37.194601 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 712/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:26:39.487645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22f8b4-741d-4009-b28e-aa23cd02c7bf None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:39.488170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22f8b4-741d-4009-b28e-aa23cd02c7bf None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:39.488170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22f8b4-741d-4009-b28e-aa23cd02c7bf None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:39.489527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:39.494760 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c429bea-4d69-459a-8fe8-f9166579caa9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:39.495220 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c429bea-4d69-459a-8fe8-f9166579caa9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:39.495391 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c429bea-4d69-459a-8fe8-f9166579caa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:39.542895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:39.561996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1c429bea-4d69-459a-8fe8-f9166579caa9 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:39.563243 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1c429bea-4d69-459a-8fe8-f9166579caa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:39.657573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:39.696283 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22f8b4-741d-4009-b28e-aa23cd02c7bf None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:39.697822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1f22f8b4-741d-4009-b28e-aa23cd02c7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:39.800729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22f8b4-741d-4009-b28e-aa23cd02c7bf None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:39.842105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:39.875144 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea18a7-5748-4af3-8557-3489d3be3134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:39.875739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea18a7-5748-4af3-8557-3489d3be3134 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:39.876008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea18a7-5748-4af3-8557-3489d3be3134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:39.876268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea18a7-5748-4af3-8557-3489d3be3134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:39.877831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d9ea18a7-5748-4af3-8557-3489d3be3134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:39.983655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea18a7-5748-4af3-8557-3489d3be3134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:39.985130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea18a7-5748-4af3-8557-3489d3be3134 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:40.003210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 736/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:42.140072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a16b7b-4d9b-4409-ad8d-8e6e89366bb9 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:42.140616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a16b7b-4d9b-4409-ad8d-8e6e89366bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:42.140616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a16b7b-4d9b-4409-ad8d-8e6e89366bb9 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:42.141978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:42.147210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048c62d-6d31-40bb-9bf6-48c19e92b4db None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:42.147599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048c62d-6d31-40bb-9bf6-48c19e92b4db None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:42.147756 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048c62d-6d31-40bb-9bf6-48c19e92b4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:42.213414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3048c62d-6d31-40bb-9bf6-48c19e92b4db None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:42.214611 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3048c62d-6d31-40bb-9bf6-48c19e92b4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:42.235077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:42.310988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:42.349669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a16b7b-4d9b-4409-ad8d-8e6e89366bb9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:42.351229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-93a16b7b-4d9b-4409-ad8d-8e6e89366bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:42.453976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a16b7b-4d9b-4409-ad8d-8e6e89366bb9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:42.473828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:42.526855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9d103-3890-4ceb-84b6-d0600f3a3990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:42.527411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d103-3890-4ceb-84b6-d0600f3a3990 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:42.527689 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d103-3890-4ceb-84b6-d0600f3a3990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:42.527958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d103-3890-4ceb-84b6-d0600f3a3990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:42.530048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c1c9d103-3890-4ceb-84b6-d0600f3a3990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:42.637004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9d103-3890-4ceb-84b6-d0600f3a3990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:42.638464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9d103-3890-4ceb-84b6-d0600f3a3990 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:42.668483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 715/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:44.708976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a610c-b74f-48b4-9da9-ad0d9642ab01 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:44.709549 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a610c-b74f-48b4-9da9-ad0d9642ab01 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:44.709549 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a610c-b74f-48b4-9da9-ad0d9642ab01 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:44.710829 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:44.716556 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7018600-fd91-49e2-8958-091e83bbfa72 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:44.716982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7018600-fd91-49e2-8958-091e83bbfa72 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:44.717124 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7018600-fd91-49e2-8958-091e83bbfa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:44.780785 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:44.783584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d7018600-fd91-49e2-8958-091e83bbfa72 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:44.785366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d7018600-fd91-49e2-8958-091e83bbfa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:44.880396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:26:44.918396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a610c-b74f-48b4-9da9-ad0d9642ab01 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:44.920666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-435a610c-b74f-48b4-9da9-ad0d9642ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:45.031659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a610c-b74f-48b4-9da9-ad0d9642ab01 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:45.079058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:45.103746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d8890-f18f-4801-a193-f689e32188d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:45.104339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d8890-f18f-4801-a193-f689e32188d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:45.104614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d8890-f18f-4801-a193-f689e32188d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:45.104878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d8890-f18f-4801-a193-f689e32188d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:45.106455 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d29d8890-f18f-4801-a193-f689e32188d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:45.212477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d8890-f18f-4801-a193-f689e32188d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:45.213926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d8890-f18f-4801-a193-f689e32188d3 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:45.232161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 739/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:47.265368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceb2dd-4277-4c73-864b-80a3f166800d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:47.265927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceb2dd-4277-4c73-864b-80a3f166800d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:47.265927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceb2dd-4277-4c73-864b-80a3f166800d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:47.267255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:47.272414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4df7c3-dbca-497c-abb2-38944a510151 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:47.272859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4df7c3-dbca-497c-abb2-38944a510151 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:47.272969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4df7c3-dbca-497c-abb2-38944a510151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:47.337313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-fb4df7c3-dbca-497c-abb2-38944a510151 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:47.338513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fb4df7c3-dbca-497c-abb2-38944a510151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:47.368829 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:47.434735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:47.473194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeceb2dd-4277-4c73-864b-80a3f166800d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:47.474708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-aeceb2dd-4277-4c73-864b-80a3f166800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:47.577571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeceb2dd-4277-4c73-864b-80a3f166800d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:47.606304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:47.651545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d0df5-c41b-4a10-8d92-118dd74942e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:47.652144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d0df5-c41b-4a10-8d92-118dd74942e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:47.652419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d0df5-c41b-4a10-8d92-118dd74942e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:47.652683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d0df5-c41b-4a10-8d92-118dd74942e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:47.654305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9f2d0df5-c41b-4a10-8d92-118dd74942e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:47.764550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d0df5-c41b-4a10-8d92-118dd74942e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:47.765984 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d0df5-c41b-4a10-8d92-118dd74942e7 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:47.783659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 718/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:49.823986 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ba49-9bd3-4b1e-b8bb-2279de1d0d87 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:49.824580 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ba49-9bd3-4b1e-b8bb-2279de1d0d87 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:49.824580 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ba49-9bd3-4b1e-b8bb-2279de1d0d87 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:49.826503 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:49.833063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0c796-f7be-46f2-b111-3dde21474f82 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:49.833517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0c796-f7be-46f2-b111-3dde21474f82 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:49.833616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0c796-f7be-46f2-b111-3dde21474f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:49.899099 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-32c0c796-f7be-46f2-b111-3dde21474f82 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:49.900308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-32c0c796-f7be-46f2-b111-3dde21474f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:49.908594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:50.002413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:50.040090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833ba49-9bd3-4b1e-b8bb-2279de1d0d87 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:50.041597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f833ba49-9bd3-4b1e-b8bb-2279de1d0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:50.143417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833ba49-9bd3-4b1e-b8bb-2279de1d0d87 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:50.196705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:50.215576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690e998-3d73-4bd8-a728-349b9ffc3725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:50.216171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e998-3d73-4bd8-a728-349b9ffc3725 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:50.216471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e998-3d73-4bd8-a728-349b9ffc3725 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:50.216740 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e998-3d73-4bd8-a728-349b9ffc3725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:50.218344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7690e998-3d73-4bd8-a728-349b9ffc3725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:50.325091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690e998-3d73-4bd8-a728-349b9ffc3725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:50.326499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690e998-3d73-4bd8-a728-349b9ffc3725 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:50.343926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 742/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:52.403417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384342fa-c619-49a3-a2ff-d5d508ab371c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:52.403951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384342fa-c619-49a3-a2ff-d5d508ab371c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:52.403951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384342fa-c619-49a3-a2ff-d5d508ab371c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:52.405286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:52.410384 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632603ca-3cc9-4eab-983a-94d95a91b5b8 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:52.410808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632603ca-3cc9-4eab-983a-94d95a91b5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:52.410921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632603ca-3cc9-4eab-983a-94d95a91b5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:52.475957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-632603ca-3cc9-4eab-983a-94d95a91b5b8 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:52.477182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-632603ca-3cc9-4eab-983a-94d95a91b5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:52.515922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:52.573517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:52.611213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384342fa-c619-49a3-a2ff-d5d508ab371c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:52.612754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-384342fa-c619-49a3-a2ff-d5d508ab371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:52.713983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384342fa-c619-49a3-a2ff-d5d508ab371c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:52.750833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:52.785095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834bb31-6a2a-449b-a59f-a5e232dbd8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:52.785681 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834bb31-6a2a-449b-a59f-a5e232dbd8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:52.785952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834bb31-6a2a-449b-a59f-a5e232dbd8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:52.786215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834bb31-6a2a-449b-a59f-a5e232dbd8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:52.787900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3834bb31-6a2a-449b-a59f-a5e232dbd8d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:52.894791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834bb31-6a2a-449b-a59f-a5e232dbd8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:52.896251 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834bb31-6a2a-449b-a59f-a5e232dbd8d0 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:53.036488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 721/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:55.039505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d0f55-3070-48bd-8c28-8e74e9704325 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:55.040057 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d0f55-3070-48bd-8c28-8e74e9704325 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:55.040057 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d0f55-3070-48bd-8c28-8e74e9704325 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:55.041381 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:26:55.047417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f11e2-dd28-41fe-9a5a-7a6258394d82 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:55.047842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f11e2-dd28-41fe-9a5a-7a6258394d82 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:55.047952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f11e2-dd28-41fe-9a5a-7a6258394d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:55.113122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d69f11e2-dd28-41fe-9a5a-7a6258394d82 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:55.114301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d69f11e2-dd28-41fe-9a5a-7a6258394d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:55.131945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:55.209380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:55.246688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d0f55-3070-48bd-8c28-8e74e9704325 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:55.248660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-018d0f55-3070-48bd-8c28-8e74e9704325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:55.350945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d0f55-3070-48bd-8c28-8e74e9704325 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:55.419873 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:55.427308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e8c30-b547-42d3-9286-211023e9aac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:55.427912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8c30-b547-42d3-9286-211023e9aac0 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:55.428189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8c30-b547-42d3-9286-211023e9aac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:55.428457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8c30-b547-42d3-9286-211023e9aac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:55.430054 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-566e8c30-b547-42d3-9286-211023e9aac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:55.537627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e8c30-b547-42d3-9286-211023e9aac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:55.539036 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e8c30-b547-42d3-9286-211023e9aac0 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:55.556683 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 745/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:26:57.560741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f40e7-5d6e-4a85-9e67-74ecf3b8f257 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:57.561327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f40e7-5d6e-4a85-9e67-74ecf3b8f257 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:57.561327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f40e7-5d6e-4a85-9e67-74ecf3b8f257 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:57.562620 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:26:57.567837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b777d-8722-4949-9da5-7f8a3db0d15a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:57.568265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b777d-8722-4949-9da5-7f8a3db0d15a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:57.568384 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b777d-8722-4949-9da5-7f8a3db0d15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:57.637198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-694b777d-8722-4949-9da5-7f8a3db0d15a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:26:57.638441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-694b777d-8722-4949-9da5-7f8a3db0d15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:57.686093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:57.739155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:26:57.774595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f40e7-5d6e-4a85-9e67-74ecf3b8f257 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:26:57.776155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-688f40e7-5d6e-4a85-9e67-74ecf3b8f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:57.881507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f40e7-5d6e-4a85-9e67-74ecf3b8f257 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:26:57.928571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:26:57.954752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabc3dd-3c7a-4413-a9d9-332f702c4099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:26:57.955508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabc3dd-3c7a-4413-a9d9-332f702c4099 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:26:57.955779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabc3dd-3c7a-4413-a9d9-332f702c4099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:26:57.956043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabc3dd-3c7a-4413-a9d9-332f702c4099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:26:57.958006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9eabc3dd-3c7a-4413-a9d9-332f702c4099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:26:58.073624 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabc3dd-3c7a-4413-a9d9-332f702c4099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:26:58.075646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabc3dd-3c7a-4413-a9d9-332f702c4099 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:26:58.094595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 724/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:27:07.734169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=22 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:08.092313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=66 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:17.533157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a6a12-c7d3-42fb-a582-4ed35a366ccb None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:17.533735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a6a12-c7d3-42fb-a582-4ed35a366ccb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:17.533735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a6a12-c7d3-42fb-a582-4ed35a366ccb None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:17.535111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 747/1471] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:27:17.540299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2b386-11be-46e1-a2a3-e03bb8e1a83e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:17.540696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2b386-11be-46e1-a2a3-e03bb8e1a83e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:17.540840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2b386-11be-46e1-a2a3-e03bb8e1a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:17.606328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6fd2b386-11be-46e1-a2a3-e03bb8e1a83e None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:27:17.607535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6fd2b386-11be-46e1-a2a3-e03bb8e1a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:17.700755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 725/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:27:17.784358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394056db-c916-4a42-a25a-ba0ec3561d0f None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:17.784583 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394056db-c916-4a42-a25a-ba0ec3561d0f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:17.784856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394056db-c916-4a42-a25a-ba0ec3561d0f None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:17.786195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 748/1473] 10.222.0.15 () {54 vars in 966 bytes} [Sun Aug 7 22:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:27:17.790810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af8c58-03c4-4cf9-9e1c-57067f3b83f2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:17.791120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af8c58-03c4-4cf9-9e1c-57067f3b83f2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:17.791408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af8c58-03c4-4cf9-9e1c-57067f3b83f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:17.865041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-24af8c58-03c4-4cf9-9e1c-57067f3b83f2 None None] MFA Rules not processed for user `c6639f15880c4c718f41cd84cb79c750`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:27:17.866225 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-24af8c58-03c4-4cf9-9e1c-57067f3b83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:17.886359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:17.942987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 726/1474] 10.222.0.15 () {58 vars in 1063 bytes} [Sun Aug 7 22:27:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:27:17.951941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394056db-c916-4a42-a25a-ba0ec3561d0f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:27:17.953444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-394056db-c916-4a42-a25a-ba0ec3561d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:18.059741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394056db-c916-4a42-a25a-ba0ec3561d0f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:27:18.133282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3f872-9902-4f96-bf2e-5a51a88e30be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6639f15880c4c718f41cd84cb79c750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:27:18.133877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3f872-9902-4f96-bf2e-5a51a88e30be service glance] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:18.134151 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3f872-9902-4f96-bf2e-5a51a88e30be service glance] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:18.134414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3f872-9902-4f96-bf2e-5a51a88e30be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:18.136052 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8db3f872-9902-4f96-bf2e-5a51a88e30be service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:18.189931 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:18.251355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3f872-9902-4f96-bf2e-5a51a88e30be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:27:18.252778 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3f872-9902-4f96-bf2e-5a51a88e30be service glance] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:27:18.271105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 749/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:27:20.347945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ed55c-04cf-43a2-bc90-d127e6113e33 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:20.348504 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ed55c-04cf-43a2-bc90-d127e6113e33 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:20.348504 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ed55c-04cf-43a2-bc90-d127e6113e33 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:20.349868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 727/1476] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:27:20.355624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b4669-b382-4803-b911-0437d1cc8d8b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:20.356036 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b4669-b382-4803-b911-0437d1cc8d8b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:20.356173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b4669-b382-4803-b911-0437d1cc8d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:20.421298 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-9d3b4669-b382-4803-b911-0437d1cc8d8b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:27:20.422503 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9d3b4669-b382-4803-b911-0437d1cc8d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:20.517366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 750/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:27:20.540020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ed55c-04cf-43a2-bc90-d127e6113e33 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:27:20.541551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-939ed55c-04cf-43a2-bc90-d127e6113e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:20.665010 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ed55c-04cf-43a2-bc90-d127e6113e33 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:27:20.713303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:20.758738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224fde1-84cc-4272-9fcc-4e6b9982b25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:27:20.759362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224fde1-84cc-4272-9fcc-4e6b9982b25f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:20.759634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224fde1-84cc-4272-9fcc-4e6b9982b25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:20.759898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224fde1-84cc-4272-9fcc-4e6b9982b25f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:20.760527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224fde1-84cc-4272-9fcc-4e6b9982b25f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:27:20.762222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-9224fde1-84cc-4272-9fcc-4e6b9982b25f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:27:20.762222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 07 22:27:20.762222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: Aug 07 22:27:20.763362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224fde1-84cc-4272-9fcc-4e6b9982b25f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:27:20.781971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 728/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 22:27:20 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:27:22.777456 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11cec-cce8-443f-8da7-6846cecff904 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:22.778035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11cec-cce8-443f-8da7-6846cecff904 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:22.778035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11cec-cce8-443f-8da7-6846cecff904 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:22.779363 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 751/1479] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:27:22.784548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddc0b5-00ed-49b6-a886-46939af454f8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:22.784991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddc0b5-00ed-49b6-a886-46939af454f8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:22.785112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddc0b5-00ed-49b6-a886-46939af454f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:22.849290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d8ddc0b5-00ed-49b6-a886-46939af454f8 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:27:22.850503 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d8ddc0b5-00ed-49b6-a886-46939af454f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:22.944157 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 729/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:27:22.986412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb11cec-cce8-443f-8da7-6846cecff904 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:27:22.988972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8eb11cec-cce8-443f-8da7-6846cecff904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:22.998358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:23.132957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb11cec-cce8-443f-8da7-6846cecff904 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:27:23.211663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:23.244061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1194a-9b23-440e-b198-c0cda31b0335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:27:23.244657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1194a-9b23-440e-b198-c0cda31b0335 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:23.244934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1194a-9b23-440e-b198-c0cda31b0335 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:23.245202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1194a-9b23-440e-b198-c0cda31b0335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:23.246834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a3d1194a-9b23-440e-b198-c0cda31b0335 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:23.334058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1194a-9b23-440e-b198-c0cda31b0335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:27:23.335654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1194a-9b23-440e-b198-c0cda31b0335 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:27:23.353564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 752/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:27:25.519966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201116-5bc7-4b17-bc68-423fb9579b04 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:25.520539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201116-5bc7-4b17-bc68-423fb9579b04 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:25.520539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201116-5bc7-4b17-bc68-423fb9579b04 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:25.521923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 730/1482] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:27:25.527884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e611025-e6ea-482a-9840-e60c11cc7c64 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:25.528335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e611025-e6ea-482a-9840-e60c11cc7c64 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:25.528441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e611025-e6ea-482a-9840-e60c11cc7c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:25.592246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7e611025-e6ea-482a-9840-e60c11cc7c64 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:27:25.593466 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7e611025-e6ea-482a-9840-e60c11cc7c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:25.638670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:25.688132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 753/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:27:25.724878 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201116-5bc7-4b17-bc68-423fb9579b04 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:27:25.726378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-95201116-5bc7-4b17-bc68-423fb9579b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:25.749139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:25.829414 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201116-5bc7-4b17-bc68-423fb9579b04 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:27:25.901133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c2123-20ee-40b2-ae0f-3e09bdeae646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:27:25.901766 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c2123-20ee-40b2-ae0f-3e09bdeae646 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:25.902042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c2123-20ee-40b2-ae0f-3e09bdeae646 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:25.902312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c2123-20ee-40b2-ae0f-3e09bdeae646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:25.903933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d59c2123-20ee-40b2-ae0f-3e09bdeae646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:25.978965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:26.020492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c2123-20ee-40b2-ae0f-3e09bdeae646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:27:26.021919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c2123-20ee-40b2-ae0f-3e09bdeae646 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:27:26.040045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 731/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:27:28.071997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa825-fa39-4faf-9b09-3b8880660227 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:28.072564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa825-fa39-4faf-9b09-3b8880660227 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:28.072564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa825-fa39-4faf-9b09-3b8880660227 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:28.073925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 754/1485] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:27:28.079137 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e110f-1486-484a-9272-da3dac5a6e67 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:28.079585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e110f-1486-484a-9272-da3dac5a6e67 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:28.079695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e110f-1486-484a-9272-da3dac5a6e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:28.143854 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-656e110f-1486-484a-9272-da3dac5a6e67 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:27:28.145040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-656e110f-1486-484a-9272-da3dac5a6e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:28.239139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 732/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:27:28.277487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa825-fa39-4faf-9b09-3b8880660227 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:27:28.279024 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-935aa825-fa39-4faf-9b09-3b8880660227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:28.381508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa825-fa39-4faf-9b09-3b8880660227 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:27:28.451727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:28.453922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5559105-f766-45ae-8951-cbdd70922fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:27:28.455001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5559105-f766-45ae-8951-cbdd70922fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:28.455484 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5559105-f766-45ae-8951-cbdd70922fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:28.455933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5559105-f766-45ae-8951-cbdd70922fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:28.457560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d5559105-f766-45ae-8951-cbdd70922fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:28.565200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5559105-f766-45ae-8951-cbdd70922fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:27:28.566620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5559105-f766-45ae-8951-cbdd70922fc4 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:27:28.584275 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 755/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:27:30.705163 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251cc72-357f-4440-a401-65092c6dd682 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:30.705748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251cc72-357f-4440-a401-65092c6dd682 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:30.705748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251cc72-357f-4440-a401-65092c6dd682 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:30.707077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 733/1488] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:27:30.712233 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8ca4c-21e2-4e42-86d2-722762fcf92f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:30.712626 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8ca4c-21e2-4e42-86d2-722762fcf92f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:30.712762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8ca4c-21e2-4e42-86d2-722762fcf92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:30.777479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7aa8ca4c-21e2-4e42-86d2-722762fcf92f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:27:30.778675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7aa8ca4c-21e2-4e42-86d2-722762fcf92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:30.830205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:30.875866 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 756/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:27:30.918245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251cc72-357f-4440-a401-65092c6dd682 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:27:30.920012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c251cc72-357f-4440-a401-65092c6dd682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:30.959735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:31.029138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251cc72-357f-4440-a401-65092c6dd682 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:27:31.100472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39a59e-2e2e-448a-bde2-c6a2d1d6cc2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:27:31.101074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39a59e-2e2e-448a-bde2-c6a2d1d6cc2b service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:31.101343 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39a59e-2e2e-448a-bde2-c6a2d1d6cc2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:31.101605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39a59e-2e2e-448a-bde2-c6a2d1d6cc2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:31.103232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cc39a59e-2e2e-448a-bde2-c6a2d1d6cc2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:31.181268 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:31.213005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39a59e-2e2e-448a-bde2-c6a2d1d6cc2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:27:31.214890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39a59e-2e2e-448a-bde2-c6a2d1d6cc2b service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:27:31.235753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 734/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:27:33.461017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2904da3-ddda-426e-be25-aacc6d9888c4 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:33.461575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2904da3-ddda-426e-be25-aacc6d9888c4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:33.461575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2904da3-ddda-426e-be25-aacc6d9888c4 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:33.462915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 757/1491] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 22:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:27:33.468642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05574-af5c-4cd0-8e61-6454934c3ccf None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:33.469043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05574-af5c-4cd0-8e61-6454934c3ccf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:33.469178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05574-af5c-4cd0-8e61-6454934c3ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:33.534085 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0ec05574-af5c-4cd0-8e61-6454934c3ccf None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:27:33.535319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0ec05574-af5c-4cd0-8e61-6454934c3ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:33.633645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 735/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 22:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:27:33.673767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2904da3-ddda-426e-be25-aacc6d9888c4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:27:33.675319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d2904da3-ddda-426e-be25-aacc6d9888c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:33.787479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2904da3-ddda-426e-be25-aacc6d9888c4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:27:33.859065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a3551-3efb-4459-80d4-0e6dc833a8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:27:33.859698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a3551-3efb-4459-80d4-0e6dc833a8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:27:33.860082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a3551-3efb-4459-80d4-0e6dc833a8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:27:33.860550 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a3551-3efb-4459-80d4-0e6dc833a8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:27:33.862660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b11a3551-3efb-4459-80d4-0e6dc833a8e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:27:33.871970 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:33.971001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a3551-3efb-4459-80d4-0e6dc833a8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:27:33.972391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a3551-3efb-4459-80d4-0e6dc833a8e6 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:27:33.991698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 758/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:27:43.631740 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=82 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:27:43.988045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=50 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:29:13.226521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d9e11-48ad-4f45-b7ad-53242f9b65f1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:13.227142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d9e11-48ad-4f45-b7ad-53242f9b65f1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:13.227142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d9e11-48ad-4f45-b7ad-53242f9b65f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:13.300468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a19d9e11-48ad-4f45-b7ad-53242f9b65f1 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:29:13.301648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a19d9e11-48ad-4f45-b7ad-53242f9b65f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:13.395049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 736/1494] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:29:13.403149 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449cb34-1370-4033-9b49-03b95113a89b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:13.403655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449cb34-1370-4033-9b49-03b95113a89b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:13.403777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449cb34-1370-4033-9b49-03b95113a89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:13.484070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4449cb34-1370-4033-9b49-03b95113a89b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:29:13.485278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4449cb34-1370-4033-9b49-03b95113a89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:13.578785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 759/1495] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:29:13.583447 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d9e11-48ad-4f45-b7ad-53242f9b65f1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:29:13.584632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a19d9e11-48ad-4f45-b7ad-53242f9b65f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:13.596343 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d9e11-48ad-4f45-b7ad-53242f9b65f1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:29:13.655884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:29:13.689546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4226ab-78df-4f1b-a711-5aaa059a718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:29:13.690198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4226ab-78df-4f1b-a711-5aaa059a718e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:13.690489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4226ab-78df-4f1b-a711-5aaa059a718e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:13.690907 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4226ab-78df-4f1b-a711-5aaa059a718e admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:13.691693 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4226ab-78df-4f1b-a711-5aaa059a718e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:29:13.692108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4226ab-78df-4f1b-a711-5aaa059a718e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:29:13.693714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-bd4226ab-78df-4f1b-a711-5aaa059a718e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:29:13.693714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 07 22:29:13.693714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: Aug 07 22:29:13.694811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4226ab-78df-4f1b-a711-5aaa059a718e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:29:13.706971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 737/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:29:13.715948 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449cb34-1370-4033-9b49-03b95113a89b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:29:13.725220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449cb34-1370-4033-9b49-03b95113a89b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:29:13.785510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:29:13.818836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff24f9-efe7-41c4-9ef8-4811fabe676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:29:13.819394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff24f9-efe7-41c4-9ef8-4811fabe676c admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:13.819665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff24f9-efe7-41c4-9ef8-4811fabe676c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:13.819925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff24f9-efe7-41c4-9ef8-4811fabe676c admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:13.820524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff24f9-efe7-41c4-9ef8-4811fabe676c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:29:13.822248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-ceff24f9-efe7-41c4-9ef8-4811fabe676c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:29:13.822248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 07 22:29:13.822248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: Aug 07 22:29:13.823954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff24f9-efe7-41c4-9ef8-4811fabe676c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:29:13.877270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 760/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:29:13 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:29:13.881802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4226ab-78df-4f1b-a711-5aaa059a718e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:29:13.883335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bd4226ab-78df-4f1b-a711-5aaa059a718e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:13.918282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4226ab-78df-4f1b-a711-5aaa059a718e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:29:14.009943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731530ae-b683-4ae8-82d7-69ddae20c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:29:14.011050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731530ae-b683-4ae8-82d7-69ddae20c4eb admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:14.011347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731530ae-b683-4ae8-82d7-69ddae20c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:14.011608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731530ae-b683-4ae8-82d7-69ddae20c4eb admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:14.012224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731530ae-b683-4ae8-82d7-69ddae20c4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:29:14.013217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-731530ae-b683-4ae8-82d7-69ddae20c4eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:29:14.013217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 07 22:29:14.013217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: Aug 07 22:29:14.014395 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731530ae-b683-4ae8-82d7-69ddae20c4eb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:29:14.054642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 738/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:29:13 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:29:14.058787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff24f9-efe7-41c4-9ef8-4811fabe676c admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:29:14.060310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ceff24f9-efe7-41c4-9ef8-4811fabe676c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:14.121816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff24f9-efe7-41c4-9ef8-4811fabe676c admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:29:14.204457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:29:14.215805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69a59-6ba0-4d11-b686-b8904c3c0e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:29:14.216406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69a59-6ba0-4d11-b686-b8904c3c0e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:14.216680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69a59-6ba0-4d11-b686-b8904c3c0e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:14.216948 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69a59-6ba0-4d11-b686-b8904c3c0e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:14.217577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd69a59-6ba0-4d11-b686-b8904c3c0e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:29:14.218570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-bfd69a59-6ba0-4d11-b686-b8904c3c0e1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:29:14.218570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 07 22:29:14.218570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: Aug 07 22:29:14.219487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd69a59-6ba0-4d11-b686-b8904c3c0e1a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:29:14.231712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 761/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:29:14.235867 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731530ae-b683-4ae8-82d7-69ddae20c4eb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:29:14.237372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-731530ae-b683-4ae8-82d7-69ddae20c4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:14.249175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731530ae-b683-4ae8-82d7-69ddae20c4eb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:29:14.274319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:29:14.345263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d7699-08de-4ea6-90f4-b6a910040f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:29:14.345804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7699-08de-4ea6-90f4-b6a910040f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:14.346080 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7699-08de-4ea6-90f4-b6a910040f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:14.346349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7699-08de-4ea6-90f4-b6a910040f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:14.346984 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d7699-08de-4ea6-90f4-b6a910040f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:29:14.348025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-8f1d7699-08de-4ea6-90f4-b6a910040f17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:29:14.348025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 07 22:29:14.348025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: Aug 07 22:29:14.348899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d7699-08de-4ea6-90f4-b6a910040f17 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:29:14.361544 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 739/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:29:14.365807 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69a59-6ba0-4d11-b686-b8904c3c0e1a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:29:14.367345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-bfd69a59-6ba0-4d11-b686-b8904c3c0e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:14.404200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69a59-6ba0-4d11-b686-b8904c3c0e1a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:29:14.495579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134230f-e134-4a2b-a24b-81f489fd0132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:29:14.496226 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134230f-e134-4a2b-a24b-81f489fd0132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:14.496499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134230f-e134-4a2b-a24b-81f489fd0132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:14.496765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134230f-e134-4a2b-a24b-81f489fd0132 admin admin] PATH_INFO: `/v3/projects/4ed9423855a04c399b40b8f33511290f/users/c3142c45b22c4fbbbedf32f980fa24f4/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:14.518069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134230f-e134-4a2b-a24b-81f489fd0132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed9423855a04c399b40b8f33511290f, user_id=c3142c45b22c4fbbbedf32f980fa24f4, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:29:14.519098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-8134230f-e134-4a2b-a24b-81f489fd0132 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:29:14.519098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 07 22:29:14.519098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: Aug 07 22:29:14.521017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134230f-e134-4a2b-a24b-81f489fd0132 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:29:14.546305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 762/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:29:14 2022] PUT /identity/v3/projects/4ed9423855a04c399b40b8f33511290f/users/c3142c45b22c4fbbbedf32f980fa24f4/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:29:14.558653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2645d7-9bab-4e49-b0cf-3dee8c7b0cd1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:14.558941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2645d7-9bab-4e49-b0cf-3dee8c7b0cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:14.559254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2645d7-9bab-4e49-b0cf-3dee8c7b0cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:14.615215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ea2645d7-9bab-4e49-b0cf-3dee8c7b0cd1 None None] MFA Rules not processed for user `c3142c45b22c4fbbbedf32f980fa24f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:29:14.616331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ea2645d7-9bab-4e49-b0cf-3dee8c7b0cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:14.691190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 740/1502] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:29:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:29:14.704841 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946adfb6-9659-4c78-9219-133966df73a2 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:14.705120 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946adfb6-9659-4c78-9219-133966df73a2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:14.705385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946adfb6-9659-4c78-9219-133966df73a2 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:14.706699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 763/1503] 10.222.0.15 () {54 vars in 964 bytes} [Sun Aug 7 22:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:29:14.711279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e07dc-dae6-496a-b1c9-034c7b54e7ea None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:14.711564 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e07dc-dae6-496a-b1c9-034c7b54e7ea None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:14.711832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e07dc-dae6-496a-b1c9-034c7b54e7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:14.742270 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:29:14.788549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-297e07dc-dae6-496a-b1c9-034c7b54e7ea None None] MFA Rules not processed for user `1cfe1875cce3436eac2ac8f4d6db88bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:29:14.789739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-297e07dc-dae6-496a-b1c9-034c7b54e7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:14.863272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 741/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Sun Aug 7 22:29:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:29:14.871366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946adfb6-9659-4c78-9219-133966df73a2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:29:14.872785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-946adfb6-9659-4c78-9219-133966df73a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:14.921888 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:29:14.975380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946adfb6-9659-4c78-9219-133966df73a2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:29:15.047909 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ed0c1-f57e-4191-b32c-84e28fe85477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:29:15.048526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ed0c1-f57e-4191-b32c-84e28fe85477 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:15.049016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ed0c1-f57e-4191-b32c-84e28fe85477 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:15.049511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ed0c1-f57e-4191-b32c-84e28fe85477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:15.052702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3a1ed0c1-f57e-4191-b32c-84e28fe85477 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:15.150884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ed0c1-f57e-4191-b32c-84e28fe85477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:29:15.152254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ed0c1-f57e-4191-b32c-84e28fe85477 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:29:15.155795 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:29:15.170546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 764/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:29:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:29:15.216532 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0fb09-fee6-4b52-8a9a-fa80f2f3c6f3 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:15.216819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0fb09-fee6-4b52-8a9a-fa80f2f3c6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:15.217091 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0fb09-fee6-4b52-8a9a-fa80f2f3c6f3 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:15.218339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 742/1506] 10.222.0.15 () {52 vars in 830 bytes} [Sun Aug 7 22:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:29:15.221968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ed0c1-f57e-4191-b32c-84e28fe85477 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:29:15.223202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3a1ed0c1-f57e-4191-b32c-84e28fe85477 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:15.320212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ed0c1-f57e-4191-b32c-84e28fe85477 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:29:15.410920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:29:15.411601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:15.411861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:15.412122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] PATH_INFO: `/v3/users/c3142c45b22c4fbbbedf32f980fa24f4` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:15.424266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3142c45b22c4fbbbedf32f980fa24f4)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:29:15.425267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:29:15.425267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 07 22:29:15.425267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: Aug 07 22:29:15.426448 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:29:15.436391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:29:15.488553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3142c45b22c4fbbbedf32f980fa24f4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:29:15.503290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3142c45b22c4fbbbedf32f980fa24f4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:29:15.511754 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3142c45b22c4fbbbedf32f980fa24f4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:29:15.512108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3142c45b22c4fbbbedf32f980fa24f4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:29:15.533810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3142c45b22c4fbbbedf32f980fa24f4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:29:15.539265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 765/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:29:15 2022] DELETE /identity/v3/users/c3142c45b22c4fbbbedf32f980fa24f4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:29:15.544163 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a2aa-cf6b-4c7e-8f40-c7a496de9227 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:15.544636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a2aa-cf6b-4c7e-8f40-c7a496de9227 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:15.544744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a2aa-cf6b-4c7e-8f40-c7a496de9227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:15.599668 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8b32a2aa-cf6b-4c7e-8f40-c7a496de9227 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:29:15.600854 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8b32a2aa-cf6b-4c7e-8f40-c7a496de9227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:15.674573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:29:15.688024 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 743/1508] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:29:15.698749 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:29:15.699976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:15.799496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880106a-36ae-4680-abc0-9b81ec54d5fb admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:29:15.852072 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:29:15.872496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04220b-784c-4509-89b8-18fb4b622e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:29:15.873094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04220b-784c-4509-89b8-18fb4b622e76 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:15.873369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04220b-784c-4509-89b8-18fb4b622e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:15.873635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04220b-784c-4509-89b8-18fb4b622e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:15.875252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fe04220b-784c-4509-89b8-18fb4b622e76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:15.982015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04220b-784c-4509-89b8-18fb4b622e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:29:15.983450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04220b-784c-4509-89b8-18fb4b622e76 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:29:16.003593 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 766/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:29:16.336416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32a2aa-cf6b-4c7e-8f40-c7a496de9227 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:29:16.337628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8b32a2aa-cf6b-4c7e-8f40-c7a496de9227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:29:16.349680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32a2aa-cf6b-4c7e-8f40-c7a496de9227 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:29:16.461879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:29:16.462529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:29:16.462801 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:29:16.463106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] PATH_INFO: `/v3/projects/4ed9423855a04c399b40b8f33511290f` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:29:16.472982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed9423855a04c399b40b8f33511290f)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:29:16.473993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:29:16.473993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 07 22:29:16.473993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: Aug 07 22:29:16.475188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:29:16.531366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed9423855a04c399b40b8f33511290f', 'request_id': 'req-b77ea888-a292-4ddd-80a8-0219980789bf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:29:16.537191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed9423855a04c399b40b8f33511290f', 'request_id': 'req-b77ea888-a292-4ddd-80a8-0219980789bf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:29:16.549902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed9423855a04c399b40b8f33511290f', 'request_id': 'req-b77ea888-a292-4ddd-80a8-0219980789bf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:29:16.576969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] The token cache is being invalidate because project 4ed9423855a04c399b40b8f33511290f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:29:16.577247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:29:16.577665 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b77ea888-a292-4ddd-80a8-0219980789bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:29:16.579017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 744/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:29:16 2022] DELETE /identity/v3/projects/4ed9423855a04c399b40b8f33511290f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:29:26.001325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=62 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:29:26.574969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:30:45.980254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7548b5f-6cfe-4f9d-94a0-ceca1c0687cc None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:45.980858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7548b5f-6cfe-4f9d-94a0-ceca1c0687cc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:45.980858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7548b5f-6cfe-4f9d-94a0-ceca1c0687cc None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:45.982321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 22:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:30:45.988739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90e956-842d-4d8f-bc73-c06e96058d72 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:45.988739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90e956-842d-4d8f-bc73-c06e96058d72 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:45.988739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90e956-842d-4d8f-bc73-c06e96058d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:46.070752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bd90e956-842d-4d8f-bc73-c06e96058d72 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:30:46.072840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bd90e956-842d-4d8f-bc73-c06e96058d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:30:46.180273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 22:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:30:46.338500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7548b5f-6cfe-4f9d-94a0-ceca1c0687cc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:30:46.340684 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f7548b5f-6cfe-4f9d-94a0-ceca1c0687cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:30:46.469734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7548b5f-6cfe-4f9d-94a0-ceca1c0687cc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:30:46.475122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5609e4-21e6-46bd-9d2f-d381c3852022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:30:46.475711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5609e4-21e6-46bd-9d2f-d381c3852022 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:46.475987 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5609e4-21e6-46bd-9d2f-d381c3852022 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:46.476252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5609e4-21e6-46bd-9d2f-d381c3852022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:46.484161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5609e4-21e6-46bd-9d2f-d381c3852022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:30:46.485719 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5609e4-21e6-46bd-9d2f-d381c3852022 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:30:46.495649 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 768/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:30:47.339760 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae30d3-4917-4fcf-bf35-69340331981e None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:47.340328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae30d3-4917-4fcf-bf35-69340331981e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:47.340328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae30d3-4917-4fcf-bf35-69340331981e None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:47.341651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 746/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 22:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:30:47.346386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d46cf8-3a6c-4bc5-a178-995f84631734 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:47.346809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d46cf8-3a6c-4bc5-a178-995f84631734 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:47.346916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d46cf8-3a6c-4bc5-a178-995f84631734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:47.366607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-48d46cf8-3a6c-4bc5-a178-995f84631734 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:30:47.367819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-48d46cf8-3a6c-4bc5-a178-995f84631734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:30:47.375514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 769/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 22:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:30:47.492357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea110b77-e05f-46fa-9807-cb3e84a262be None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:47.492639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea110b77-e05f-46fa-9807-cb3e84a262be None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:47.492915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea110b77-e05f-46fa-9807-cb3e84a262be None None] PATH_INFO: `/v3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:47.494263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 747/1516] 10.222.0.36 () {54 vars in 925 bytes} [Sun Aug 7 22:30:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:30:47.522569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ebcb6-4d21-463b-8a94-5fcb27a14e43 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:47.522854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ebcb6-4d21-463b-8a94-5fcb27a14e43 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:47.523183 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ebcb6-4d21-463b-8a94-5fcb27a14e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:47.529931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea110b77-e05f-46fa-9807-cb3e84a262be None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:30:47.547184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea110b77-e05f-46fa-9807-cb3e84a262be None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:30:47.552625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc283f53-a0ad-4ce4-8972-5fa3ea32c3ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:30:47.553217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc283f53-a0ad-4ce4-8972-5fa3ea32c3ba service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:47.553497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc283f53-a0ad-4ce4-8972-5fa3ea32c3ba service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:47.553768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc283f53-a0ad-4ce4-8972-5fa3ea32c3ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:47.562638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc283f53-a0ad-4ce4-8972-5fa3ea32c3ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:30:47.564276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc283f53-a0ad-4ce4-8972-5fa3ea32c3ba service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:30:47.574449 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 748/1517] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:30:47.584348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1e5ebcb6-4d21-463b-8a94-5fcb27a14e43 None None] MFA Rules not processed for user `90db0874a2f443768a9d9842beb2523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:30:47.585533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1e5ebcb6-4d21-463b-8a94-5fcb27a14e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:30:47.643187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:30:47.667869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 770/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Sun Aug 7 22:30:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:30:56.846948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6902c4-3047-4e0a-aa99-936911a72a15 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:56.847507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6902c4-3047-4e0a-aa99-936911a72a15 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:56.847507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6902c4-3047-4e0a-aa99-936911a72a15 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:56.848786 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 749/1519] 10.222.0.15 () {54 vars in 961 bytes} [Sun Aug 7 22:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:30:56.853639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb01bf-3824-424e-998a-cc26027cddc3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:56.854033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb01bf-3824-424e-998a-cc26027cddc3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:56.854195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb01bf-3824-424e-998a-cc26027cddc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:56.873669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c7fb01bf-3824-424e-998a-cc26027cddc3 None None] MFA Rules not processed for user `90db0874a2f443768a9d9842beb2523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:30:56.874867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c7fb01bf-3824-424e-998a-cc26027cddc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:30:56.883648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 771/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Sun Aug 7 22:30:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:30:56.890806 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6902c4-3047-4e0a-aa99-936911a72a15 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:30:56.904286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6902c4-3047-4e0a-aa99-936911a72a15 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:30:56.909275 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9e1d0-c012-4244-9c0e-e69b35963cac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db0874a2f443768a9d9842beb2523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:30:56.909858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9e1d0-c012-4244-9c0e-e69b35963cac service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:56.910133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9e1d0-c012-4244-9c0e-e69b35963cac service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:56.910403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9e1d0-c012-4244-9c0e-e69b35963cac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:56.919132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9e1d0-c012-4244-9c0e-e69b35963cac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:30:56.920684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9e1d0-c012-4244-9c0e-e69b35963cac service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:30:56.930713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 750/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:30:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:30:58.806408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35e116-721a-4b76-9b96-3363449c35a3 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:58.807021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35e116-721a-4b76-9b96-3363449c35a3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:58.807021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35e116-721a-4b76-9b96-3363449c35a3 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:58.808374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 22:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:30:58.813070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4ebe3-6742-4b71-a0d6-d17ee8270d62 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:58.813498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4ebe3-6742-4b71-a0d6-d17ee8270d62 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:58.813615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4ebe3-6742-4b71-a0d6-d17ee8270d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:58.832838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3cc4ebe3-6742-4b71-a0d6-d17ee8270d62 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:30:58.834016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3cc4ebe3-6742-4b71-a0d6-d17ee8270d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:30:58.842482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 22:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:30:58.994916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35e116-721a-4b76-9b96-3363449c35a3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:30:59.009914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35e116-721a-4b76-9b96-3363449c35a3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:30:59.015946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6247a5-c8d2-4cf5-8605-26a209127644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:30:59.016534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6247a5-c8d2-4cf5-8605-26a209127644 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:59.016808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6247a5-c8d2-4cf5-8605-26a209127644 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:59.017077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6247a5-c8d2-4cf5-8605-26a209127644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:59.024968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6247a5-c8d2-4cf5-8605-26a209127644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:30:59.026527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6247a5-c8d2-4cf5-8605-26a209127644 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:30:59.036433 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 773/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:30:59.855177 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c8296-9093-4364-b6b4-2d5595ee4d35 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:59.856295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c8296-9093-4364-b6b4-2d5595ee4d35 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:59.856295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c8296-9093-4364-b6b4-2d5595ee4d35 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:59.857666 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 22:30:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:30:59.862280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab808b2-20c7-43a6-954f-dba76f59dd1d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:30:59.862695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab808b2-20c7-43a6-954f-dba76f59dd1d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:30:59.862823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab808b2-20c7-43a6-954f-dba76f59dd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:30:59.881767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2ab808b2-20c7-43a6-954f-dba76f59dd1d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:30:59.883235 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2ab808b2-20c7-43a6-954f-dba76f59dd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:30:59.890938 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 22:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:31:00.046271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c8296-9093-4364-b6b4-2d5595ee4d35 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:31:00.061239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c8296-9093-4364-b6b4-2d5595ee4d35 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:31:00.066941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaaeec-8e7a-41e1-9871-81ea4570f63a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:31:00.067558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaaeec-8e7a-41e1-9871-81ea4570f63a service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:00.067827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaaeec-8e7a-41e1-9871-81ea4570f63a service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:00.068092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaaeec-8e7a-41e1-9871-81ea4570f63a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:00.076232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaaeec-8e7a-41e1-9871-81ea4570f63a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:31:00.077803 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaaeec-8e7a-41e1-9871-81ea4570f63a service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:31:00.086949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 753/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:31:03.956509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acea10-29ef-4bea-b425-a89e690da9e6 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:03.957043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acea10-29ef-4bea-b425-a89e690da9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:03.957043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acea10-29ef-4bea-b425-a89e690da9e6 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:03.958343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:31:03.963553 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f3f6d-95d9-49cd-9474-a16d83d1620b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:03.964023 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f3f6d-95d9-49cd-9474-a16d83d1620b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:03.964139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f3f6d-95d9-49cd-9474-a16d83d1620b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:03.983623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-892f3f6d-95d9-49cd-9474-a16d83d1620b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:31:03.984833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-892f3f6d-95d9-49cd-9474-a16d83d1620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:31:03.992950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:31:04.064926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acea10-29ef-4bea-b425-a89e690da9e6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:31:04.066647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-79acea10-29ef-4bea-b425-a89e690da9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:31:04.144008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acea10-29ef-4bea-b425-a89e690da9e6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:31:04.147672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac165c-6d01-489a-a437-ee3fa3c33644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:31:04.148268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac165c-6d01-489a-a437-ee3fa3c33644 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:04.148546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac165c-6d01-489a-a437-ee3fa3c33644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:04.148815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac165c-6d01-489a-a437-ee3fa3c33644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:04.158799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac165c-6d01-489a-a437-ee3fa3c33644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:31:04.160270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac165c-6d01-489a-a437-ee3fa3c33644 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:31:04.170489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 776/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:31:06.157150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceadce6-7580-4a7d-b1da-7fa0a23040a4 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:06.157988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceadce6-7580-4a7d-b1da-7fa0a23040a4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:06.158232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceadce6-7580-4a7d-b1da-7fa0a23040a4 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:06.159613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:31:06.164838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59034cf7-3883-4e2b-8513-03174b25fc51 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:06.165261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59034cf7-3883-4e2b-8513-03174b25fc51 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:06.165374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59034cf7-3883-4e2b-8513-03174b25fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:06.184945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-59034cf7-3883-4e2b-8513-03174b25fc51 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:31:06.186133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-59034cf7-3883-4e2b-8513-03174b25fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:31:06.194090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:31:06.231256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceadce6-7580-4a7d-b1da-7fa0a23040a4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:31:06.241858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceadce6-7580-4a7d-b1da-7fa0a23040a4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:31:06.245378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c580f8-8795-45d8-916b-dfd96562e1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:31:06.245942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c580f8-8795-45d8-916b-dfd96562e1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:06.246234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c580f8-8795-45d8-916b-dfd96562e1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:06.246503 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c580f8-8795-45d8-916b-dfd96562e1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:06.255307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c580f8-8795-45d8-916b-dfd96562e1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:31:06.256731 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c580f8-8795-45d8-916b-dfd96562e1b9 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:31:06.267209 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 756/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:31:09.695965 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80611c-3f82-4dde-a890-1a1a115c3ac2 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:09.696575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80611c-3f82-4dde-a890-1a1a115c3ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:09.696575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80611c-3f82-4dde-a890-1a1a115c3ac2 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:09.697819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:31:09.703506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240dde5-829a-4f39-97be-9e231b5cfd83 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:09.703950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240dde5-829a-4f39-97be-9e231b5cfd83 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:09.704060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240dde5-829a-4f39-97be-9e231b5cfd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:09.711684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:31:09.724272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a240dde5-829a-4f39-97be-9e231b5cfd83 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:31:09.725506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a240dde5-829a-4f39-97be-9e231b5cfd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:31:09.733338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:31:10.033958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80611c-3f82-4dde-a890-1a1a115c3ac2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:31:10.035639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1e80611c-3f82-4dde-a890-1a1a115c3ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:31:10.112663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80611c-3f82-4dde-a890-1a1a115c3ac2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:31:10.116185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e944ed8-0070-49bc-83aa-a1846d9c00bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:31:10.116772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e944ed8-0070-49bc-83aa-a1846d9c00bd service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:10.117052 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e944ed8-0070-49bc-83aa-a1846d9c00bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:10.117312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e944ed8-0070-49bc-83aa-a1846d9c00bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:10.126502 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e944ed8-0070-49bc-83aa-a1846d9c00bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:31:10.127936 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e944ed8-0070-49bc-83aa-a1846d9c00bd service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:31:10.137320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 779/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:31:12.126132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462ce14-6a67-413b-a0ee-8ea65eb8333a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:12.126678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462ce14-6a67-413b-a0ee-8ea65eb8333a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:12.126678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462ce14-6a67-413b-a0ee-8ea65eb8333a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:12.128035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 22:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:31:12.133299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab55b6-3183-4989-81ef-914012eda976 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:12.133737 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab55b6-3183-4989-81ef-914012eda976 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:12.133835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab55b6-3183-4989-81ef-914012eda976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:12.153706 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-9eab55b6-3183-4989-81ef-914012eda976 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:31:12.154893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9eab55b6-3183-4989-81ef-914012eda976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:31:12.162662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 22:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:31:12.459329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462ce14-6a67-413b-a0ee-8ea65eb8333a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:31:12.461018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8462ce14-6a67-413b-a0ee-8ea65eb8333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:31:12.473784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462ce14-6a67-413b-a0ee-8ea65eb8333a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:31:12.477219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62913f-285b-4626-b1da-40802504d07d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:31:12.477797 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62913f-285b-4626-b1da-40802504d07d service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:31:12.478068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62913f-285b-4626-b1da-40802504d07d service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:31:12.478331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62913f-285b-4626-b1da-40802504d07d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:31:12.487531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62913f-285b-4626-b1da-40802504d07d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:31:12.488925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62913f-285b-4626-b1da-40802504d07d service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:31:12.498952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 759/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:31:22.148945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:31:22.493965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=8 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:43.728455 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9629600-aa5b-4243-81e0-e7f601b9d761 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:43.729552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9629600-aa5b-4243-81e0-e7f601b9d761 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:43.729991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9629600-aa5b-4243-81e0-e7f601b9d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:43.757890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d9629600-aa5b-4243-81e0-e7f601b9d761 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:43.759445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d9629600-aa5b-4243-81e0-e7f601b9d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:43.777231 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 781/1540] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:43.786974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4a921-c8cb-4ddc-836b-ff97eb0cc34d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:43.787608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4a921-c8cb-4ddc-836b-ff97eb0cc34d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:43.787608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4a921-c8cb-4ddc-836b-ff97eb0cc34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:43.816587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-02b4a921-c8cb-4ddc-836b-ff97eb0cc34d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:43.817974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-02b4a921-c8cb-4ddc-836b-ff97eb0cc34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:43.832850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 760/1541] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:43.838783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9629600-aa5b-4243-81e0-e7f601b9d761 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:43.855653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9629600-aa5b-4243-81e0-e7f601b9d761 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:43.861885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec844-a9bc-4fac-be5b-ced08707a29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:43.862703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec844-a9bc-4fac-be5b-ced08707a29f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:43.863177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec844-a9bc-4fac-be5b-ced08707a29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:43.863617 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec844-a9bc-4fac-be5b-ced08707a29f admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:43.864428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ec844-a9bc-4fac-be5b-ced08707a29f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:32:43.864905 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ec844-a9bc-4fac-be5b-ced08707a29f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:43.866190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-f64ec844-a9bc-4fac-be5b-ced08707a29f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:32:43.866190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 07 22:32:43.866190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: Aug 07 22:32:43.867738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ec844-a9bc-4fac-be5b-ced08707a29f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:43.881671 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 782/1542] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:32:43.890590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4a921-c8cb-4ddc-836b-ff97eb0cc34d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:43.906568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4a921-c8cb-4ddc-836b-ff97eb0cc34d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:43.915073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198649df-1ecb-484b-9ed3-fbee900f9915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:43.915783 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198649df-1ecb-484b-9ed3-fbee900f9915 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:43.916061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198649df-1ecb-484b-9ed3-fbee900f9915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:43.916325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198649df-1ecb-484b-9ed3-fbee900f9915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:43.916962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198649df-1ecb-484b-9ed3-fbee900f9915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:43.918070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-198649df-1ecb-484b-9ed3-fbee900f9915 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:32:43.918070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 07 22:32:43.918070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: Aug 07 22:32:43.919994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198649df-1ecb-484b-9ed3-fbee900f9915 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:43.988740 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 761/1543] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:32:43 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:44.001368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec844-a9bc-4fac-be5b-ced08707a29f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.019007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec844-a9bc-4fac-be5b-ced08707a29f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.035489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf46bcb-b677-45ce-a8e0-dc8c55142725 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.035860 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf46bcb-b677-45ce-a8e0-dc8c55142725 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.036105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf46bcb-b677-45ce-a8e0-dc8c55142725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.074411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-eaf46bcb-b677-45ce-a8e0-dc8c55142725 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.075698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-eaf46bcb-b677-45ce-a8e0-dc8c55142725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.112138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900419e-28d0-4c6d-acf2-3748e47e8034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.113158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900419e-28d0-4c6d-acf2-3748e47e8034 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.113645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900419e-28d0-4c6d-acf2-3748e47e8034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.114138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900419e-28d0-4c6d-acf2-3748e47e8034 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.114971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900419e-28d0-4c6d-acf2-3748e47e8034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.116449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-b900419e-28d0-4c6d-acf2-3748e47e8034 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:32:44.116449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 07 22:32:44.116449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: Aug 07 22:32:44.118024 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900419e-28d0-4c6d-acf2-3748e47e8034 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.170140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 783/1544] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:44.171928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266dab7-9e02-462a-9b77-c159736c42d9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.172442 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266dab7-9e02-462a-9b77-c159736c42d9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.172936 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266dab7-9e02-462a-9b77-c159736c42d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.186593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 762/1545] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.188027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23683d-426b-4c43-84d6-b48a6220ec8e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.190349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23683d-426b-4c43-84d6-b48a6220ec8e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.190718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23683d-426b-4c43-84d6-b48a6220ec8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.206740 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d266dab7-9e02-462a-9b77-c159736c42d9 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.211139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d266dab7-9e02-462a-9b77-c159736c42d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.223460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8f23683d-426b-4c43-84d6-b48a6220ec8e None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.225719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8f23683d-426b-4c43-84d6-b48a6220ec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.229962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 784/1546] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.230591 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266dab7-9e02-462a-9b77-c159736c42d9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.249048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 763/1547] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.251478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266dab7-9e02-462a-9b77-c159736c42d9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.253397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5e5a-8092-4cca-9aef-94e5c75355ad None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.253677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5e5a-8092-4cca-9aef-94e5c75355ad None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.253944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5e5a-8092-4cca-9aef-94e5c75355ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.265229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcbef4-a560-4781-8015-31a48239648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.265848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcbef4-a560-4781-8015-31a48239648d admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.266128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcbef4-a560-4781-8015-31a48239648d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.266389 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcbef4-a560-4781-8015-31a48239648d admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.267034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcbef4-a560-4781-8015-31a48239648d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.268778 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcbef4-a560-4781-8015-31a48239648d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.283906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 785/1548] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:44.285822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f1365-1225-4268-8cc3-d835f0c22f57 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.286370 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f1365-1225-4268-8cc3-d835f0c22f57 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.287374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f1365-1225-4268-8cc3-d835f0c22f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.289765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8cfb5e5a-8092-4cca-9aef-94e5c75355ad None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.290981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8cfb5e5a-8092-4cca-9aef-94e5c75355ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.301276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 764/1549] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.303297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a3319-9e1d-4029-bcb1-ce45321bc045 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.303441 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a3319-9e1d-4029-bcb1-ce45321bc045 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.303886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a3319-9e1d-4029-bcb1-ce45321bc045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.309704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-713f1365-1225-4268-8cc3-d835f0c22f57 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.310904 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-713f1365-1225-4268-8cc3-d835f0c22f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.319986 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 786/1550] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.321284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a140e3f-4547-442f-9fb3-97a914d5ee73 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.321569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a140e3f-4547-442f-9fb3-97a914d5ee73 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.321837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a140e3f-4547-442f-9fb3-97a914d5ee73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.327066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-565a3319-9e1d-4029-bcb1-ce45321bc045 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.328310 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-565a3319-9e1d-4029-bcb1-ce45321bc045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.336264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 765/1551] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.337437 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d6b2a-df8d-4a31-b322-605834a05963 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.337715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d6b2a-df8d-4a31-b322-605834a05963 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.337982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d6b2a-df8d-4a31-b322-605834a05963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.341221 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5a140e3f-4547-442f-9fb3-97a914d5ee73 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.342446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5a140e3f-4547-442f-9fb3-97a914d5ee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.350430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 787/1552] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.351661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dae8f-bccb-45d9-bc93-431649fc060f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.351936 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dae8f-bccb-45d9-bc93-431649fc060f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.352200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dae8f-bccb-45d9-bc93-431649fc060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.359727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c18d6b2a-df8d-4a31-b322-605834a05963 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.361032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c18d6b2a-df8d-4a31-b322-605834a05963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.369098 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 766/1553] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.369734 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d6b2a-df8d-4a31-b322-605834a05963 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.371227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-948dae8f-bccb-45d9-bc93-431649fc060f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.372410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-948dae8f-bccb-45d9-bc93-431649fc060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.379549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d6b2a-df8d-4a31-b322-605834a05963 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.381764 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 788/1554] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.382937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16f2d-7761-4cb8-ba4a-3ae6a9419069 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.383249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16f2d-7761-4cb8-ba4a-3ae6a9419069 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.383517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16f2d-7761-4cb8-ba4a-3ae6a9419069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.384345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7180f6-4b21-447a-8b69-db7c38bb64ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.384933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7180f6-4b21-447a-8b69-db7c38bb64ab admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.385215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7180f6-4b21-447a-8b69-db7c38bb64ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.385484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7180f6-4b21-447a-8b69-db7c38bb64ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.386379 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7180f6-4b21-447a-8b69-db7c38bb64ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.388205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7180f6-4b21-447a-8b69-db7c38bb64ab admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.398611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 767/1555] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:44.399868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e37787-fb6e-4a92-9aab-85a45210d94c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.400150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e37787-fb6e-4a92-9aab-85a45210d94c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.400419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e37787-fb6e-4a92-9aab-85a45210d94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.406044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-95c16f2d-7761-4cb8-ba4a-3ae6a9419069 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.407272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-95c16f2d-7761-4cb8-ba4a-3ae6a9419069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.416047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 789/1556] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.416823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16f2d-7761-4cb8-ba4a-3ae6a9419069 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.420953 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-76e37787-fb6e-4a92-9aab-85a45210d94c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.422118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-76e37787-fb6e-4a92-9aab-85a45210d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.426731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16f2d-7761-4cb8-ba4a-3ae6a9419069 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.429976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 768/1557] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.430726 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e37787-fb6e-4a92-9aab-85a45210d94c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.437620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c6bc5-f9b6-4c83-9953-73eba9e6f555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.438300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c6bc5-f9b6-4c83-9953-73eba9e6f555 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.438645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c6bc5-f9b6-4c83-9953-73eba9e6f555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.438917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c6bc5-f9b6-4c83-9953-73eba9e6f555 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.439590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c6bc5-f9b6-4c83-9953-73eba9e6f555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:32:44.439882 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e37787-fb6e-4a92-9aab-85a45210d94c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.439989 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c6bc5-f9b6-4c83-9953-73eba9e6f555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.441502 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c6bc5-f9b6-4c83-9953-73eba9e6f555 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.444557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c941909-6331-4de9-b2bc-50e0ef2af32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.445127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c941909-6331-4de9-b2bc-50e0ef2af32b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.445396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c941909-6331-4de9-b2bc-50e0ef2af32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.445665 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c941909-6331-4de9-b2bc-50e0ef2af32b admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.446291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c941909-6331-4de9-b2bc-50e0ef2af32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:32:44.446585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c941909-6331-4de9-b2bc-50e0ef2af32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.448169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c941909-6331-4de9-b2bc-50e0ef2af32b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.459686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 790/1558] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:32:44.459686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c6bc5-f9b6-4c83-9953-73eba9e6f555 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.464367 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 769/1559] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:32:44.464509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c6bc5-f9b6-4c83-9953-73eba9e6f555 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.466672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10f275-70f1-409f-8c57-bd983b7ec8ea None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.467052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10f275-70f1-409f-8c57-bd983b7ec8ea None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.467382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10f275-70f1-409f-8c57-bd983b7ec8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.469944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93688b8f-94c6-4f24-bc3e-aab01edff3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.470558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93688b8f-94c6-4f24-bc3e-aab01edff3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.470835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93688b8f-94c6-4f24-bc3e-aab01edff3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.471130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93688b8f-94c6-4f24-bc3e-aab01edff3a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.471766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93688b8f-94c6-4f24-bc3e-aab01edff3a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:32:44.472068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93688b8f-94c6-4f24-bc3e-aab01edff3a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.473617 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93688b8f-94c6-4f24-bc3e-aab01edff3a6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.486091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 791/1560] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:32:44.486976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bb10f275-70f1-409f-8c57-bd983b7ec8ea None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.487289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27543152-dbc1-4055-ba16-2cdff9459c26 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.487570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27543152-dbc1-4055-ba16-2cdff9459c26 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.487836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27543152-dbc1-4055-ba16-2cdff9459c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.488549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bb10f275-70f1-409f-8c57-bd983b7ec8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.497307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 770/1561] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.498304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10f275-70f1-409f-8c57-bd983b7ec8ea None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.506285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-27543152-dbc1-4055-ba16-2cdff9459c26 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.507424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-27543152-dbc1-4055-ba16-2cdff9459c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.507641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10f275-70f1-409f-8c57-bd983b7ec8ea None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.513140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c768d-404c-491d-bd35-d2455c2e724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.513768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c768d-404c-491d-bd35-d2455c2e724e admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.514044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c768d-404c-491d-bd35-d2455c2e724e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.514314 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c768d-404c-491d-bd35-d2455c2e724e admin admin] PATH_INFO: `/v3/projects/cef380f240424ca392b826f8f0356654/users/0a5bdba51d9446c18a096f421d27f71d/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.516352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 792/1562] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.517246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27543152-dbc1-4055-ba16-2cdff9459c26 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.526539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27543152-dbc1-4055-ba16-2cdff9459c26 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.531267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c768d-404c-491d-bd35-d2455c2e724e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef380f240424ca392b826f8f0356654, user_id=0a5bdba51d9446c18a096f421d27f71d, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.531611 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d132c-df61-4169-a35c-d1a93f8f751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.532189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d132c-df61-4169-a35c-d1a93f8f751a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.532359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-701c768d-404c-491d-bd35-d2455c2e724e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:32:44.532359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 07 22:32:44.532359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: Aug 07 22:32:44.532635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d132c-df61-4169-a35c-d1a93f8f751a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.532743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d132c-df61-4169-a35c-d1a93f8f751a admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.533332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d132c-df61-4169-a35c-d1a93f8f751a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:32:44.533628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d132c-df61-4169-a35c-d1a93f8f751a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.534265 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c768d-404c-491d-bd35-d2455c2e724e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.535263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d132c-df61-4169-a35c-d1a93f8f751a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.547398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 793/1563] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:32:44.548632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 771/1564] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:44 2022] PUT /identity/v3/projects/cef380f240424ca392b826f8f0356654/users/0a5bdba51d9446c18a096f421d27f71d/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:44.549134 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee97d0a-8f89-43fa-9a60-e36a21d9074c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.549562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee97d0a-8f89-43fa-9a60-e36a21d9074c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.549742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c768d-404c-491d-bd35-d2455c2e724e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.550182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee97d0a-8f89-43fa-9a60-e36a21d9074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.574316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8ee97d0a-8f89-43fa-9a60-e36a21d9074c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.576050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8ee97d0a-8f89-43fa-9a60-e36a21d9074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.599701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:44.610446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:44.624855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c768d-404c-491d-bd35-d2455c2e724e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.629793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce531d0-0dd6-4885-93ca-8ac6881868d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.630389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce531d0-0dd6-4885-93ca-8ac6881868d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.630667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce531d0-0dd6-4885-93ca-8ac6881868d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.630926 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce531d0-0dd6-4885-93ca-8ac6881868d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.631565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce531d0-0dd6-4885-93ca-8ac6881868d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.633444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce531d0-0dd6-4885-93ca-8ac6881868d4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.636242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 794/1565] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.637627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee97d0a-8f89-43fa-9a60-e36a21d9074c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.647389 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee97d0a-8f89-43fa-9a60-e36a21d9074c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.653884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07375449-7614-4d10-8005-bc4b49ee12fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.654511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07375449-7614-4d10-8005-bc4b49ee12fb admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.654819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07375449-7614-4d10-8005-bc4b49ee12fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.655260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07375449-7614-4d10-8005-bc4b49ee12fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.655877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07375449-7614-4d10-8005-bc4b49ee12fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.657759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07375449-7614-4d10-8005-bc4b49ee12fb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.661017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 772/1566] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:44.661801 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce531d0-0dd6-4885-93ca-8ac6881868d4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.683655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 795/1567] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:44.684539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07375449-7614-4d10-8005-bc4b49ee12fb admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.730443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce531d0-0dd6-4885-93ca-8ac6881868d4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.745221 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07375449-7614-4d10-8005-bc4b49ee12fb admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.749868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87106f1-41cc-4a01-838e-a67393516680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.750460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87106f1-41cc-4a01-838e-a67393516680 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.750733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87106f1-41cc-4a01-838e-a67393516680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.750997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87106f1-41cc-4a01-838e-a67393516680 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.751663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87106f1-41cc-4a01-838e-a67393516680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:32:44.751961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87106f1-41cc-4a01-838e-a67393516680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.753538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87106f1-41cc-4a01-838e-a67393516680 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.765912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 796/1568] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:32:44.766721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87106f1-41cc-4a01-838e-a67393516680 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.776164 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87106f1-41cc-4a01-838e-a67393516680 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.781283 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa079b-7c9a-4126-b058-1737873be82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.781859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa079b-7c9a-4126-b058-1737873be82d admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.782135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa079b-7c9a-4126-b058-1737873be82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.782406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa079b-7c9a-4126-b058-1737873be82d admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.783062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa079b-7c9a-4126-b058-1737873be82d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:32:44.783390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa079b-7c9a-4126-b058-1737873be82d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.784946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa079b-7c9a-4126-b058-1737873be82d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.792425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6498d-5c0e-4785-9589-c105f6cdaae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.793024 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6498d-5c0e-4785-9589-c105f6cdaae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.793355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6498d-5c0e-4785-9589-c105f6cdaae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.793628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6498d-5c0e-4785-9589-c105f6cdaae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.794241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6498d-5c0e-4785-9589-c105f6cdaae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.796156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6498d-5c0e-4785-9589-c105f6cdaae4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.796804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 797/1569] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:32:44.803974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a65a5-2a3b-44fc-a173-2de5f5f21740 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.803974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a65a5-2a3b-44fc-a173-2de5f5f21740 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.803974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a65a5-2a3b-44fc-a173-2de5f5f21740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.825905 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f27a65a5-2a3b-44fc-a173-2de5f5f21740 None None] MFA Rules not processed for user `0a5bdba51d9446c18a096f421d27f71d`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:44.827164 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f27a65a5-2a3b-44fc-a173-2de5f5f21740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:44.829242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 773/1570] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:44.830033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6498d-5c0e-4785-9589-c105f6cdaae4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.879290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:44.891684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6498d-5c0e-4785-9589-c105f6cdaae4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.892556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 798/1571] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:44.893386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a65a5-2a3b-44fc-a173-2de5f5f21740 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.897762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905754ee-7b77-44a9-8acd-7322b2f83e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.898643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905754ee-7b77-44a9-8acd-7322b2f83e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.898923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905754ee-7b77-44a9-8acd-7322b2f83e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.899231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905754ee-7b77-44a9-8acd-7322b2f83e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.900045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905754ee-7b77-44a9-8acd-7322b2f83e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.902043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905754ee-7b77-44a9-8acd-7322b2f83e43 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.904410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a65a5-2a3b-44fc-a173-2de5f5f21740 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.908881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4421d2-5e0f-47c4-9ea7-8c7537d10a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.909601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4421d2-5e0f-47c4-9ea7-8c7537d10a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.909879 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4421d2-5e0f-47c4-9ea7-8c7537d10a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.910287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4421d2-5e0f-47c4-9ea7-8c7537d10a08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.910932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4421d2-5e0f-47c4-9ea7-8c7537d10a08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:32:44.911265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4421d2-5e0f-47c4-9ea7-8c7537d10a08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.912854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4421d2-5e0f-47c4-9ea7-8c7537d10a08 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.926474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 799/1572] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:32:44.927715 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4421d2-5e0f-47c4-9ea7-8c7537d10a08 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.939486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4421d2-5e0f-47c4-9ea7-8c7537d10a08 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:44.944403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493ba90-6125-448c-9f74-b83bb57e6a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:44.944989 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493ba90-6125-448c-9f74-b83bb57e6a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:44.945258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493ba90-6125-448c-9f74-b83bb57e6a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:44.945520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493ba90-6125-448c-9f74-b83bb57e6a81 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:44.946127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493ba90-6125-448c-9f74-b83bb57e6a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:44.948078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493ba90-6125-448c-9f74-b83bb57e6a81 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:44.948384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 774/1573] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:44.949252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905754ee-7b77-44a9-8acd-7322b2f83e43 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.965562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:44.973685 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 800/1574] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:44.974899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493ba90-6125-448c-9f74-b83bb57e6a81 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:44.985611 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493ba90-6125-448c-9f74-b83bb57e6a81 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.015579 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905754ee-7b77-44a9-8acd-7322b2f83e43 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.020416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910ac2b-1863-4322-ac2b-beb1c439c207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.020957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910ac2b-1863-4322-ac2b-beb1c439c207 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.021226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910ac2b-1863-4322-ac2b-beb1c439c207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.021491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910ac2b-1863-4322-ac2b-beb1c439c207 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.022095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910ac2b-1863-4322-ac2b-beb1c439c207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.024039 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910ac2b-1863-4322-ac2b-beb1c439c207 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.045269 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335c51-d0ed-4d37-b04e-d18a0f31bbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.045877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335c51-d0ed-4d37-b04e-d18a0f31bbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.046150 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335c51-d0ed-4d37-b04e-d18a0f31bbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.046417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335c51-d0ed-4d37-b04e-d18a0f31bbd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.047034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7335c51-d0ed-4d37-b04e-d18a0f31bbd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.047985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 775/1575] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:45.048857 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910ac2b-1863-4322-ac2b-beb1c439c207 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.049042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7335c51-d0ed-4d37-b04e-d18a0f31bbd2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.058465 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910ac2b-1863-4322-ac2b-beb1c439c207 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.063159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95044b1-c6ba-4f81-a848-50617ddc9e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.063837 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95044b1-c6ba-4f81-a848-50617ddc9e87 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.064123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95044b1-c6ba-4f81-a848-50617ddc9e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.064384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95044b1-c6ba-4f81-a848-50617ddc9e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.064985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95044b1-c6ba-4f81-a848-50617ddc9e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.066893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95044b1-c6ba-4f81-a848-50617ddc9e87 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.078263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 801/1576] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:32:44 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:45.078263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335c51-d0ed-4d37-b04e-d18a0f31bbd2 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.096620 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 776/1577] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:32:45 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:45.097845 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e85b-c50d-445b-93b5-09cb952b5426 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.098125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e85b-c50d-445b-93b5-09cb952b5426 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.098395 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e85b-c50d-445b-93b5-09cb952b5426 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.099644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 777/1578] 10.222.0.15 () {54 vars in 962 bytes} [Sun Aug 7 22:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:32:45.100301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7e85b-c50d-445b-93b5-09cb952b5426 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.142685 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335c51-d0ed-4d37-b04e-d18a0f31bbd2 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.163966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7e85b-c50d-445b-93b5-09cb952b5426 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.169257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae86e3-7bf3-4822-9602-935332e50326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.169924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae86e3-7bf3-4822-9602-935332e50326 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.170265 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae86e3-7bf3-4822-9602-935332e50326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.170601 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae86e3-7bf3-4822-9602-935332e50326 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.171243 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae86e3-7bf3-4822-9602-935332e50326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.173245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae86e3-7bf3-4822-9602-935332e50326 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.197204 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3bc11-3ee1-482d-bee2-cfdd78f1b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.197822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3bc11-3ee1-482d-bee2-cfdd78f1b71e admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.198097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3bc11-3ee1-482d-bee2-cfdd78f1b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.198364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3bc11-3ee1-482d-bee2-cfdd78f1b71e admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.198972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3bc11-3ee1-482d-bee2-cfdd78f1b71e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.201346 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 778/1579] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:32:45 2022] POST /identity/v3/projects => generated 357 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:45.201474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3bc11-3ee1-482d-bee2-cfdd78f1b71e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.202169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae86e3-7bf3-4822-9602-935332e50326 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.222524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 802/1580] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:32:45 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:45.223360 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3bc11-3ee1-482d-bee2-cfdd78f1b71e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.234631 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3bc11-3ee1-482d-bee2-cfdd78f1b71e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.240490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:45.254487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:45.271455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae86e3-7bf3-4822-9602-935332e50326 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.276168 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c176605-2bb2-46e8-b0cd-47e01757cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.276769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c176605-2bb2-46e8-b0cd-47e01757cd44 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.277046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c176605-2bb2-46e8-b0cd-47e01757cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.277310 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c176605-2bb2-46e8-b0cd-47e01757cd44 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.277962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c176605-2bb2-46e8-b0cd-47e01757cd44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.279935 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c176605-2bb2-46e8-b0cd-47e01757cd44 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.295665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25f20c-faa5-4c05-8140-1c85a0047801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.296338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25f20c-faa5-4c05-8140-1c85a0047801 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.296635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25f20c-faa5-4c05-8140-1c85a0047801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.296889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25f20c-faa5-4c05-8140-1c85a0047801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.297535 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25f20c-faa5-4c05-8140-1c85a0047801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.299243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25f20c-faa5-4c05-8140-1c85a0047801 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.303681 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 779/1581] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:32:45 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:45.304701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c176605-2bb2-46e8-b0cd-47e01757cd44 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.310001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 803/1582] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.310889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25f20c-faa5-4c05-8140-1c85a0047801 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.317577 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c176605-2bb2-46e8-b0cd-47e01757cd44 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.320184 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25f20c-faa5-4c05-8140-1c85a0047801 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.322188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bdbf0-07d8-4e1b-bdfd-8ae8d0f4abcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.322843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bdbf0-07d8-4e1b-bdfd-8ae8d0f4abcd admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.323239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bdbf0-07d8-4e1b-bdfd-8ae8d0f4abcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.323590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bdbf0-07d8-4e1b-bdfd-8ae8d0f4abcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.324289 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bdbf0-07d8-4e1b-bdfd-8ae8d0f4abcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.324919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67e229-3522-4629-9a95-f5fc7c85efd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.325491 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67e229-3522-4629-9a95-f5fc7c85efd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.325766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67e229-3522-4629-9a95-f5fc7c85efd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.326038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67e229-3522-4629-9a95-f5fc7c85efd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.326204 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bdbf0-07d8-4e1b-bdfd-8ae8d0f4abcd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.326642 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67e229-3522-4629-9a95-f5fc7c85efd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.328550 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67e229-3522-4629-9a95-f5fc7c85efd0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.336890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 780/1583] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.337741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bdbf0-07d8-4e1b-bdfd-8ae8d0f4abcd admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.347918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bdbf0-07d8-4e1b-bdfd-8ae8d0f4abcd admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.352524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1740c6-e25f-4a21-ba02-b4066e6641fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.356546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 804/1584] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:32:45 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:45.356679 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1740c6-e25f-4a21-ba02-b4066e6641fb admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.356679 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1740c6-e25f-4a21-ba02-b4066e6641fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.356679 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1740c6-e25f-4a21-ba02-b4066e6641fb admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.356976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d47298-c49c-49fe-92f6-53831a75e5a8 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.357080 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1740c6-e25f-4a21-ba02-b4066e6641fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.357170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d47298-c49c-49fe-92f6-53831a75e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.357170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d47298-c49c-49fe-92f6-53831a75e5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.357340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1740c6-e25f-4a21-ba02-b4066e6641fb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.379480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 781/1585] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:32:45 2022] POST /identity/v3/users => generated 283 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:45.380180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1740c6-e25f-4a21-ba02-b4066e6641fb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.390378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1740c6-e25f-4a21-ba02-b4066e6641fb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.394631 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-18d47298-c49c-49fe-92f6-53831a75e5a8 None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:45.395600 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf17b-3679-45f4-9563-f19ab0e0e97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.395857 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-18d47298-c49c-49fe-92f6-53831a75e5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:45.396219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf17b-3679-45f4-9563-f19ab0e0e97b admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.396495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf17b-3679-45f4-9563-f19ab0e0e97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.396765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf17b-3679-45f4-9563-f19ab0e0e97b admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.397375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf17b-3679-45f4-9563-f19ab0e0e97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.399335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf17b-3679-45f4-9563-f19ab0e0e97b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.421293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 782/1586] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:32:45 2022] POST /identity/v3/users => generated 279 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:45.422182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf17b-3679-45f4-9563-f19ab0e0e97b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.431490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf17b-3679-45f4-9563-f19ab0e0e97b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.437087 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804d49d-3f8c-43e5-a16f-48c8745aab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.437665 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804d49d-3f8c-43e5-a16f-48c8745aab59 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.437940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804d49d-3f8c-43e5-a16f-48c8745aab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.438213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804d49d-3f8c-43e5-a16f-48c8745aab59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.438842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804d49d-3f8c-43e5-a16f-48c8745aab59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.440463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804d49d-3f8c-43e5-a16f-48c8745aab59 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.450145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 783/1587] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.450905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804d49d-3f8c-43e5-a16f-48c8745aab59 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.459974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804d49d-3f8c-43e5-a16f-48c8745aab59 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.464136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 805/1588] 10.222.0.15 () {58 vars in 1059 bytes} [Sun Aug 7 22:32:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:45.464463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72606069-fb00-4885-833d-c6a4afe0709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.464979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d47298-c49c-49fe-92f6-53831a75e5a8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.465152 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72606069-fb00-4885-833d-c6a4afe0709f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.465316 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72606069-fb00-4885-833d-c6a4afe0709f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.465581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72606069-fb00-4885-833d-c6a4afe0709f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.466182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72606069-fb00-4885-833d-c6a4afe0709f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.467871 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72606069-fb00-4885-833d-c6a4afe0709f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.475850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d47298-c49c-49fe-92f6-53831a75e5a8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.478098 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 784/1589] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.480202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72606069-fb00-4885-833d-c6a4afe0709f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.480437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205e6ab-9be9-429b-b3aa-a4bef65136fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.481554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e6ab-9be9-429b-b3aa-a4bef65136fc admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.481832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e6ab-9be9-429b-b3aa-a4bef65136fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.482105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e6ab-9be9-429b-b3aa-a4bef65136fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.482746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205e6ab-9be9-429b-b3aa-a4bef65136fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.484366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205e6ab-9be9-429b-b3aa-a4bef65136fc admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.490321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72606069-fb00-4885-833d-c6a4afe0709f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.494548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 806/1590] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.495428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205e6ab-9be9-429b-b3aa-a4bef65136fc admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.498538 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac0f4a-59bf-4e28-885c-15cd47c0b9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.499145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac0f4a-59bf-4e28-885c-15cd47c0b9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.499421 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac0f4a-59bf-4e28-885c-15cd47c0b9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.499685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac0f4a-59bf-4e28-885c-15cd47c0b9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.500321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac0f4a-59bf-4e28-885c-15cd47c0b9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.501916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac0f4a-59bf-4e28-885c-15cd47c0b9ef admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.505344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205e6ab-9be9-429b-b3aa-a4bef65136fc admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.509839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed0aec-684b-427f-b958-057e51768c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.510407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed0aec-684b-427f-b958-057e51768c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.510931 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed0aec-684b-427f-b958-057e51768c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.511244 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed0aec-684b-427f-b958-057e51768c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.511865 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed0aec-684b-427f-b958-057e51768c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.512209 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 785/1591] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.512991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac0f4a-59bf-4e28-885c-15cd47c0b9ef admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.513498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed0aec-684b-427f-b958-057e51768c12 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.523661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 807/1592] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.524206 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac0f4a-59bf-4e28-885c-15cd47c0b9ef admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.524538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed0aec-684b-427f-b958-057e51768c12 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.530450 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a26962-49f9-409f-9e8a-19b11d9bb5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.531150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a26962-49f9-409f-9e8a-19b11d9bb5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.531430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a26962-49f9-409f-9e8a-19b11d9bb5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.531702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a26962-49f9-409f-9e8a-19b11d9bb5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.532337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a26962-49f9-409f-9e8a-19b11d9bb5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.533903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a26962-49f9-409f-9e8a-19b11d9bb5f3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.534191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed0aec-684b-427f-b958-057e51768c12 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.539175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3a9b8-2bf8-4db0-9314-408ea66f74b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.539817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3a9b8-2bf8-4db0-9314-408ea66f74b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.540101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3a9b8-2bf8-4db0-9314-408ea66f74b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.540374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3a9b8-2bf8-4db0-9314-408ea66f74b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.541030 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3a9b8-2bf8-4db0-9314-408ea66f74b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.542562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3a9b8-2bf8-4db0-9314-408ea66f74b9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.544698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 786/1593] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.545498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a26962-49f9-409f-9e8a-19b11d9bb5f3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.554743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a26962-49f9-409f-9e8a-19b11d9bb5f3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.557917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 808/1594] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.559530 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3a9b8-2bf8-4db0-9314-408ea66f74b9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.563076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4251e-11a7-4465-9809-2fe907af417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.563693 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4251e-11a7-4465-9809-2fe907af417f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.563965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4251e-11a7-4465-9809-2fe907af417f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.564230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4251e-11a7-4465-9809-2fe907af417f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.564862 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4251e-11a7-4465-9809-2fe907af417f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.566437 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4251e-11a7-4465-9809-2fe907af417f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.573846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3a9b8-2bf8-4db0-9314-408ea66f74b9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.577065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 787/1595] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.577910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4251e-11a7-4465-9809-2fe907af417f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.582802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb914d5-1865-4224-9297-a2ea91522ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.583920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb914d5-1865-4224-9297-a2ea91522ddb service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.583920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb914d5-1865-4224-9297-a2ea91522ddb service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.584171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb914d5-1865-4224-9297-a2ea91522ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.587002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4251e-11a7-4465-9809-2fe907af417f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.592166 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55168c1-9867-4006-9675-b0c1a06edcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.592729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55168c1-9867-4006-9675-b0c1a06edcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.593000 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55168c1-9867-4006-9675-b0c1a06edcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.593264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55168c1-9867-4006-9675-b0c1a06edcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.593877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55168c1-9867-4006-9675-b0c1a06edcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.595467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55168c1-9867-4006-9675-b0c1a06edcd2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.604995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 788/1596] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.605797 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55168c1-9867-4006-9675-b0c1a06edcd2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.615841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55168c1-9867-4006-9675-b0c1a06edcd2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.621441 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2d726-77d0-441a-a72d-896cfcc9b969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.622061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2d726-77d0-441a-a72d-896cfcc9b969 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.622334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2d726-77d0-441a-a72d-896cfcc9b969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.623020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2d726-77d0-441a-a72d-896cfcc9b969 admin admin] PATH_INFO: `/v3/projects/8ff1353007e0474c923cb4e3bf93ba43/users/aff5308e6cb94622853075a723d54a67/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.626311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:45.637977 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2d726-77d0-441a-a72d-896cfcc9b969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff1353007e0474c923cb4e3bf93ba43, user_id=aff5308e6cb94622853075a723d54a67, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.640615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2d726-77d0-441a-a72d-896cfcc9b969 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.642405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb914d5-1865-4224-9297-a2ea91522ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.644656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb914d5-1865-4224-9297-a2ea91522ddb service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.653445 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 789/1597] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:45 2022] PUT /identity/v3/projects/8ff1353007e0474c923cb4e3bf93ba43/users/aff5308e6cb94622853075a723d54a67/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:45.654038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 809/1598] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:45.654342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2d726-77d0-441a-a72d-896cfcc9b969 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.654648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb914d5-1865-4224-9297-a2ea91522ddb service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.664822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb914d5-1865-4224-9297-a2ea91522ddb service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.705180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:45.722656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8dae7-3cf8-4956-a9e8-12703e22279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.723286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8dae7-3cf8-4956-a9e8-12703e22279f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.723555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8dae7-3cf8-4956-a9e8-12703e22279f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.723820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8dae7-3cf8-4956-a9e8-12703e22279f admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.724449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8dae7-3cf8-4956-a9e8-12703e22279f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.725521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2d726-77d0-441a-a72d-896cfcc9b969 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.726011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8dae7-3cf8-4956-a9e8-12703e22279f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.731679 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c99e0-020a-4b85-95df-7ab66a37361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.732183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c99e0-020a-4b85-95df-7ab66a37361d admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.732522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c99e0-020a-4b85-95df-7ab66a37361d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.732862 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c99e0-020a-4b85-95df-7ab66a37361d admin admin] PATH_INFO: `/v3/projects/01db52a9d53f4540aafa5b2db7b693c8/users/ccb8ac5aaec44417bd6aaa4a2b1aca11/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.736691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 810/1599] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.736934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8dae7-3cf8-4956-a9e8-12703e22279f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.746181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8dae7-3cf8-4956-a9e8-12703e22279f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.751114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c6aef-b638-457a-bc70-d0a3fb212916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.751758 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c6aef-b638-457a-bc70-d0a3fb212916 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.752028 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c6aef-b638-457a-bc70-d0a3fb212916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.752293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c6aef-b638-457a-bc70-d0a3fb212916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.752910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c6aef-b638-457a-bc70-d0a3fb212916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.753028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c99e0-020a-4b85-95df-7ab66a37361d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01db52a9d53f4540aafa5b2db7b693c8, user_id=ccb8ac5aaec44417bd6aaa4a2b1aca11, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.754451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c6aef-b638-457a-bc70-d0a3fb212916 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.756064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c99e0-020a-4b85-95df-7ab66a37361d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.764992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 811/1600] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.765779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c6aef-b638-457a-bc70-d0a3fb212916 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.775548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c6aef-b638-457a-bc70-d0a3fb212916 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.778057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 790/1601] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:45 2022] PUT /identity/v3/projects/01db52a9d53f4540aafa5b2db7b693c8/users/ccb8ac5aaec44417bd6aaa4a2b1aca11/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:45.778660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c99e0-020a-4b85-95df-7ab66a37361d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.833755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42569ffa-97f6-40e6-91f8-02498531c4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.834523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42569ffa-97f6-40e6-91f8-02498531c4ab admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.834798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42569ffa-97f6-40e6-91f8-02498531c4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.835138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42569ffa-97f6-40e6-91f8-02498531c4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.835786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42569ffa-97f6-40e6-91f8-02498531c4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.837365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42569ffa-97f6-40e6-91f8-02498531c4ab admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.846958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c99e0-020a-4b85-95df-7ab66a37361d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.850923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 812/1602] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:45.850923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42569ffa-97f6-40e6-91f8-02498531c4ab admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.856527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2118fdf-f4aa-4d98-b898-9b498d965dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.857190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2118fdf-f4aa-4d98-b898-9b498d965dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.858005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2118fdf-f4aa-4d98-b898-9b498d965dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.858279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2118fdf-f4aa-4d98-b898-9b498d965dad admin admin] PATH_INFO: `/v3/projects/611a6c918a44414db285b1a4f478ccb7/users/e2dabc4754c54de1ac66ba4c19b63919/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.861002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42569ffa-97f6-40e6-91f8-02498531c4ab admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.865799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf223ee-f251-4b21-aba8-a1d72649a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.866555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf223ee-f251-4b21-aba8-a1d72649a1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.866834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf223ee-f251-4b21-aba8-a1d72649a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.867141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf223ee-f251-4b21-aba8-a1d72649a1f5 admin admin] PATH_INFO: `/v3/projects/deeb373bbc2f4eb7a0fe70ca05d82552/users/411b1c674ef24c2bab146208d720c0b4/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.873352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2118fdf-f4aa-4d98-b898-9b498d965dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=611a6c918a44414db285b1a4f478ccb7, user_id=e2dabc4754c54de1ac66ba4c19b63919, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.876101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2118fdf-f4aa-4d98-b898-9b498d965dad admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.884690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf223ee-f251-4b21-aba8-a1d72649a1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deeb373bbc2f4eb7a0fe70ca05d82552, user_id=411b1c674ef24c2bab146208d720c0b4, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:45.888342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf223ee-f251-4b21-aba8-a1d72649a1f5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:45.893912 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 791/1603] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:45 2022] PUT /identity/v3/projects/611a6c918a44414db285b1a4f478ccb7/users/e2dabc4754c54de1ac66ba4c19b63919/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:45.895903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157e45-a119-4520-81d9-abffc6769307 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.896630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157e45-a119-4520-81d9-abffc6769307 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.897227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157e45-a119-4520-81d9-abffc6769307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.906894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 813/1604] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:45 2022] PUT /identity/v3/projects/deeb373bbc2f4eb7a0fe70ca05d82552/users/411b1c674ef24c2bab146208d720c0b4/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:45.911260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf223ee-f251-4b21-aba8-a1d72649a1f5 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.918118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-96157e45-a119-4520-81d9-abffc6769307 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:45.919900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-96157e45-a119-4520-81d9-abffc6769307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:45.952602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:45.973064 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf223ee-f251-4b21-aba8-a1d72649a1f5 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:45.977636 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154586d-80f9-4808-99ff-9b06fddc2c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:45.978306 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154586d-80f9-4808-99ff-9b06fddc2c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:45.978578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154586d-80f9-4808-99ff-9b06fddc2c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:45.978843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154586d-80f9-4808-99ff-9b06fddc2c6f admin admin] PATH_INFO: `/v3/projects/6bd5c44768574454ab5ec245148bd47a/users/51e200b8d8c443d5912756bf1d04a82d/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:45.979714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 792/1605] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:45.983077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157e45-a119-4520-81d9-abffc6769307 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:45.996790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157e45-a119-4520-81d9-abffc6769307 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.001504 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435d8e-ea5f-48a2-88d0-1a45958b01e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.002153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435d8e-ea5f-48a2-88d0-1a45958b01e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.002431 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435d8e-ea5f-48a2-88d0-1a45958b01e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.002704 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435d8e-ea5f-48a2-88d0-1a45958b01e8 admin admin] PATH_INFO: `/v3/projects/f5bf65dde00848d4864461e5538a7d00/users/3aae02d5da9a405e8683586ff9793d89/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.004372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154586d-80f9-4808-99ff-9b06fddc2c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd5c44768574454ab5ec245148bd47a, user_id=51e200b8d8c443d5912756bf1d04a82d, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.007041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154586d-80f9-4808-99ff-9b06fddc2c6f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.019283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435d8e-ea5f-48a2-88d0-1a45958b01e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5bf65dde00848d4864461e5538a7d00, user_id=3aae02d5da9a405e8683586ff9793d89, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.021080 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 814/1606] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:45 2022] PUT /identity/v3/projects/6bd5c44768574454ab5ec245148bd47a/users/51e200b8d8c443d5912756bf1d04a82d/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:46.022096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435d8e-ea5f-48a2-88d0-1a45958b01e8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.022306 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e806-53a9-4787-affc-d39c8845b0f9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.022584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e806-53a9-4787-affc-d39c8845b0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.022850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e806-53a9-4787-affc-d39c8845b0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.036401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 793/1607] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:45 2022] PUT /identity/v3/projects/f5bf65dde00848d4864461e5538a7d00/users/3aae02d5da9a405e8683586ff9793d89/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:46.037508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435d8e-ea5f-48a2-88d0-1a45958b01e8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:46.051792 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a196e806-53a9-4787-affc-d39c8845b0f9 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:46.053076 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a196e806-53a9-4787-affc-d39c8845b0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:46.066587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:46.102442 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435d8e-ea5f-48a2-88d0-1a45958b01e8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.107165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca32c6c-f933-45d7-9cc1-89a52ba690fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.107835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca32c6c-f933-45d7-9cc1-89a52ba690fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.108109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca32c6c-f933-45d7-9cc1-89a52ba690fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.108378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca32c6c-f933-45d7-9cc1-89a52ba690fe admin admin] PATH_INFO: `/v3/projects/6910f845d4ea4c8a8abf6f9705f1f332/users/b0c163fdfff342bd8d5ef252feff6934/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.116027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 815/1608] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:46.117437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c43b84-0a1b-4143-bc67-54e2718acb81 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.117701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c43b84-0a1b-4143-bc67-54e2718acb81 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.117967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c43b84-0a1b-4143-bc67-54e2718acb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.126181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca32c6c-f933-45d7-9cc1-89a52ba690fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6910f845d4ea4c8a8abf6f9705f1f332, user_id=b0c163fdfff342bd8d5ef252feff6934, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.129046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca32c6c-f933-45d7-9cc1-89a52ba690fe admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.136669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-53c43b84-0a1b-4143-bc67-54e2718acb81 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:46.138379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-53c43b84-0a1b-4143-bc67-54e2718acb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:46.143055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 794/1609] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:46 2022] PUT /identity/v3/projects/6910f845d4ea4c8a8abf6f9705f1f332/users/b0c163fdfff342bd8d5ef252feff6934/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:46.144352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f415394-38a2-42ca-9019-4dcd43e5931e None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.144634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f415394-38a2-42ca-9019-4dcd43e5931e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.144905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f415394-38a2-42ca-9019-4dcd43e5931e None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.146291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 795/1610] 10.222.0.15 () {54 vars in 912 bytes} [Sun Aug 7 22:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:32:46.147362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d2051-0b00-4bfa-8962-b5ea905b6f4b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.147487 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d2051-0b00-4bfa-8962-b5ea905b6f4b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.148080 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d2051-0b00-4bfa-8962-b5ea905b6f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.166934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-da0d2051-0b00-4bfa-8962-b5ea905b6f4b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:46.168200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-da0d2051-0b00-4bfa-8962-b5ea905b6f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:46.202257 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 816/1611] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:46.202257 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c43b84-0a1b-4143-bc67-54e2718acb81 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:46.229073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 796/1612] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:46.230226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f2b10-27be-4fce-ad9d-d7b295060b65 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.230543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f2b10-27be-4fce-ad9d-d7b295060b65 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.230981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f2b10-27be-4fce-ad9d-d7b295060b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.249860 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0e8f2b10-27be-4fce-ad9d-d7b295060b65 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:46.251046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0e8f2b10-27be-4fce-ad9d-d7b295060b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:46.257814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c43b84-0a1b-4143-bc67-54e2718acb81 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.258545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 797/1613] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:46.259799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286800ef-d665-4efa-b9d6-1c031eefd995 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.260075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286800ef-d665-4efa-b9d6-1c031eefd995 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.260337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286800ef-d665-4efa-b9d6-1c031eefd995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.263741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8974e12-4bb2-4814-ac0b-cdb921a4876e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.264460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8974e12-4bb2-4814-ac0b-cdb921a4876e service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.264815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8974e12-4bb2-4814-ac0b-cdb921a4876e service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.265158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8974e12-4bb2-4814-ac0b-cdb921a4876e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.274746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8974e12-4bb2-4814-ac0b-cdb921a4876e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.276312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8974e12-4bb2-4814-ac0b-cdb921a4876e service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.287531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 817/1614] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:46.287531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8974e12-4bb2-4814-ac0b-cdb921a4876e service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:46.289126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f8974e12-4bb2-4814-ac0b-cdb921a4876e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:46.291473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-286800ef-d665-4efa-b9d6-1c031eefd995 None None] MFA Rules not processed for user `3aae02d5da9a405e8683586ff9793d89`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:46.292710 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-286800ef-d665-4efa-b9d6-1c031eefd995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:46.300779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8974e12-4bb2-4814-ac0b-cdb921a4876e service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.304996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7b456-7216-4927-9c20-1e3810194849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.305643 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7b456-7216-4927-9c20-1e3810194849 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.305969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7b456-7216-4927-9c20-1e3810194849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.306241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7b456-7216-4927-9c20-1e3810194849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.313480 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:46.317916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7b456-7216-4927-9c20-1e3810194849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.319784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7b456-7216-4927-9c20-1e3810194849 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.332086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 818/1615] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:46.333630 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd15df4-2f06-4b75-9b8f-04b9c168a4ad None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.333915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd15df4-2f06-4b75-9b8f-04b9c168a4ad None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.334187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd15df4-2f06-4b75-9b8f-04b9c168a4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.366965 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2bd15df4-2f06-4b75-9b8f-04b9c168a4ad None None] MFA Rules not processed for user `b0c163fdfff342bd8d5ef252feff6934`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:46.368355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2bd15df4-2f06-4b75-9b8f-04b9c168a4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:46.391575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 798/1616] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:46.394187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046307e7-bae3-48ff-a57b-22b5d26bfac6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.394642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046307e7-bae3-48ff-a57b-22b5d26bfac6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.395144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046307e7-bae3-48ff-a57b-22b5d26bfac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.422257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-046307e7-bae3-48ff-a57b-22b5d26bfac6 None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:46.423713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-046307e7-bae3-48ff-a57b-22b5d26bfac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:46.454659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 819/1617] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:46.456033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd15df4-2f06-4b75-9b8f-04b9c168a4ad None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:46.462220 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:46.471756 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd15df4-2f06-4b75-9b8f-04b9c168a4ad None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.477529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371cb8b-9f62-416d-a672-9dd40f7cfed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.478729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371cb8b-9f62-416d-a672-9dd40f7cfed3 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.479588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371cb8b-9f62-416d-a672-9dd40f7cfed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.480407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371cb8b-9f62-416d-a672-9dd40f7cfed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.492264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371cb8b-9f62-416d-a672-9dd40f7cfed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.494118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371cb8b-9f62-416d-a672-9dd40f7cfed3 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.509172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 820/1618] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:46.510972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371cb8b-9f62-416d-a672-9dd40f7cfed3 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:46.521469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371cb8b-9f62-416d-a672-9dd40f7cfed3 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.526571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3590c-d542-4ae4-8638-a2dda7062224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.527646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3590c-d542-4ae4-8638-a2dda7062224 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.528078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3590c-d542-4ae4-8638-a2dda7062224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.529007 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 799/1619] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:32:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:46.530035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046307e7-bae3-48ff-a57b-22b5d26bfac6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:46.537245 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3590c-d542-4ae4-8638-a2dda7062224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.539989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046307e7-bae3-48ff-a57b-22b5d26bfac6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.544752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d8898-349b-4d3a-aabe-fcdbb6c089ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.545487 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d8898-349b-4d3a-aabe-fcdbb6c089ee service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.545866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d8898-349b-4d3a-aabe-fcdbb6c089ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.546238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d8898-349b-4d3a-aabe-fcdbb6c089ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.549890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3590c-d542-4ae4-8638-a2dda7062224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.558120 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3590c-d542-4ae4-8638-a2dda7062224 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.563414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 821/1620] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:46.564207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3590c-d542-4ae4-8638-a2dda7062224 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:46.567137 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d8898-349b-4d3a-aabe-fcdbb6c089ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.569577 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d8898-349b-4d3a-aabe-fcdbb6c089ee service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.582802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 800/1621] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:46.583959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d8898-349b-4d3a-aabe-fcdbb6c089ee service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:46.597296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d8898-349b-4d3a-aabe-fcdbb6c089ee service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.605410 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca6a33-550e-48a4-ba63-293f23716bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.606209 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca6a33-550e-48a4-ba63-293f23716bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.606580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca6a33-550e-48a4-ba63-293f23716bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.606962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca6a33-550e-48a4-ba63-293f23716bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.607855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca6a33-550e-48a4-ba63-293f23716bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.610528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca6a33-550e-48a4-ba63-293f23716bd2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.628396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3590c-d542-4ae4-8638-a2dda7062224 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.632472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9e1ee-3405-41a1-b86f-f40b13f86366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.633090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9e1ee-3405-41a1-b86f-f40b13f86366 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.633383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9e1ee-3405-41a1-b86f-f40b13f86366 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.633635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9e1ee-3405-41a1-b86f-f40b13f86366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.645049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9e1ee-3405-41a1-b86f-f40b13f86366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.647311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9e1ee-3405-41a1-b86f-f40b13f86366 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.663897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 801/1622] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:32:46 2022] POST /identity/v3/projects => generated 357 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:46.665092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca6a33-550e-48a4-ba63-293f23716bd2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:46.671436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 822/1623] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:46.673883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9e1ee-3405-41a1-b86f-f40b13f86366 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:46.697984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9e1ee-3405-41a1-b86f-f40b13f86366 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.791407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca6a33-550e-48a4-ba63-293f23716bd2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.802881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ef980-998d-4a05-8bc6-3018b3507fd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.803723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ef980-998d-4a05-8bc6-3018b3507fd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.804001 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ef980-998d-4a05-8bc6-3018b3507fd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.805537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ef980-998d-4a05-8bc6-3018b3507fd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.833773 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170b42d-0cd6-477d-a001-155489c60180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.834451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170b42d-0cd6-477d-a001-155489c60180 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.834730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170b42d-0cd6-477d-a001-155489c60180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.834999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170b42d-0cd6-477d-a001-155489c60180 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.838646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170b42d-0cd6-477d-a001-155489c60180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.843133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170b42d-0cd6-477d-a001-155489c60180 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.865887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:46.888694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 823/1624] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:32:46 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:46.892284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170b42d-0cd6-477d-a001-155489c60180 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:46.910559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170b42d-0cd6-477d-a001-155489c60180 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.926720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b45e03-2a00-4054-99ae-e1af856748a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.927431 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b45e03-2a00-4054-99ae-e1af856748a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.927761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b45e03-2a00-4054-99ae-e1af856748a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.928031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b45e03-2a00-4054-99ae-e1af856748a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:46.928755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b45e03-2a00-4054-99ae-e1af856748a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.930353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b45e03-2a00-4054-99ae-e1af856748a4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.952177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 824/1625] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:32:46.957355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b45e03-2a00-4054-99ae-e1af856748a4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:46.962665 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ef980-998d-4a05-8bc6-3018b3507fd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:46.964089 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ef980-998d-4a05-8bc6-3018b3507fd0 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:46.975565 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b45e03-2a00-4054-99ae-e1af856748a4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:46.979145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 802/1626] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:46.995797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d22ae-4e85-4d9f-829f-fbc22a583590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:46.997029 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d22ae-4e85-4d9f-829f-fbc22a583590 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:46.997310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d22ae-4e85-4d9f-829f-fbc22a583590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:46.997583 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d22ae-4e85-4d9f-829f-fbc22a583590 admin admin] PATH_INFO: `/v3/projects/9a4380a572fd49b495bb650f00a25670/users/fc320c402a4c4877a382125ff34ed54e/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:47.030622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d22ae-4e85-4d9f-829f-fbc22a583590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4380a572fd49b495bb650f00a25670, user_id=fc320c402a4c4877a382125ff34ed54e, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:47.033395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d22ae-4e85-4d9f-829f-fbc22a583590 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:47.058190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 825/1627] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:46 2022] PUT /identity/v3/projects/9a4380a572fd49b495bb650f00a25670/users/fc320c402a4c4877a382125ff34ed54e/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:47.063516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ef980-998d-4a05-8bc6-3018b3507fd0 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:47.077563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ef980-998d-4a05-8bc6-3018b3507fd0 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:47.126282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:47.180519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58def2b3-77a7-4d73-940c-35c0e8ccfa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:47.183295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58def2b3-77a7-4d73-940c-35c0e8ccfa47 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:47.183740 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58def2b3-77a7-4d73-940c-35c0e8ccfa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:47.184327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58def2b3-77a7-4d73-940c-35c0e8ccfa47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:47.185252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58def2b3-77a7-4d73-940c-35c0e8ccfa47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:47.187423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58def2b3-77a7-4d73-940c-35c0e8ccfa47 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:47.205878 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 803/1628] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:47.206256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d22ae-4e85-4d9f-829f-fbc22a583590 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:47.221544 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d22ae-4e85-4d9f-829f-fbc22a583590 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:47.239024 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b371417-e4e6-437e-b9cd-825ae4b63fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:47.240944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b371417-e4e6-437e-b9cd-825ae4b63fce admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:47.243019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b371417-e4e6-437e-b9cd-825ae4b63fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:47.243880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b371417-e4e6-437e-b9cd-825ae4b63fce admin admin] PATH_INFO: `/v3/projects/9a4380a572fd49b495bb650f00a25670/users/fc320c402a4c4877a382125ff34ed54e/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:47.248618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b371417-e4e6-437e-b9cd-825ae4b63fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4380a572fd49b495bb650f00a25670, user_id=fc320c402a4c4877a382125ff34ed54e, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:47.252265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b371417-e4e6-437e-b9cd-825ae4b63fce admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:47.294855 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 826/1629] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:47 2022] PUT /identity/v3/projects/9a4380a572fd49b495bb650f00a25670/users/fc320c402a4c4877a382125ff34ed54e/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:32:47.305211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a0a68-79e1-496a-87fc-11ba0fd7b758 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:47.305499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a0a68-79e1-496a-87fc-11ba0fd7b758 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:47.305818 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a0a68-79e1-496a-87fc-11ba0fd7b758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:47.416641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a89a0a68-79e1-496a-87fc-11ba0fd7b758 None None] MFA Rules not processed for user `fc320c402a4c4877a382125ff34ed54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:47.420221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a89a0a68-79e1-496a-87fc-11ba0fd7b758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:47.655393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 804/1630] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:47.662453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b371417-e4e6-437e-b9cd-825ae4b63fce admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:47.798592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b371417-e4e6-437e-b9cd-825ae4b63fce admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:47.803579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d84a7-a11e-4699-ac48-5793ad829547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:47.804228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d84a7-a11e-4699-ac48-5793ad829547 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:47.804556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d84a7-a11e-4699-ac48-5793ad829547 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:47.805109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d84a7-a11e-4699-ac48-5793ad829547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:47.821299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d84a7-a11e-4699-ac48-5793ad829547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:47.821299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d84a7-a11e-4699-ac48-5793ad829547 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:47.833186 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 827/1631] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:48.027799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a0a68-79e1-496a-87fc-11ba0fd7b758 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:48.042250 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a0a68-79e1-496a-87fc-11ba0fd7b758 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:48.050802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51f828-d208-46cb-a1a0-e3afacb6dd47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:48.053993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51f828-d208-46cb-a1a0-e3afacb6dd47 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:48.054276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51f828-d208-46cb-a1a0-e3afacb6dd47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:48.054550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51f828-d208-46cb-a1a0-e3afacb6dd47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:48.204670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51f828-d208-46cb-a1a0-e3afacb6dd47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:48.208521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51f828-d208-46cb-a1a0-e3afacb6dd47 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:48.232110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 805/1632] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:48.305873 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6980b7-2880-46ef-836b-75736aeaebba None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:48.306473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6980b7-2880-46ef-836b-75736aeaebba None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:48.306473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6980b7-2880-46ef-836b-75736aeaebba None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:48.308286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 828/1633] 10.222.0.15 () {54 vars in 962 bytes} [Sun Aug 7 22:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:32:48.316014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e7986-64e4-48af-874c-d73f35949fdc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:48.316352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e7986-64e4-48af-874c-d73f35949fdc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:48.316735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e7986-64e4-48af-874c-d73f35949fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:48.349191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ea0e7986-64e4-48af-874c-d73f35949fdc None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:48.350445 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ea0e7986-64e4-48af-874c-d73f35949fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:48.414031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:48.458312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 806/1634] 10.222.0.15 () {58 vars in 1059 bytes} [Sun Aug 7 22:32:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:48.472533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681013b2-5efb-4dec-8199-c0b564d36918 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:48.472875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681013b2-5efb-4dec-8199-c0b564d36918 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:48.473335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681013b2-5efb-4dec-8199-c0b564d36918 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:48.475037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 829/1635] 10.222.0.15 () {54 vars in 912 bytes} [Sun Aug 7 22:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:32:48.485283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9fc46-6699-41b9-ae45-05a072cf111c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:48.485690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9fc46-6699-41b9-ae45-05a072cf111c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:48.486494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9fc46-6699-41b9-ae45-05a072cf111c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:48.584090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-83d9fc46-6699-41b9-ae45-05a072cf111c None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:48.585702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-83d9fc46-6699-41b9-ae45-05a072cf111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:48.630070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 807/1636] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:32:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:48.655031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681013b2-5efb-4dec-8199-c0b564d36918 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:48.707250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681013b2-5efb-4dec-8199-c0b564d36918 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:48.721918 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31d6f3-1747-4431-a311-ef8097ed736b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:48.722454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d6f3-1747-4431-a311-ef8097ed736b service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:48.726815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d6f3-1747-4431-a311-ef8097ed736b service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:48.726815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d6f3-1747-4431-a311-ef8097ed736b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:48.754699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31d6f3-1747-4431-a311-ef8097ed736b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:48.756357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31d6f3-1747-4431-a311-ef8097ed736b service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:48.776561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 830/1637] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:50.686178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9fc46-6699-41b9-ae45-05a072cf111c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:50.829723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9fc46-6699-41b9-ae45-05a072cf111c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:50.838941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:50.841293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:50.841575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:50.843191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] PATH_INFO: `/v3/users/0a5bdba51d9446c18a096f421d27f71d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:50.846216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5bdba51d9446c18a096f421d27f71d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:50.848682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:32:50.848682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 07 22:32:50.848682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: Aug 07 22:32:50.852204 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:50.947938 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5bdba51d9446c18a096f421d27f71d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:50.982950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5bdba51d9446c18a096f421d27f71d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:50.982950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5bdba51d9446c18a096f421d27f71d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:50.982950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5bdba51d9446c18a096f421d27f71d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:51.017516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5bdba51d9446c18a096f421d27f71d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:51.037878 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 808/1638] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:32:50 2022] DELETE /identity/v3/users/0a5bdba51d9446c18a096f421d27f71d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:51.039474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b96ac-02d1-4b36-8c9e-638753a41fca None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:51.040265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b96ac-02d1-4b36-8c9e-638753a41fca None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:51.040669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b96ac-02d1-4b36-8c9e-638753a41fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:51.072252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-987b96ac-02d1-4b36-8c9e-638753a41fca None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:51.096646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-987b96ac-02d1-4b36-8c9e-638753a41fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:51.253491 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 831/1639] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:51.280447 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:51.282325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:51.401133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee1c62-3c18-448c-9bcf-e1651edb7cb4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:51.412665 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21ea0b-5516-432f-8255-f0cce3ee15ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:51.414071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21ea0b-5516-432f-8255-f0cce3ee15ff service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:51.414473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21ea0b-5516-432f-8255-f0cce3ee15ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:51.414852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21ea0b-5516-432f-8255-f0cce3ee15ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:51.428142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21ea0b-5516-432f-8255-f0cce3ee15ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:51.431284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21ea0b-5516-432f-8255-f0cce3ee15ff service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:51.441388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:51.454809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 809/1640] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:52.589988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b96ac-02d1-4b36-8c9e-638753a41fca None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:52.592059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-987b96ac-02d1-4b36-8c9e-638753a41fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:52.615890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b96ac-02d1-4b36-8c9e-638753a41fca None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:52.627538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:52.628187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:52.628462 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:52.628729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] PATH_INFO: `/v3/projects/cef380f240424ca392b826f8f0356654` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:52.629977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef380f240424ca392b826f8f0356654)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:52.631224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:32:52.631224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 07 22:32:52.631224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: Aug 07 22:32:52.632866 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:52.703471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=5,keystone:SELECT=94,keystone:DELETE=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:52.757928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef380f240424ca392b826f8f0356654', 'request_id': 'req-4a3db718-c7df-43da-814a-56a255209660'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:52.770912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef380f240424ca392b826f8f0356654', 'request_id': 'req-4a3db718-c7df-43da-814a-56a255209660'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:52.824353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef380f240424ca392b826f8f0356654', 'request_id': 'req-4a3db718-c7df-43da-814a-56a255209660'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:52.885358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] The token cache is being invalidate because project cef380f240424ca392b826f8f0356654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:32:52.885654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:52.887802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4a3db718-c7df-43da-814a-56a255209660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:52.896777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 832/1641] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:32:52 2022] DELETE /identity/v3/projects/cef380f240424ca392b826f8f0356654 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:52.898591 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3825-6208-4f2f-bd21-2cb3eec00a77 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:52.899921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3825-6208-4f2f-bd21-2cb3eec00a77 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:52.899921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3825-6208-4f2f-bd21-2cb3eec00a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:52.955057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cb4a3825-6208-4f2f-bd21-2cb3eec00a77 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:52.956342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cb4a3825-6208-4f2f-bd21-2cb3eec00a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:53.146179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 810/1642] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:53.161658 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d5d32-25c9-4089-a46d-c4b96fd5c260 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:53.162148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d5d32-25c9-4089-a46d-c4b96fd5c260 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:53.162648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d5d32-25c9-4089-a46d-c4b96fd5c260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:53.228779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-169d5d32-25c9-4089-a46d-c4b96fd5c260 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:53.233252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-169d5d32-25c9-4089-a46d-c4b96fd5c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:53.264220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 833/1643] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:53.265652 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a3825-6208-4f2f-bd21-2cb3eec00a77 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:53.291958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a3825-6208-4f2f-bd21-2cb3eec00a77 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:53.315487 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee4858-5796-4e10-b454-dab881b7f7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:53.316044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee4858-5796-4e10-b454-dab881b7f7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:53.316423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee4858-5796-4e10-b454-dab881b7f7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:53.317157 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee4858-5796-4e10-b454-dab881b7f7f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:53.318235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee4858-5796-4e10-b454-dab881b7f7f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:32:53.318567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee4858-5796-4e10-b454-dab881b7f7f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:53.323244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee4858-5796-4e10-b454-dab881b7f7f0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:53.369767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 811/1644] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:32:53.373034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d5d32-25c9-4089-a46d-c4b96fd5c260 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:53.386460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d5d32-25c9-4089-a46d-c4b96fd5c260 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:53.423934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b684ff-6e4b-4025-b00d-fefacb0094db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:53.424843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b684ff-6e4b-4025-b00d-fefacb0094db admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:53.425614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b684ff-6e4b-4025-b00d-fefacb0094db admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:53.426098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b684ff-6e4b-4025-b00d-fefacb0094db admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:53.429499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b684ff-6e4b-4025-b00d-fefacb0094db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:53.432557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b684ff-6e4b-4025-b00d-fefacb0094db admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:53.509359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 834/1645] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:32:53 2022] POST /identity/v3/projects => generated 361 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:53.514069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee4858-5796-4e10-b454-dab881b7f7f0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:53.533789 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee4858-5796-4e10-b454-dab881b7f7f0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:53.681203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611f35f-2446-4efe-90b0-54d6d3fba817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:53.682611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611f35f-2446-4efe-90b0-54d6d3fba817 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:53.684618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611f35f-2446-4efe-90b0-54d6d3fba817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:53.685804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611f35f-2446-4efe-90b0-54d6d3fba817 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:53.688585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611f35f-2446-4efe-90b0-54d6d3fba817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:53.693282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611f35f-2446-4efe-90b0-54d6d3fba817 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:53.774305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 812/1646] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:32:53 2022] POST /identity/v3/users => generated 281 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:53.778232 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b684ff-6e4b-4025-b00d-fefacb0094db admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:53.793954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b684ff-6e4b-4025-b00d-fefacb0094db admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:53.818154 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558286e-b3ad-4e6b-9b22-25dc5f4c63a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:53.818785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558286e-b3ad-4e6b-9b22-25dc5f4c63a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:53.819201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558286e-b3ad-4e6b-9b22-25dc5f4c63a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:53.819394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558286e-b3ad-4e6b-9b22-25dc5f4c63a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:53.820003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558286e-b3ad-4e6b-9b22-25dc5f4c63a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:53.821597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558286e-b3ad-4e6b-9b22-25dc5f4c63a0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:53.859189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 835/1647] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:53.861387 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611f35f-2446-4efe-90b0-54d6d3fba817 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:53.876145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611f35f-2446-4efe-90b0-54d6d3fba817 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:53.893605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49890f7-167e-4d06-9c3d-154f3b085a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:53.894227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49890f7-167e-4d06-9c3d-154f3b085a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:53.894634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49890f7-167e-4d06-9c3d-154f3b085a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:53.894804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49890f7-167e-4d06-9c3d-154f3b085a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:53.903494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49890f7-167e-4d06-9c3d-154f3b085a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:53.905151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49890f7-167e-4d06-9c3d-154f3b085a56 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:53.937996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 813/1648] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:53.940526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558286e-b3ad-4e6b-9b22-25dc5f4c63a0 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:53.958896 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558286e-b3ad-4e6b-9b22-25dc5f4c63a0 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:53.994208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8158-b842-4446-ad9d-0c3dc8298b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:53.995303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8158-b842-4446-ad9d-0c3dc8298b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:53.995779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8158-b842-4446-ad9d-0c3dc8298b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:53.996198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8158-b842-4446-ad9d-0c3dc8298b31 admin admin] PATH_INFO: `/v3/projects/52fc7d7f8ef94d1c93b472157a24d6ae/users/e320a4fc89b84854a4b376f8dd25c6bc/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:54.034283 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f8158-b842-4446-ad9d-0c3dc8298b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fc7d7f8ef94d1c93b472157a24d6ae, user_id=e320a4fc89b84854a4b376f8dd25c6bc, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:54.041939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f8158-b842-4446-ad9d-0c3dc8298b31 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:54.080171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 836/1649] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:53 2022] PUT /identity/v3/projects/52fc7d7f8ef94d1c93b472157a24d6ae/users/e320a4fc89b84854a4b376f8dd25c6bc/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:32:54.090789 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036b418-ec15-4f75-a039-c0ccf27391dd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:54.091332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036b418-ec15-4f75-a039-c0ccf27391dd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:54.091758 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036b418-ec15-4f75-a039-c0ccf27391dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:54.192809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5036b418-ec15-4f75-a039-c0ccf27391dd None None] MFA Rules not processed for user `e320a4fc89b84854a4b376f8dd25c6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:54.196068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5036b418-ec15-4f75-a039-c0ccf27391dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:54.390643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:54.437746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 814/1650] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:54.438645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8158-b842-4446-ad9d-0c3dc8298b31 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:54.669934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8158-b842-4446-ad9d-0c3dc8298b31 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:54.692790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2a971-6249-4e8f-833f-b896669ad7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:54.693808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2a971-6249-4e8f-833f-b896669ad7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:54.694228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2a971-6249-4e8f-833f-b896669ad7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:54.694752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2a971-6249-4e8f-833f-b896669ad7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:54.695617 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2a971-6249-4e8f-833f-b896669ad7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:54.699348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2a971-6249-4e8f-833f-b896669ad7a5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:54.753359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 837/1651] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:32:54 2022] POST /identity/v3/projects => generated 365 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:32:54.757010 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036b418-ec15-4f75-a039-c0ccf27391dd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:54.782111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036b418-ec15-4f75-a039-c0ccf27391dd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:54.911792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea731f9e-5539-4b43-a4e1-c71b722ba5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:54.912730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea731f9e-5539-4b43-a4e1-c71b722ba5be admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:54.912892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea731f9e-5539-4b43-a4e1-c71b722ba5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:54.913355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea731f9e-5539-4b43-a4e1-c71b722ba5be admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:54.914051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea731f9e-5539-4b43-a4e1-c71b722ba5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:54.916569 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea731f9e-5539-4b43-a4e1-c71b722ba5be admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:54.995173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2a971-6249-4e8f-833f-b896669ad7a5 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:54.996879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 815/1652] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:32:54 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:32:55.014308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2a971-6249-4e8f-833f-b896669ad7a5 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:55.038001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b389932-8efd-41d6-8c8b-3ae18a90f7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:55.039015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b389932-8efd-41d6-8c8b-3ae18a90f7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:55.039560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b389932-8efd-41d6-8c8b-3ae18a90f7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:55.040353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b389932-8efd-41d6-8c8b-3ae18a90f7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:55.041225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b389932-8efd-41d6-8c8b-3ae18a90f7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:55.051360 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b389932-8efd-41d6-8c8b-3ae18a90f7ea admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:55.071440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea731f9e-5539-4b43-a4e1-c71b722ba5be admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:55.085244 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 838/1653] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:55.089528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea731f9e-5539-4b43-a4e1-c71b722ba5be admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:55.099407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c635a32-ad88-4333-a5a1-1682b5ef8dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:55.100622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c635a32-ad88-4333-a5a1-1682b5ef8dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:55.101249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c635a32-ad88-4333-a5a1-1682b5ef8dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:55.101861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c635a32-ad88-4333-a5a1-1682b5ef8dc9 admin admin] PATH_INFO: `/v3/projects/7fa4ba65431b43c1a8c74c491fd360ed/users/2ff5d56aaa7843eda0eae58fb7b950b0/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:55.130602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c635a32-ad88-4333-a5a1-1682b5ef8dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa4ba65431b43c1a8c74c491fd360ed, user_id=2ff5d56aaa7843eda0eae58fb7b950b0, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:55.138195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c635a32-ad88-4333-a5a1-1682b5ef8dc9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:55.176088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b389932-8efd-41d6-8c8b-3ae18a90f7ea admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:55.206347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 816/1654] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:55 2022] PUT /identity/v3/projects/7fa4ba65431b43c1a8c74c491fd360ed/users/2ff5d56aaa7843eda0eae58fb7b950b0/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:55.213098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b389932-8efd-41d6-8c8b-3ae18a90f7ea admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:55.260141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:55.372577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804511ac-1833-42c4-b385-7b055f3eecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:55.373303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804511ac-1833-42c4-b385-7b055f3eecee admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:55.373648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804511ac-1833-42c4-b385-7b055f3eecee admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:55.374068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804511ac-1833-42c4-b385-7b055f3eecee admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:55.374791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804511ac-1833-42c4-b385-7b055f3eecee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:55.377999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804511ac-1833-42c4-b385-7b055f3eecee admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:55.412240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c635a32-ad88-4333-a5a1-1682b5ef8dc9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:55.425987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c635a32-ad88-4333-a5a1-1682b5ef8dc9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:55.426486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 839/1655] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:32:55.457646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5267754-9959-4c93-8982-87e74784dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:55.458403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5267754-9959-4c93-8982-87e74784dde0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:55.460049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5267754-9959-4c93-8982-87e74784dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:55.460345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5267754-9959-4c93-8982-87e74784dde0 admin admin] PATH_INFO: `/v3/projects/7fa4ba65431b43c1a8c74c491fd360ed/users/2ff5d56aaa7843eda0eae58fb7b950b0/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:55.463847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5267754-9959-4c93-8982-87e74784dde0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa4ba65431b43c1a8c74c491fd360ed, user_id=2ff5d56aaa7843eda0eae58fb7b950b0, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:55.467617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5267754-9959-4c93-8982-87e74784dde0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:55.502755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc97c29-9642-4aed-b8fd-f0fcac5fb74b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:55.505263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc97c29-9642-4aed-b8fd-f0fcac5fb74b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:55.505805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc97c29-9642-4aed-b8fd-f0fcac5fb74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:55.505913 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 817/1656] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:32:55 2022] PUT /identity/v3/projects/7fa4ba65431b43c1a8c74c491fd360ed/users/2ff5d56aaa7843eda0eae58fb7b950b0/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:32:55.566804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1fc97c29-9642-4aed-b8fd-f0fcac5fb74b None None] MFA Rules not processed for user `2ff5d56aaa7843eda0eae58fb7b950b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:55.568337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1fc97c29-9642-4aed-b8fd-f0fcac5fb74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:55.696717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 840/1657] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:55.703813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5267754-9959-4c93-8982-87e74784dde0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:55.707364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e5267754-9959-4c93-8982-87e74784dde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:55.913463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5267754-9959-4c93-8982-87e74784dde0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:55.929580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4ecea-a905-4624-be6a-9bb3086a5c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:55.932121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4ecea-a905-4624-be6a-9bb3086a5c46 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:55.933413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4ecea-a905-4624-be6a-9bb3086a5c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:55.934430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4ecea-a905-4624-be6a-9bb3086a5c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:55.962100 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4ecea-a905-4624-be6a-9bb3086a5c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:55.964208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4ecea-a905-4624-be6a-9bb3086a5c46 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:56.006024 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 818/1658] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:32:56.149129 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc97c29-9642-4aed-b8fd-f0fcac5fb74b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:56.158937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc97c29-9642-4aed-b8fd-f0fcac5fb74b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:56.170486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de5ea4-f001-49c7-b66d-69490395aba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:56.171110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de5ea4-f001-49c7-b66d-69490395aba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:56.180315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de5ea4-f001-49c7-b66d-69490395aba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:56.180741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de5ea4-f001-49c7-b66d-69490395aba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:56.317953 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de5ea4-f001-49c7-b66d-69490395aba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:56.321906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de5ea4-f001-49c7-b66d-69490395aba6 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:56.351070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 841/1659] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:32:58.283339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4ecea-a905-4624-be6a-9bb3086a5c46 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:58.286563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b7b4ecea-a905-4624-be6a-9bb3086a5c46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:58.471173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:58.546185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4ecea-a905-4624-be6a-9bb3086a5c46 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:58.558084 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:58.562414 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:58.562966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:58.563309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] PATH_INFO: `/v3/users/3aae02d5da9a405e8683586ff9793d89` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:58.567324 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aae02d5da9a405e8683586ff9793d89)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:58.572810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:58.722489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aae02d5da9a405e8683586ff9793d89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:58.738068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aae02d5da9a405e8683586ff9793d89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:58.738928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aae02d5da9a405e8683586ff9793d89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:58.739865 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aae02d5da9a405e8683586ff9793d89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:58.774614 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aae02d5da9a405e8683586ff9793d89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:32:58.814307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 819/1660] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:32:58 2022] DELETE /identity/v3/users/3aae02d5da9a405e8683586ff9793d89 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:32:58.819149 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd68e85-1226-4975-8e5d-4fd50ff0a159 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:58.819995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd68e85-1226-4975-8e5d-4fd50ff0a159 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:58.820487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd68e85-1226-4975-8e5d-4fd50ff0a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:58.872188 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6dd68e85-1226-4975-8e5d-4fd50ff0a159 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:32:58.873602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6dd68e85-1226-4975-8e5d-4fd50ff0a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:59.036403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:59.114567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 842/1661] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:32:59.149054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:32:59.151375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:32:59.361358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c1d90-8dcc-48b0-a239-08f6bee124d6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:32:59.369611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bf7bf-71da-44c1-a912-6427ddc23e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:32:59.371034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bf7bf-71da-44c1-a912-6427ddc23e00 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:32:59.372037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bf7bf-71da-44c1-a912-6427ddc23e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:32:59.373887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bf7bf-71da-44c1-a912-6427ddc23e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:32:59.402304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bf7bf-71da-44c1-a912-6427ddc23e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:32:59.407801 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bf7bf-71da-44c1-a912-6427ddc23e00 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:32:59.443995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 820/1662] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:00.192326 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddace4-f0df-40bc-910b-56f9d1a75172 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:00.193312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddace4-f0df-40bc-910b-56f9d1a75172 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:00.194074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddace4-f0df-40bc-910b-56f9d1a75172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:00.288052 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f0ddace4-f0df-40bc-910b-56f9d1a75172 None None] MFA Rules not processed for user `aff5308e6cb94622853075a723d54a67`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:00.289276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f0ddace4-f0df-40bc-910b-56f9d1a75172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:00.516224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 843/1663] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:00.535792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bf7bf-71da-44c1-a912-6427ddc23e00 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:00.538411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5f7bf7bf-71da-44c1-a912-6427ddc23e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:00.838896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bf7bf-71da-44c1-a912-6427ddc23e00 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:00.859740 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e71417-b869-4f60-8587-d681d6cc6be3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:00.860382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71417-b869-4f60-8587-d681d6cc6be3 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:00.862247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71417-b869-4f60-8587-d681d6cc6be3 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:00.862662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71417-b869-4f60-8587-d681d6cc6be3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:00.885932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:00.906633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e71417-b869-4f60-8587-d681d6cc6be3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:00.909541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e71417-b869-4f60-8587-d681d6cc6be3 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:00.955689 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 821/1664] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:01.930056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddace4-f0df-40bc-910b-56f9d1a75172 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:01.931971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f0ddace4-f0df-40bc-910b-56f9d1a75172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:01.964610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddace4-f0df-40bc-910b-56f9d1a75172 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:01.981397 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f18525-3102-4d25-a0da-f7a657bd3410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:01.982197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f18525-3102-4d25-a0da-f7a657bd3410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:01.982600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f18525-3102-4d25-a0da-f7a657bd3410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:01.982940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f18525-3102-4d25-a0da-f7a657bd3410 admin admin] PATH_INFO: `/v3/projects/f5bf65dde00848d4864461e5538a7d00` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:01.995890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f18525-3102-4d25-a0da-f7a657bd3410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5bf65dde00848d4864461e5538a7d00)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:01.998000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f18525-3102-4d25-a0da-f7a657bd3410 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:02.131950 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-96f18525-3102-4d25-a0da-f7a657bd3410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5bf65dde00848d4864461e5538a7d00', 'request_id': 'req-96f18525-3102-4d25-a0da-f7a657bd3410'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:02.142728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-96f18525-3102-4d25-a0da-f7a657bd3410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5bf65dde00848d4864461e5538a7d00', 'request_id': 'req-96f18525-3102-4d25-a0da-f7a657bd3410'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:02.153019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-96f18525-3102-4d25-a0da-f7a657bd3410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5bf65dde00848d4864461e5538a7d00', 'request_id': 'req-96f18525-3102-4d25-a0da-f7a657bd3410'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:02.187851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-96f18525-3102-4d25-a0da-f7a657bd3410 admin admin] The token cache is being invalidate because project f5bf65dde00848d4864461e5538a7d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:02.188285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-96f18525-3102-4d25-a0da-f7a657bd3410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:02.189554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-96f18525-3102-4d25-a0da-f7a657bd3410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:02.195689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 844/1665] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:01 2022] DELETE /identity/v3/projects/f5bf65dde00848d4864461e5538a7d00 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:02.197091 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b00733-d371-45dc-a547-0137669fd5b0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:02.197634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b00733-d371-45dc-a547-0137669fd5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:02.197634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b00733-d371-45dc-a547-0137669fd5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:02.239012 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-61b00733-d371-45dc-a547-0137669fd5b0 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:02.241640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-61b00733-d371-45dc-a547-0137669fd5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:02.402033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 822/1666] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:02.412021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5351b-c1dc-4197-87a0-4ed6bc54f019 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:02.412413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5351b-c1dc-4197-87a0-4ed6bc54f019 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:02.412781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5351b-c1dc-4197-87a0-4ed6bc54f019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:02.457664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-9cb5351b-c1dc-4197-87a0-4ed6bc54f019 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:02.461582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9cb5351b-c1dc-4197-87a0-4ed6bc54f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:02.491317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 845/1667] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:02.493304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b00733-d371-45dc-a547-0137669fd5b0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:02.514973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b00733-d371-45dc-a547-0137669fd5b0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:02.536650 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffa01b-66fd-45f2-86eb-9b40bbca8681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:02.537316 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffa01b-66fd-45f2-86eb-9b40bbca8681 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:02.537596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffa01b-66fd-45f2-86eb-9b40bbca8681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:02.537867 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffa01b-66fd-45f2-86eb-9b40bbca8681 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:02.538825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffa01b-66fd-45f2-86eb-9b40bbca8681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:02.538825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffa01b-66fd-45f2-86eb-9b40bbca8681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:02.540621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffa01b-66fd-45f2-86eb-9b40bbca8681 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:02.603882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5351b-c1dc-4197-87a0-4ed6bc54f019 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:02.607603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 823/1668] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:33:02.616678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5351b-c1dc-4197-87a0-4ed6bc54f019 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:02.628094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a5a3e-030c-46f5-bfa8-7c24d18ea62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:02.630058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a5a3e-030c-46f5-bfa8-7c24d18ea62a admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:02.639517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a5a3e-030c-46f5-bfa8-7c24d18ea62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:02.639748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a5a3e-030c-46f5-bfa8-7c24d18ea62a admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:02.640600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a5a3e-030c-46f5-bfa8-7c24d18ea62a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:02.642705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a5a3e-030c-46f5-bfa8-7c24d18ea62a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:02.737174 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 846/1669] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:02 2022] POST /identity/v3/projects => generated 405 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:02.741392 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffa01b-66fd-45f2-86eb-9b40bbca8681 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:02.762828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffa01b-66fd-45f2-86eb-9b40bbca8681 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:02.942593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9771a92-b182-4dfb-b4ef-9b2d6694efd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:02.947920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9771a92-b182-4dfb-b4ef-9b2d6694efd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:02.948646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9771a92-b182-4dfb-b4ef-9b2d6694efd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:02.949111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9771a92-b182-4dfb-b4ef-9b2d6694efd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:02.950147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9771a92-b182-4dfb-b4ef-9b2d6694efd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:02.952488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9771a92-b182-4dfb-b4ef-9b2d6694efd5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:03.031024 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 824/1670] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:02 2022] POST /identity/v3/users => generated 303 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:03.035585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a5a3e-030c-46f5-bfa8-7c24d18ea62a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:03.049978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a5a3e-030c-46f5-bfa8-7c24d18ea62a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:03.058595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcb3bb-8cc6-4bec-bcc0-d2d9fd14a958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:03.059803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcb3bb-8cc6-4bec-bcc0-d2d9fd14a958 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:03.060084 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcb3bb-8cc6-4bec-bcc0-d2d9fd14a958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:03.060357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcb3bb-8cc6-4bec-bcc0-d2d9fd14a958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:03.065398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcb3bb-8cc6-4bec-bcc0-d2d9fd14a958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:03.065743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcb3bb-8cc6-4bec-bcc0-d2d9fd14a958 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:03.106281 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 847/1671] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:03.110086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9771a92-b182-4dfb-b4ef-9b2d6694efd5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:03.143056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9771a92-b182-4dfb-b4ef-9b2d6694efd5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:03.155937 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed807e-07d6-4816-a269-e508fb68232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:03.156713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed807e-07d6-4816-a269-e508fb68232e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:03.156995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed807e-07d6-4816-a269-e508fb68232e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:03.157269 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed807e-07d6-4816-a269-e508fb68232e admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:03.157940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed807e-07d6-4816-a269-e508fb68232e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:03.162313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed807e-07d6-4816-a269-e508fb68232e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:03.206576 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 825/1672] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:03.210817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcb3bb-8cc6-4bec-bcc0-d2d9fd14a958 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:03.228776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcb3bb-8cc6-4bec-bcc0-d2d9fd14a958 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:03.250872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9a102-5fe2-4ffc-92ae-02bc614f41b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:03.252183 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9a102-5fe2-4ffc-92ae-02bc614f41b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:03.252474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9a102-5fe2-4ffc-92ae-02bc614f41b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:03.252750 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9a102-5fe2-4ffc-92ae-02bc614f41b7 admin admin] PATH_INFO: `/v3/projects/bd8e10599a184752b83c061f50dea19b/users/b54170da57894221a0f52833e6344663/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:03.298211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9a102-5fe2-4ffc-92ae-02bc614f41b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8e10599a184752b83c061f50dea19b, user_id=b54170da57894221a0f52833e6344663, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:03.300955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9a102-5fe2-4ffc-92ae-02bc614f41b7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:03.314127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:03.346119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 848/1673] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:03 2022] PUT /identity/v3/projects/bd8e10599a184752b83c061f50dea19b/users/b54170da57894221a0f52833e6344663/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:03.351130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb478eae-ef5f-4099-9711-7c9575c3939c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:03.351484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb478eae-ef5f-4099-9711-7c9575c3939c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:03.351865 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb478eae-ef5f-4099-9711-7c9575c3939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:03.410774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-eb478eae-ef5f-4099-9711-7c9575c3939c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:03.415189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-eb478eae-ef5f-4099-9711-7c9575c3939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:03.596024 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 826/1674] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:03.642232 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9a102-5fe2-4ffc-92ae-02bc614f41b7 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:03.645063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-eae9a102-5fe2-4ffc-92ae-02bc614f41b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:03.828515 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9a102-5fe2-4ffc-92ae-02bc614f41b7 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:03.845191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302531d-a689-4bb6-9d22-6f6590b6d053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:03.846190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302531d-a689-4bb6-9d22-6f6590b6d053 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:03.846695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302531d-a689-4bb6-9d22-6f6590b6d053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:03.847205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302531d-a689-4bb6-9d22-6f6590b6d053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:03.889207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302531d-a689-4bb6-9d22-6f6590b6d053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:03.890840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302531d-a689-4bb6-9d22-6f6590b6d053 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:03.921477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 849/1675] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:04.516245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa5d6-169b-4246-8bfb-5c9fe58d337b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:04.516841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa5d6-169b-4246-8bfb-5c9fe58d337b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:04.517416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa5d6-169b-4246-8bfb-5c9fe58d337b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:04.537353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:04.595945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-caafa5d6-169b-4246-8bfb-5c9fe58d337b None None] MFA Rules not processed for user `ccb8ac5aaec44417bd6aaa4a2b1aca11`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:04.597712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-caafa5d6-169b-4246-8bfb-5c9fe58d337b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:04.832687 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 827/1676] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:04.843756 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9defc-d9ac-4473-b798-d2bd5ea9ab5f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:04.845257 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9defc-d9ac-4473-b798-d2bd5ea9ab5f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:04.846072 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9defc-d9ac-4473-b798-d2bd5ea9ab5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:04.912301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-93f9defc-d9ac-4473-b798-d2bd5ea9ab5f None None] MFA Rules not processed for user `ccb8ac5aaec44417bd6aaa4a2b1aca11`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:04.914118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-93f9defc-d9ac-4473-b798-d2bd5ea9ab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:04.936320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 850/1677] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:04.946694 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafa5d6-169b-4246-8bfb-5c9fe58d337b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:04.949571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-caafa5d6-169b-4246-8bfb-5c9fe58d337b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:05.133736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafa5d6-169b-4246-8bfb-5c9fe58d337b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:05.151226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63231800-f100-4939-8bc8-89f501c09263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:05.153026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63231800-f100-4939-8bc8-89f501c09263 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:05.153645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63231800-f100-4939-8bc8-89f501c09263 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:05.154322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63231800-f100-4939-8bc8-89f501c09263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:05.166455 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9defc-d9ac-4473-b798-d2bd5ea9ab5f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:05.167964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-93f9defc-d9ac-4473-b798-d2bd5ea9ab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:05.174386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63231800-f100-4939-8bc8-89f501c09263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:05.177314 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63231800-f100-4939-8bc8-89f501c09263 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:05.191022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 828/1678] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:05.204225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9defc-d9ac-4473-b798-d2bd5ea9ab5f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:05.222260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:05.223245 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:05.227312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:05.231652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] PATH_INFO: `/v3/users/e320a4fc89b84854a4b376f8dd25c6bc` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:05.233853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e320a4fc89b84854a4b376f8dd25c6bc)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:05.246596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:05.383443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e320a4fc89b84854a4b376f8dd25c6bc'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:05.412862 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e320a4fc89b84854a4b376f8dd25c6bc'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:05.430847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e320a4fc89b84854a4b376f8dd25c6bc'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:05.431755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e320a4fc89b84854a4b376f8dd25c6bc'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:05.457318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e320a4fc89b84854a4b376f8dd25c6bc'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:05.464339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 851/1679] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:05 2022] DELETE /identity/v3/users/e320a4fc89b84854a4b376f8dd25c6bc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:05.469645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6ffa0-daad-44f3-bd29-56534317bbbc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:05.470046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6ffa0-daad-44f3-bd29-56534317bbbc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:05.470241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6ffa0-daad-44f3-bd29-56534317bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:05.500493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-eda6ffa0-daad-44f3-bd29-56534317bbbc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:05.505534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-eda6ffa0-daad-44f3-bd29-56534317bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:05.656686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 829/1680] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:05.758790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:05.763769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:05.973792 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed822cc-0214-4a7c-80d3-3ffa1adfb919 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:05.982625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95591d9-dc2d-4b1a-8acd-d162557f6ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:05.983523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95591d9-dc2d-4b1a-8acd-d162557f6ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:05.983653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95591d9-dc2d-4b1a-8acd-d162557f6ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:05.983827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95591d9-dc2d-4b1a-8acd-d162557f6ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:06.021697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95591d9-dc2d-4b1a-8acd-d162557f6ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:06.023575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95591d9-dc2d-4b1a-8acd-d162557f6ea1 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:06.045111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 852/1681] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:06.420108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee43d7-634b-428e-ae88-a96630579879 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:06.420391 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee43d7-634b-428e-ae88-a96630579879 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:06.420661 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee43d7-634b-428e-ae88-a96630579879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:06.457285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656fb9e-8c0b-47c3-8203-53cb5a6aa366 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:06.457569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656fb9e-8c0b-47c3-8203-53cb5a6aa366 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:06.457844 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656fb9e-8c0b-47c3-8203-53cb5a6aa366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:06.479173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:06.488767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f1ee43d7-634b-428e-ae88-a96630579879 None None] MFA Rules not processed for user `411b1c674ef24c2bab146208d720c0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:06.490213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f1ee43d7-634b-428e-ae88-a96630579879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:06.509922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:06.531528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4656fb9e-8c0b-47c3-8203-53cb5a6aa366 None None] MFA Rules not processed for user `51e200b8d8c443d5912756bf1d04a82d`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:06.532876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4656fb9e-8c0b-47c3-8203-53cb5a6aa366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:06.719574 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 830/1682] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:06.740026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee43d7-634b-428e-ae88-a96630579879 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:06.741965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f1ee43d7-634b-428e-ae88-a96630579879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:06.770132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 853/1683] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:06.774650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336352f-ccea-4d2e-8987-803df037c2e1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:06.782421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336352f-ccea-4d2e-8987-803df037c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:06.787641 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336352f-ccea-4d2e-8987-803df037c2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:06.853374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f336352f-ccea-4d2e-8987-803df037c2e1 None None] MFA Rules not processed for user `b54170da57894221a0f52833e6344663`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:06.858478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f336352f-ccea-4d2e-8987-803df037c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:06.930663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee43d7-634b-428e-ae88-a96630579879 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:06.948383 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9144e70-7abe-416a-b2b0-aa659e83ec04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:06.949233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9144e70-7abe-416a-b2b0-aa659e83ec04 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:06.950190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9144e70-7abe-416a-b2b0-aa659e83ec04 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:06.950631 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9144e70-7abe-416a-b2b0-aa659e83ec04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:06.969868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9144e70-7abe-416a-b2b0-aa659e83ec04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:06.971826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9144e70-7abe-416a-b2b0-aa659e83ec04 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:07.011287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 831/1684] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:07.022026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6f70e-79ee-4f74-8f67-d42858dabea1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:07.022482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6f70e-79ee-4f74-8f67-d42858dabea1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:07.022916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6f70e-79ee-4f74-8f67-d42858dabea1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:07.025055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 832/1685] 10.222.0.15 () {54 vars in 912 bytes} [Sun Aug 7 22:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:33:07.041268 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a2f2b-c61e-4079-974e-91dc70464c74 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:07.041836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a2f2b-c61e-4079-974e-91dc70464c74 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:07.042286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a2f2b-c61e-4079-974e-91dc70464c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:07.067505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 854/1686] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:06 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:07.072218 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336352f-ccea-4d2e-8987-803df037c2e1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:07.073628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f336352f-ccea-4d2e-8987-803df037c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:07.109632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336352f-ccea-4d2e-8987-803df037c2e1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:07.135579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f478382-214f-4c4a-accb-e4e0fcc1cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:07.148079 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0d5a2f2b-c61e-4079-974e-91dc70464c74 None None] MFA Rules not processed for user `8c68d5fdc4a946499ae86cdff0149470`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:07.149590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f478382-214f-4c4a-accb-e4e0fcc1cb59 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:07.150239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f478382-214f-4c4a-accb-e4e0fcc1cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:07.150653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f478382-214f-4c4a-accb-e4e0fcc1cb59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:07.151495 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f478382-214f-4c4a-accb-e4e0fcc1cb59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:07.153691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0d5a2f2b-c61e-4079-974e-91dc70464c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:07.158815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f478382-214f-4c4a-accb-e4e0fcc1cb59 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:07.174703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 833/1687] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:33:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:07.193748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a2f2b-c61e-4079-974e-91dc70464c74 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:07.230613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a2f2b-c61e-4079-974e-91dc70464c74 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:07.243790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521464a-015e-4cdc-940e-3fb36910e716 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:07.246419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521464a-015e-4cdc-940e-3fb36910e716 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:07.246800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521464a-015e-4cdc-940e-3fb36910e716 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:07.247391 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521464a-015e-4cdc-940e-3fb36910e716 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:07.267197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 855/1688] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:07 2022] POST /identity/v3/projects => generated 403 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:07.272039 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f478382-214f-4c4a-accb-e4e0fcc1cb59 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:07.273243 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521464a-015e-4cdc-940e-3fb36910e716 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:07.274956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521464a-015e-4cdc-940e-3fb36910e716 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:07.304359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 834/1689] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:33:07.390418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521464a-015e-4cdc-940e-3fb36910e716 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:07.402949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521464a-015e-4cdc-940e-3fb36910e716 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:07.418939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f478382-214f-4c4a-accb-e4e0fcc1cb59 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:07.430991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79d48c-e698-4964-b36a-4e76db466548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:07.433686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79d48c-e698-4964-b36a-4e76db466548 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:07.450678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79d48c-e698-4964-b36a-4e76db466548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:07.451071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79d48c-e698-4964-b36a-4e76db466548 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:07.464151 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79d48c-e698-4964-b36a-4e76db466548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:07.466937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79d48c-e698-4964-b36a-4e76db466548 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:07.481531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:07.517014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 856/1690] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:07 2022] POST /identity/v3/users => generated 308 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:07.520735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79d48c-e698-4964-b36a-4e76db466548 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:07.541887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79d48c-e698-4964-b36a-4e76db466548 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:07.548757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d0c1d-55f8-4eca-a8c6-532b112e8b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:07.549751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d0c1d-55f8-4eca-a8c6-532b112e8b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:07.550035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d0c1d-55f8-4eca-a8c6-532b112e8b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:07.550305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d0c1d-55f8-4eca-a8c6-532b112e8b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:07.550968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d0c1d-55f8-4eca-a8c6-532b112e8b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:07.552906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d0c1d-55f8-4eca-a8c6-532b112e8b5f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:07.563492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145f955-b32c-4523-b7d5-385278a50a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:07.564245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145f955-b32c-4523-b7d5-385278a50a50 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:07.564422 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145f955-b32c-4523-b7d5-385278a50a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:07.564736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145f955-b32c-4523-b7d5-385278a50a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:07.568587 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 857/1691] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:07.574300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d0c1d-55f8-4eca-a8c6-532b112e8b5f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:07.583416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145f955-b32c-4523-b7d5-385278a50a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:07.584878 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145f955-b32c-4523-b7d5-385278a50a50 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:07.611784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d0c1d-55f8-4eca-a8c6-532b112e8b5f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:07.616119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 835/1692] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:07.621086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea421da-3f3d-4639-9a7c-8273bbffa767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:07.622180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea421da-3f3d-4639-9a7c-8273bbffa767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:07.622835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea421da-3f3d-4639-9a7c-8273bbffa767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:07.623348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea421da-3f3d-4639-9a7c-8273bbffa767 admin admin] PATH_INFO: `/v3/projects/58c2fb09361745d8b39c8b1e1033bcea/users/94b464de5cc44f5b84bf2bb7d4ad3443/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:07.669198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea421da-3f3d-4639-9a7c-8273bbffa767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c2fb09361745d8b39c8b1e1033bcea, user_id=94b464de5cc44f5b84bf2bb7d4ad3443, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:07.672260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea421da-3f3d-4639-9a7c-8273bbffa767 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:07.703728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 858/1693] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:07 2022] PUT /identity/v3/projects/58c2fb09361745d8b39c8b1e1033bcea/users/94b464de5cc44f5b84bf2bb7d4ad3443/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:07.708446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145f955-b32c-4523-b7d5-385278a50a50 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:07.718325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:07.734336 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145f955-b32c-4523-b7d5-385278a50a50 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:07.946315 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48c4b5-1389-4992-9212-9bbd3925fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:07.948646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48c4b5-1389-4992-9212-9bbd3925fa21 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:07.948995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48c4b5-1389-4992-9212-9bbd3925fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:07.949884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48c4b5-1389-4992-9212-9bbd3925fa21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:07.960215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48c4b5-1389-4992-9212-9bbd3925fa21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:07.964423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48c4b5-1389-4992-9212-9bbd3925fa21 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:07.988023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f0c0a-c32c-437c-bead-b40a765dcfd2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:07.988662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f0c0a-c32c-437c-bead-b40a765dcfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:07.989060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f0c0a-c32c-437c-bead-b40a765dcfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:07.990390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 836/1694] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:07.993308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48c4b5-1389-4992-9212-9bbd3925fa21 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:08.016517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48c4b5-1389-4992-9212-9bbd3925fa21 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:08.035476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6a635-1233-4089-829f-ce1716785e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:08.036758 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6a635-1233-4089-829f-ce1716785e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:08.037106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6a635-1233-4089-829f-ce1716785e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:08.037456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6a635-1233-4089-829f-ce1716785e7f admin admin] PATH_INFO: `/v3/projects/58c2fb09361745d8b39c8b1e1033bcea/users/94b464de5cc44f5b84bf2bb7d4ad3443/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:08.041155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6a635-1233-4089-829f-ce1716785e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c2fb09361745d8b39c8b1e1033bcea, user_id=94b464de5cc44f5b84bf2bb7d4ad3443, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:08.044346 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6a635-1233-4089-829f-ce1716785e7f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:08.057459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0c8f0c0a-c32c-437c-bead-b40a765dcfd2 None None] MFA Rules not processed for user `aff5308e6cb94622853075a723d54a67`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:08.061642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 837/1695] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:07 2022] PUT /identity/v3/projects/58c2fb09361745d8b39c8b1e1033bcea/users/94b464de5cc44f5b84bf2bb7d4ad3443/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:08.089435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0c8f0c0a-c32c-437c-bead-b40a765dcfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:08.209848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 859/1696] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:08.427963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6a635-1233-4089-829f-ce1716785e7f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:08.431746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-68a6a635-1233-4089-829f-ce1716785e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:08.470982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f0c0a-c32c-437c-bead-b40a765dcfd2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:08.472767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0c8f0c0a-c32c-437c-bead-b40a765dcfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:08.559497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6a635-1233-4089-829f-ce1716785e7f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:08.567609 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f5699-b313-4e4a-8a96-fbee07b749b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:08.568758 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5699-b313-4e4a-8a96-fbee07b749b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:08.569108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5699-b313-4e4a-8a96-fbee07b749b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:08.569602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5699-b313-4e4a-8a96-fbee07b749b5 admin admin] PATH_INFO: `/v3/projects/52fc7d7f8ef94d1c93b472157a24d6ae` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:08.571590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f5699-b313-4e4a-8a96-fbee07b749b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52fc7d7f8ef94d1c93b472157a24d6ae)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:08.575046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f5699-b313-4e4a-8a96-fbee07b749b5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:08.735604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f0c0a-c32c-437c-bead-b40a765dcfd2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:08.754729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b64f5699-b313-4e4a-8a96-fbee07b749b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fc7d7f8ef94d1c93b472157a24d6ae', 'request_id': 'req-b64f5699-b313-4e4a-8a96-fbee07b749b5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:08.812692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b64f5699-b313-4e4a-8a96-fbee07b749b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fc7d7f8ef94d1c93b472157a24d6ae', 'request_id': 'req-b64f5699-b313-4e4a-8a96-fbee07b749b5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:08.856416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b64f5699-b313-4e4a-8a96-fbee07b749b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fc7d7f8ef94d1c93b472157a24d6ae', 'request_id': 'req-b64f5699-b313-4e4a-8a96-fbee07b749b5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:08.889698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b64f5699-b313-4e4a-8a96-fbee07b749b5 admin admin] The token cache is being invalidate because project 52fc7d7f8ef94d1c93b472157a24d6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:08.890254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b64f5699-b313-4e4a-8a96-fbee07b749b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:08.891121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b64f5699-b313-4e4a-8a96-fbee07b749b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:08.894670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 838/1697] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:08 2022] DELETE /identity/v3/projects/52fc7d7f8ef94d1c93b472157a24d6ae => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:08.898986 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa6e84-8ed8-44a6-8a79-af91a758e0a7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:08.899531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa6e84-8ed8-44a6-8a79-af91a758e0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:08.900009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa6e84-8ed8-44a6-8a79-af91a758e0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:08.924892 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:08.925711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:08.926164 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:08.926768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] PATH_INFO: `/v3/users/b0c163fdfff342bd8d5ef252feff6934` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:08.927951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0c163fdfff342bd8d5ef252feff6934)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:08.930794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:08.946734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:09.023660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-00aa6e84-8ed8-44a6-8a79-af91a758e0a7 None None] MFA Rules not processed for user `e2dabc4754c54de1ac66ba4c19b63919`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:09.025527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-00aa6e84-8ed8-44a6-8a79-af91a758e0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:09.034332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0c163fdfff342bd8d5ef252feff6934'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:09.038268 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:09.057066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0c163fdfff342bd8d5ef252feff6934'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:09.075629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0c163fdfff342bd8d5ef252feff6934'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:09.076389 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0c163fdfff342bd8d5ef252feff6934'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:09.119477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0c163fdfff342bd8d5ef252feff6934'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:09.139185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 860/1698] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:08 2022] DELETE /identity/v3/users/b0c163fdfff342bd8d5ef252feff6934 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:09.146166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:09.150022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:09.206858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 839/1699] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:09.208950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589af6c-3103-410b-ae1f-95a2fa28a84c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:09.209876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589af6c-3103-410b-ae1f-95a2fa28a84c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:09.210040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589af6c-3103-410b-ae1f-95a2fa28a84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:09.237041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7589af6c-3103-410b-ae1f-95a2fa28a84c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:09.238313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7589af6c-3103-410b-ae1f-95a2fa28a84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:09.270371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d26f93-4b59-4c87-90e7-2a9b0a25c0af admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:09.277107 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab71c89-6530-4fe9-8a0a-a4934f50a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:09.277803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab71c89-6530-4fe9-8a0a-a4934f50a09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:09.278486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab71c89-6530-4fe9-8a0a-a4934f50a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:09.278903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab71c89-6530-4fe9-8a0a-a4934f50a09a admin admin] PATH_INFO: `/v3/users/2ff5d56aaa7843eda0eae58fb7b950b0` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:09.281622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab71c89-6530-4fe9-8a0a-a4934f50a09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff5d56aaa7843eda0eae58fb7b950b0)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:09.284486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab71c89-6530-4fe9-8a0a-a4934f50a09a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:09.362088 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 840/1700] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:09.365190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c6fc0-c382-4bd1-896b-cab7909809a2 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:09.365190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c6fc0-c382-4bd1-896b-cab7909809a2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:09.366600 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c6fc0-c382-4bd1-896b-cab7909809a2 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:09.369020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 841/1701] 10.222.0.15 () {54 vars in 961 bytes} [Sun Aug 7 22:33:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:33:09.370407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78a141-7035-44c4-a4e6-f3eb6685f801 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:09.372994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78a141-7035-44c4-a4e6-f3eb6685f801 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:09.374057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78a141-7035-44c4-a4e6-f3eb6685f801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:09.386299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dab71c89-6530-4fe9-8a0a-a4934f50a09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff5d56aaa7843eda0eae58fb7b950b0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:09.405040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dab71c89-6530-4fe9-8a0a-a4934f50a09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff5d56aaa7843eda0eae58fb7b950b0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:09.419839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4d78a141-7035-44c4-a4e6-f3eb6685f801 None None] MFA Rules not processed for user `e2dabc4754c54de1ac66ba4c19b63919`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:09.421492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4d78a141-7035-44c4-a4e6-f3eb6685f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:09.432964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dab71c89-6530-4fe9-8a0a-a4934f50a09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff5d56aaa7843eda0eae58fb7b950b0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:09.434360 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dab71c89-6530-4fe9-8a0a-a4934f50a09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff5d56aaa7843eda0eae58fb7b950b0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:09.457772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dab71c89-6530-4fe9-8a0a-a4934f50a09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff5d56aaa7843eda0eae58fb7b950b0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:09.476360 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 861/1702] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:09 2022] DELETE /identity/v3/users/2ff5d56aaa7843eda0eae58fb7b950b0 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:09.478670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce8ded-a1a1-4f89-b341-fa8410f06828 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:09.481882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce8ded-a1a1-4f89-b341-fa8410f06828 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:09.482367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce8ded-a1a1-4f89-b341-fa8410f06828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:09.511891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:09.528355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-73ce8ded-a1a1-4f89-b341-fa8410f06828 None None] MFA Rules not processed for user `90db0874a2f443768a9d9842beb2523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:09.532206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-73ce8ded-a1a1-4f89-b341-fa8410f06828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:09.578536 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 842/1703] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:09.579437 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78a141-7035-44c4-a4e6-f3eb6685f801 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:09.582970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4d78a141-7035-44c4-a4e6-f3eb6685f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:09.722503 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78a141-7035-44c4-a4e6-f3eb6685f801 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:09.726021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:09.744027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 862/1704] 10.222.0.15 () {58 vars in 1058 bytes} [Sun Aug 7 22:33:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:09.754825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595b02f-0379-44b6-abb2-f0b3d4af025f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:09.757480 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595b02f-0379-44b6-abb2-f0b3d4af025f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:09.757949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595b02f-0379-44b6-abb2-f0b3d4af025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:09.830282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ee2fc-f9d9-4f97-b314-e75ebeb0b78b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:09.831043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ee2fc-f9d9-4f97-b314-e75ebeb0b78b service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:09.831539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ee2fc-f9d9-4f97-b314-e75ebeb0b78b service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:09.831908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ee2fc-f9d9-4f97-b314-e75ebeb0b78b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:09.834968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0595b02f-0379-44b6-abb2-f0b3d4af025f None None] MFA Rules not processed for user `ccb8ac5aaec44417bd6aaa4a2b1aca11`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:09.835421 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bb5ee2fc-f9d9-4f97-b314-e75ebeb0b78b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:09.847009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0595b02f-0379-44b6-abb2-f0b3d4af025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:10.033041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ee2fc-f9d9-4f97-b314-e75ebeb0b78b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:10.042918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ee2fc-f9d9-4f97-b314-e75ebeb0b78b service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:10.051513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 863/1705] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:10.052945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595b02f-0379-44b6-abb2-f0b3d4af025f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:10.058941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0595b02f-0379-44b6-abb2-f0b3d4af025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:10.115052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 843/1706] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:10.116520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ee2fc-f9d9-4f97-b314-e75ebeb0b78b service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:10.168753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ee2fc-f9d9-4f97-b314-e75ebeb0b78b service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:10.192282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b54e68-6a63-4438-8980-f0dfe0223772 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db0874a2f443768a9d9842beb2523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:10.193218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b54e68-6a63-4438-8980-f0dfe0223772 service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:10.193639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b54e68-6a63-4438-8980-f0dfe0223772 service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:10.194053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b54e68-6a63-4438-8980-f0dfe0223772 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:10.204934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f4b54e68-6a63-4438-8980-f0dfe0223772 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:10.236994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b54e68-6a63-4438-8980-f0dfe0223772 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:10.238970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b54e68-6a63-4438-8980-f0dfe0223772 service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:10.264433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 844/1707] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:10.265941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cfb6c-1781-4580-a07c-518462c94f72 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:10.266363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cfb6c-1781-4580-a07c-518462c94f72 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:10.266810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cfb6c-1781-4580-a07c-518462c94f72 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:10.268581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 845/1708] 10.222.0.15 () {54 vars in 912 bytes} [Sun Aug 7 22:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:33:10.274993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d2998-d000-43dd-b74e-154f6b69e52b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:10.275537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d2998-d000-43dd-b74e-154f6b69e52b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:10.276596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d2998-d000-43dd-b74e-154f6b69e52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:10.334976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b97d2998-d000-43dd-b74e-154f6b69e52b None None] MFA Rules not processed for user `8c68d5fdc4a946499ae86cdff0149470`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:10.337308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b97d2998-d000-43dd-b74e-154f6b69e52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:10.358263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595b02f-0379-44b6-abb2-f0b3d4af025f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:10.361228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 846/1709] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:33:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:10.376737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d2998-d000-43dd-b74e-154f6b69e52b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:10.378411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b97d2998-d000-43dd-b74e-154f6b69e52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:10.392506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed9d98-f05e-45c7-8239-f699e24d4ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:10.396526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed9d98-f05e-45c7-8239-f699e24d4ca0 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:10.397802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed9d98-f05e-45c7-8239-f699e24d4ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:10.398914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed9d98-f05e-45c7-8239-f699e24d4ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:10.409688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-76ed9d98-f05e-45c7-8239-f699e24d4ca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:10.411978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d2998-d000-43dd-b74e-154f6b69e52b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:10.433312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d89fc-4296-4d22-b140-2ff92f8476a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:10.434475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d89fc-4296-4d22-b140-2ff92f8476a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:10.434767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d89fc-4296-4d22-b140-2ff92f8476a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:10.435043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d89fc-4296-4d22-b140-2ff92f8476a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:10.461611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d89fc-4296-4d22-b140-2ff92f8476a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:10.463413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d89fc-4296-4d22-b140-2ff92f8476a9 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:10.490297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 847/1710] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:33:10.582161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:10.607265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed9d98-f05e-45c7-8239-f699e24d4ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:10.608882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed9d98-f05e-45c7-8239-f699e24d4ca0 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:10.633005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 864/1711] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:10.879952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eac34-6fbe-43b6-aec1-f92d28030e8c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:10.880467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eac34-6fbe-43b6-aec1-f92d28030e8c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:10.880467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eac34-6fbe-43b6-aec1-f92d28030e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:10.957329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d78eac34-6fbe-43b6-aec1-f92d28030e8c None None] MFA Rules not processed for user `94b464de5cc44f5b84bf2bb7d4ad3443`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:10.958562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d78eac34-6fbe-43b6-aec1-f92d28030e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:11.150890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 848/1712] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:10 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:11.986938 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed9d98-f05e-45c7-8239-f699e24d4ca0 service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:11.992146 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-76ed9d98-f05e-45c7-8239-f699e24d4ca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:12.029212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed9d98-f05e-45c7-8239-f699e24d4ca0 service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:12.051894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2fc3-6d37-4e79-a4c5-9b110605a225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:12.052717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2fc3-6d37-4e79-a4c5-9b110605a225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:12.053073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2fc3-6d37-4e79-a4c5-9b110605a225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:12.053446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2fc3-6d37-4e79-a4c5-9b110605a225 admin admin] PATH_INFO: `/v3/projects/7fa4ba65431b43c1a8c74c491fd360ed` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:12.064040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca2fc3-6d37-4e79-a4c5-9b110605a225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa4ba65431b43c1a8c74c491fd360ed)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:12.066165 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca2fc3-6d37-4e79-a4c5-9b110605a225 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:12.091325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eac34-6fbe-43b6-aec1-f92d28030e8c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:12.093385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d78eac34-6fbe-43b6-aec1-f92d28030e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:12.129490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eac34-6fbe-43b6-aec1-f92d28030e8c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:12.145691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:12.149588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:12.149875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:12.150152 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] PATH_INFO: `/v3/projects/6910f845d4ea4c8a8abf6f9705f1f332` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:12.161444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6910f845d4ea4c8a8abf6f9705f1f332)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:12.172719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:12.180596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:12.203236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6fca2fc3-6d37-4e79-a4c5-9b110605a225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa4ba65431b43c1a8c74c491fd360ed', 'request_id': 'req-6fca2fc3-6d37-4e79-a4c5-9b110605a225'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.219517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6fca2fc3-6d37-4e79-a4c5-9b110605a225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa4ba65431b43c1a8c74c491fd360ed', 'request_id': 'req-6fca2fc3-6d37-4e79-a4c5-9b110605a225'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.234788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6fca2fc3-6d37-4e79-a4c5-9b110605a225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa4ba65431b43c1a8c74c491fd360ed', 'request_id': 'req-6fca2fc3-6d37-4e79-a4c5-9b110605a225'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.261173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6fca2fc3-6d37-4e79-a4c5-9b110605a225 admin admin] The token cache is being invalidate because project 7fa4ba65431b43c1a8c74c491fd360ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:12.262351 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6fca2fc3-6d37-4e79-a4c5-9b110605a225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.264471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6fca2fc3-6d37-4e79-a4c5-9b110605a225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.266144 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 865/1713] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:11 2022] DELETE /identity/v3/projects/7fa4ba65431b43c1a8c74c491fd360ed => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:12.271984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d0f0f-b0f9-4dff-a4a6-f856d227377d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:12.272393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d0f0f-b0f9-4dff-a4a6-f856d227377d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:12.272767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d0f0f-b0f9-4dff-a4a6-f856d227377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:12.315682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-456d0f0f-b0f9-4dff-a4a6-f856d227377d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:12.318289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-456d0f0f-b0f9-4dff-a4a6-f856d227377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:12.374966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6910f845d4ea4c8a8abf6f9705f1f332', 'request_id': 'req-7f5cae14-a253-40b1-920c-786d8ca91f61'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.398800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6910f845d4ea4c8a8abf6f9705f1f332', 'request_id': 'req-7f5cae14-a253-40b1-920c-786d8ca91f61'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.436939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6910f845d4ea4c8a8abf6f9705f1f332', 'request_id': 'req-7f5cae14-a253-40b1-920c-786d8ca91f61'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.468011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] The token cache is being invalidate because project 6910f845d4ea4c8a8abf6f9705f1f332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:12.470283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.471456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.483782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 849/1714] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:12 2022] DELETE /identity/v3/projects/6910f845d4ea4c8a8abf6f9705f1f332 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:12.485956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:12.487971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:12.502157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 866/1715] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:12.527047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82348435-7a5e-4820-a3c5-f70ac3effd6e None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:12.527358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82348435-7a5e-4820-a3c5-f70ac3effd6e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:12.528183 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82348435-7a5e-4820-a3c5-f70ac3effd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:12.569966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cae14-a253-40b1-920c-786d8ca91f61 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:12.592184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:12.592762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:12.593035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:12.593304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] PATH_INFO: `/v3/users/fc320c402a4c4877a382125ff34ed54e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:12.597755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-82348435-7a5e-4820-a3c5-f70ac3effd6e None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:12.599003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-82348435-7a5e-4820-a3c5-f70ac3effd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:12.614988 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc320c402a4c4877a382125ff34ed54e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:12.622332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:12.623264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 867/1716] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:12.627771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82348435-7a5e-4820-a3c5-f70ac3effd6e None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:12.648303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82348435-7a5e-4820-a3c5-f70ac3effd6e None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:12.663985 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e95f8-eeab-42e8-8c0d-da7d12a00921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:12.664837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e95f8-eeab-42e8-8c0d-da7d12a00921 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:12.666460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e95f8-eeab-42e8-8c0d-da7d12a00921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:12.666904 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e95f8-eeab-42e8-8c0d-da7d12a00921 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:12.667883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e95f8-eeab-42e8-8c0d-da7d12a00921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:12.668380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e95f8-eeab-42e8-8c0d-da7d12a00921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:12.672319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e95f8-eeab-42e8-8c0d-da7d12a00921 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:12.697341 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 868/1717] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:33:12.702496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e95f8-eeab-42e8-8c0d-da7d12a00921 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:12.727126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e95f8-eeab-42e8-8c0d-da7d12a00921 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:12.742014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef0fb7-358e-456b-a59a-6b946cc0d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:12.745126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef0fb7-358e-456b-a59a-6b946cc0d558 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:12.745914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef0fb7-358e-456b-a59a-6b946cc0d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:12.747192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef0fb7-358e-456b-a59a-6b946cc0d558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:12.748358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef0fb7-358e-456b-a59a-6b946cc0d558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:12.758536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef0fb7-358e-456b-a59a-6b946cc0d558 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:12.777126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc320c402a4c4877a382125ff34ed54e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.801742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc320c402a4c4877a382125ff34ed54e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.802752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc320c402a4c4877a382125ff34ed54e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.803695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc320c402a4c4877a382125ff34ed54e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.830468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc320c402a4c4877a382125ff34ed54e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:12.841867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 869/1718] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:12 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:33:12.842877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef0fb7-358e-456b-a59a-6b946cc0d558 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:12.848799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1fef0fb7-358e-456b-a59a-6b946cc0d558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:12.864539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 850/1719] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:12 2022] DELETE /identity/v3/users/fc320c402a4c4877a382125ff34ed54e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:12.947703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:13.077893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef0fb7-358e-456b-a59a-6b946cc0d558 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:13.219325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887800-e024-4644-ab0f-6b615ea42a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:13.220717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887800-e024-4644-ab0f-6b615ea42a9f admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:13.220717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887800-e024-4644-ab0f-6b615ea42a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:13.220717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887800-e024-4644-ab0f-6b615ea42a9f admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:13.221498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e887800-e024-4644-ab0f-6b615ea42a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:13.223553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e887800-e024-4644-ab0f-6b615ea42a9f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:13.272665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 870/1720] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:12 2022] POST /identity/v3/users => generated 289 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:13.276877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:13.294139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70603180-28d5-4925-a922-29cef8f01e9c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:13.348832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c0e01-06cf-4f2b-bdaa-403929608011 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:13.349295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c0e01-06cf-4f2b-bdaa-403929608011 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:13.349671 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c0e01-06cf-4f2b-bdaa-403929608011 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:13.351380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 871/1721] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:33:13.357191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2f9f0-ecaf-45dc-9913-5b8460e69a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:13.357849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2f9f0-ecaf-45dc-9913-5b8460e69a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:13.358236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2f9f0-ecaf-45dc-9913-5b8460e69a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:13.358615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2f9f0-ecaf-45dc-9913-5b8460e69a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:13.359408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2f9f0-ecaf-45dc-9913-5b8460e69a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:13.361117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2f9f0-ecaf-45dc-9913-5b8460e69a87 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:13.375670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb83f5-0c84-4851-9513-57bd6288948f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:13.375670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb83f5-0c84-4851-9513-57bd6288948f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:13.376193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb83f5-0c84-4851-9513-57bd6288948f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:13.419814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 851/1722] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:13.428853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2f9f0-ecaf-45dc-9913-5b8460e69a87 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:13.432779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-69bb83f5-0c84-4851-9513-57bd6288948f None None] MFA Rules not processed for user `90db0874a2f443768a9d9842beb2523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:13.453083 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-69bb83f5-0c84-4851-9513-57bd6288948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:13.456221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2f9f0-ecaf-45dc-9913-5b8460e69a87 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:13.472510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f9c8e-fa39-4cc9-b704-f2d45095cbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:13.473373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9c8e-fa39-4cc9-b704-f2d45095cbbb admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:13.473783 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9c8e-fa39-4cc9-b704-f2d45095cbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:13.474287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9c8e-fa39-4cc9-b704-f2d45095cbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:13.475042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f9c8e-fa39-4cc9-b704-f2d45095cbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:13.476779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f9c8e-fa39-4cc9-b704-f2d45095cbbb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:13.522096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 852/1723] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:13.529253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f9c8e-fa39-4cc9-b704-f2d45095cbbb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:13.565403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f9c8e-fa39-4cc9-b704-f2d45095cbbb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:13.614705 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a884a9-e99f-471d-afe0-1ca9868e1382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:13.616470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a884a9-e99f-471d-afe0-1ca9868e1382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:13.622366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a884a9-e99f-471d-afe0-1ca9868e1382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:13.622731 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a884a9-e99f-471d-afe0-1ca9868e1382 admin admin] PATH_INFO: `/v3/projects/8d607c32aaf946ff926082ee28e486d6/users/f7a5ef8227ea4a60ada4e74a1b66a6de/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:13.739774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a884a9-e99f-471d-afe0-1ca9868e1382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d607c32aaf946ff926082ee28e486d6, user_id=f7a5ef8227ea4a60ada4e74a1b66a6de, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:13.752746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a884a9-e99f-471d-afe0-1ca9868e1382 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:13.775660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 872/1724] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:33:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:13.780033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173b947-95f2-4cee-a5f7-76be3353330a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:13.780742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173b947-95f2-4cee-a5f7-76be3353330a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:13.783065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173b947-95f2-4cee-a5f7-76be3353330a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:13.801917 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 853/1725] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:13 2022] PUT /identity/v3/projects/8d607c32aaf946ff926082ee28e486d6/users/f7a5ef8227ea4a60ada4e74a1b66a6de/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:13.824147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ba5f1-81a2-47d4-8454-fff455c99e54 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:13.824632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ba5f1-81a2-47d4-8454-fff455c99e54 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:13.825358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ba5f1-81a2-47d4-8454-fff455c99e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:13.942112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1c9ba5f1-81a2-47d4-8454-fff455c99e54 None None] MFA Rules not processed for user `f7a5ef8227ea4a60ada4e74a1b66a6de`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:13.953384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1c9ba5f1-81a2-47d4-8454-fff455c99e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:13.954951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e173b947-95f2-4cee-a5f7-76be3353330a None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:13.963961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e173b947-95f2-4cee-a5f7-76be3353330a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:13.974175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:14.038150 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:14.133435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 873/1726] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:33:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:14.136988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173b947-95f2-4cee-a5f7-76be3353330a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:14.145286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e173b947-95f2-4cee-a5f7-76be3353330a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:14.158304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 854/1727] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:14.162841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ba5f1-81a2-47d4-8454-fff455c99e54 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:14.334155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173b947-95f2-4cee-a5f7-76be3353330a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:14.340686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ba5f1-81a2-47d4-8454-fff455c99e54 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:14.348338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98163d0c-a02f-48da-b9f1-741b5fce8309 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db0874a2f443768a9d9842beb2523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:14.349376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98163d0c-a02f-48da-b9f1-741b5fce8309 service placement] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:14.350502 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98163d0c-a02f-48da-b9f1-741b5fce8309 service placement] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:14.351372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98163d0c-a02f-48da-b9f1-741b5fce8309 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:14.351738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708f6cc-dd12-4ca1-8874-71f478aaf3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:14.353041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708f6cc-dd12-4ca1-8874-71f478aaf3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:14.353760 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708f6cc-dd12-4ca1-8874-71f478aaf3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:14.358653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708f6cc-dd12-4ca1-8874-71f478aaf3e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:14.359544 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708f6cc-dd12-4ca1-8874-71f478aaf3e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:14.361976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708f6cc-dd12-4ca1-8874-71f478aaf3e0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:14.378087 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98163d0c-a02f-48da-b9f1-741b5fce8309 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:14.382482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98163d0c-a02f-48da-b9f1-741b5fce8309 service placement] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:14.420420 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 874/1728] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:14.421510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98163d0c-a02f-48da-b9f1-741b5fce8309 service placement] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:14.428700 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-98163d0c-a02f-48da-b9f1-741b5fce8309 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:14.448873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 855/1729] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:14 2022] POST /identity/v3/projects => generated 377 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:33:14.456026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708f6cc-dd12-4ca1-8874-71f478aaf3e0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:14.645960 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708f6cc-dd12-4ca1-8874-71f478aaf3e0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:14.669260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c7fd8-a9f4-409f-b0ce-971038934862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:14.670036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c7fd8-a9f4-409f-b0ce-971038934862 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:14.670423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c7fd8-a9f4-409f-b0ce-971038934862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:14.670830 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c7fd8-a9f4-409f-b0ce-971038934862 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:14.671657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c7fd8-a9f4-409f-b0ce-971038934862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:14.673872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c7fd8-a9f4-409f-b0ce-971038934862 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:14.705104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98163d0c-a02f-48da-b9f1-741b5fce8309 service placement] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:14.727164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 856/1730] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:14 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:14.731045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c7fd8-a9f4-409f-b0ce-971038934862 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:14.754781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c7fd8-a9f4-409f-b0ce-971038934862 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:14.775407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac7b97-7683-4179-8f30-8cea5ae9806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:14.776575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac7b97-7683-4179-8f30-8cea5ae9806f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:14.777192 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac7b97-7683-4179-8f30-8cea5ae9806f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:14.778477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac7b97-7683-4179-8f30-8cea5ae9806f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:14.782913 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac7b97-7683-4179-8f30-8cea5ae9806f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:14.786334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac7b97-7683-4179-8f30-8cea5ae9806f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:14.824339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 857/1731] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:14.830420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac7b97-7683-4179-8f30-8cea5ae9806f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:14.844127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:14.860493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac7b97-7683-4179-8f30-8cea5ae9806f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:14.873500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e048d-7b3f-4e68-b4b7-9293eac9e37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:14.874359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e048d-7b3f-4e68-b4b7-9293eac9e37e admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:14.875551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e048d-7b3f-4e68-b4b7-9293eac9e37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:14.876061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e048d-7b3f-4e68-b4b7-9293eac9e37e admin admin] PATH_INFO: `/v3/projects/bf909e9b654f400994255294a02bd9b1/users/63bb5ee7610c400b9df18502e5a229b2/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:14.903807 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:14.908920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640c529-cffd-4efe-9d52-4b2d7e3508ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:14.911579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640c529-cffd-4efe-9d52-4b2d7e3508ee service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:14.913345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640c529-cffd-4efe-9d52-4b2d7e3508ee service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:14.915960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640c529-cffd-4efe-9d52-4b2d7e3508ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:14.940413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e048d-7b3f-4e68-b4b7-9293eac9e37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf909e9b654f400994255294a02bd9b1, user_id=63bb5ee7610c400b9df18502e5a229b2, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:14.953731 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e048d-7b3f-4e68-b4b7-9293eac9e37e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:15.004395 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 858/1732] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:14 2022] PUT /identity/v3/projects/bf909e9b654f400994255294a02bd9b1/users/63bb5ee7610c400b9df18502e5a229b2/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:15.010718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e048d-7b3f-4e68-b4b7-9293eac9e37e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:15.069931 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640c529-cffd-4efe-9d52-4b2d7e3508ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:15.072331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640c529-cffd-4efe-9d52-4b2d7e3508ee service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:15.115226 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 875/1733] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:33:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:33:15.212139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e048d-7b3f-4e68-b4b7-9293eac9e37e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:15.231655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c16e6d-1de1-4563-af76-9426fcf33d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:15.232291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c16e6d-1de1-4563-af76-9426fcf33d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:15.232606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c16e6d-1de1-4563-af76-9426fcf33d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:15.232871 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c16e6d-1de1-4563-af76-9426fcf33d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:15.233532 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c16e6d-1de1-4563-af76-9426fcf33d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:15.235167 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c16e6d-1de1-4563-af76-9426fcf33d74 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:15.257028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 859/1734] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:15.262884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640c529-cffd-4efe-9d52-4b2d7e3508ee service swift] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:15.324247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640c529-cffd-4efe-9d52-4b2d7e3508ee service swift] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:15.345789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73292de-73a3-45c6-9d97-c0e2bc428d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:15.350619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73292de-73a3-45c6-9d97-c0e2bc428d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:15.357479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73292de-73a3-45c6-9d97-c0e2bc428d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:15.357957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73292de-73a3-45c6-9d97-c0e2bc428d7a admin admin] PATH_INFO: `/v3/projects/bf909e9b654f400994255294a02bd9b1/users/63bb5ee7610c400b9df18502e5a229b2/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:15.362883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73292de-73a3-45c6-9d97-c0e2bc428d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf909e9b654f400994255294a02bd9b1, user_id=63bb5ee7610c400b9df18502e5a229b2, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:15.379495 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73292de-73a3-45c6-9d97-c0e2bc428d7a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:15.418828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 876/1735] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:15 2022] PUT /identity/v3/projects/bf909e9b654f400994255294a02bd9b1/users/63bb5ee7610c400b9df18502e5a229b2/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:15.429791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140846d-6598-4f08-b0d5-ecb8d575f7e3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:15.431013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140846d-6598-4f08-b0d5-ecb8d575f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:15.431530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140846d-6598-4f08-b0d5-ecb8d575f7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:15.513804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d140846d-6598-4f08-b0d5-ecb8d575f7e3 None None] MFA Rules not processed for user `63bb5ee7610c400b9df18502e5a229b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:15.519475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d140846d-6598-4f08-b0d5-ecb8d575f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:15.706592 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 860/1736] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:15.715881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73292de-73a3-45c6-9d97-c0e2bc428d7a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:15.717744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f73292de-73a3-45c6-9d97-c0e2bc428d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:15.861279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73292de-73a3-45c6-9d97-c0e2bc428d7a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:15.872546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f604bb-4ff3-4af5-b779-63f8c41949f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:15.872546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f604bb-4ff3-4af5-b779-63f8c41949f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:15.873451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f604bb-4ff3-4af5-b779-63f8c41949f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:15.873723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f604bb-4ff3-4af5-b779-63f8c41949f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:16.028788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f604bb-4ff3-4af5-b779-63f8c41949f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:16.030876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f604bb-4ff3-4af5-b779-63f8c41949f3 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:16.050898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 877/1737] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:16.213641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140846d-6598-4f08-b0d5-ecb8d575f7e3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:16.215987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d140846d-6598-4f08-b0d5-ecb8d575f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:16.548951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140846d-6598-4f08-b0d5-ecb8d575f7e3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:16.583936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:16.584628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:16.584906 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:16.585177 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] PATH_INFO: `/v3/users/b54170da57894221a0f52833e6344663` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:16.592465 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54170da57894221a0f52833e6344663)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:16.594545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:16.633173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:16.740364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54170da57894221a0f52833e6344663'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:16.764180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54170da57894221a0f52833e6344663'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:16.765226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54170da57894221a0f52833e6344663'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:16.768088 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54170da57894221a0f52833e6344663'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:16.824178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54170da57894221a0f52833e6344663'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:16.902131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 861/1738] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:16 2022] DELETE /identity/v3/users/b54170da57894221a0f52833e6344663 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:16.986230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63bd81-fe6d-45d1-9413-12020689cb6c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:16.986776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63bd81-fe6d-45d1-9413-12020689cb6c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:16.986776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63bd81-fe6d-45d1-9413-12020689cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:17.022394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0d63bd81-fe6d-45d1-9413-12020689cb6c None None] MFA Rules not processed for user `51e200b8d8c443d5912756bf1d04a82d`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:17.025053 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0d63bd81-fe6d-45d1-9413-12020689cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:17.063471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:17.133699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 878/1739] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:17.941220 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:17.942735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:18.117167 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be33a3-d952-4cd2-9c85-2f5461bcb40e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:18.146529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c5bba-2611-49bc-a8b3-2d44cc7c0460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:18.147306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c5bba-2611-49bc-a8b3-2d44cc7c0460 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:18.147585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c5bba-2611-49bc-a8b3-2d44cc7c0460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:18.147856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c5bba-2611-49bc-a8b3-2d44cc7c0460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:18.153706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2b1c5bba-2611-49bc-a8b3-2d44cc7c0460 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:18.382473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c5bba-2611-49bc-a8b3-2d44cc7c0460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:18.385390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c5bba-2611-49bc-a8b3-2d44cc7c0460 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:18.424864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 862/1740] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:18.777393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63bd81-fe6d-45d1-9413-12020689cb6c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:18.781655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0d63bd81-fe6d-45d1-9413-12020689cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:18.965160 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63bd81-fe6d-45d1-9413-12020689cb6c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:19.000802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36195ba3-e304-481d-829b-aa6ae878f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:19.003885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36195ba3-e304-481d-829b-aa6ae878f889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:19.005853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36195ba3-e304-481d-829b-aa6ae878f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:19.006089 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36195ba3-e304-481d-829b-aa6ae878f889 admin admin] PATH_INFO: `/v3/projects/9a4380a572fd49b495bb650f00a25670` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:19.015837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36195ba3-e304-481d-829b-aa6ae878f889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4380a572fd49b495bb650f00a25670)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:19.023054 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36195ba3-e304-481d-829b-aa6ae878f889 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:19.023277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60247585-58d1-4397-b07a-aedc22a99694 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:19.023744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60247585-58d1-4397-b07a-aedc22a99694 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:19.023744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60247585-58d1-4397-b07a-aedc22a99694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:19.083898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-60247585-58d1-4397-b07a-aedc22a99694 None None] MFA Rules not processed for user `411b1c674ef24c2bab146208d720c0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:19.085474 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-60247585-58d1-4397-b07a-aedc22a99694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:19.174502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:19.280606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 863/1741] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:19.291782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-36195ba3-e304-481d-829b-aa6ae878f889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4380a572fd49b495bb650f00a25670', 'request_id': 'req-36195ba3-e304-481d-829b-aa6ae878f889'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:19.324040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-36195ba3-e304-481d-829b-aa6ae878f889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4380a572fd49b495bb650f00a25670', 'request_id': 'req-36195ba3-e304-481d-829b-aa6ae878f889'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:19.354838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-36195ba3-e304-481d-829b-aa6ae878f889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4380a572fd49b495bb650f00a25670', 'request_id': 'req-36195ba3-e304-481d-829b-aa6ae878f889'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:19.389326 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-36195ba3-e304-481d-829b-aa6ae878f889 admin admin] The token cache is being invalidate because project 9a4380a572fd49b495bb650f00a25670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:19.389584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-36195ba3-e304-481d-829b-aa6ae878f889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:19.390903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-36195ba3-e304-481d-829b-aa6ae878f889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:19.398750 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 879/1742] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:18 2022] DELETE /identity/v3/projects/9a4380a572fd49b495bb650f00a25670 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:19.401196 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f89a6-809e-4be0-819c-221ab420e233 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:19.401889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f89a6-809e-4be0-819c-221ab420e233 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:19.401889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f89a6-809e-4be0-819c-221ab420e233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:19.459540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-448f89a6-809e-4be0-819c-221ab420e233 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:19.471663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-448f89a6-809e-4be0-819c-221ab420e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:19.628960 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 864/1743] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:19.639254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9d29-7141-42c2-adfc-d9822fdd7e35 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:19.640014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9d29-7141-42c2-adfc-d9822fdd7e35 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:19.640510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9d29-7141-42c2-adfc-d9822fdd7e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:19.693292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-145f9d29-7141-42c2-adfc-d9822fdd7e35 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:19.694771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-145f9d29-7141-42c2-adfc-d9822fdd7e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:19.728287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 880/1744] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:19.728595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f89a6-809e-4be0-819c-221ab420e233 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:19.745919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f89a6-809e-4be0-819c-221ab420e233 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:19.765150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657d450-f6e8-4866-bcfe-0cb2c9e100e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:19.766033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657d450-f6e8-4866-bcfe-0cb2c9e100e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:19.766350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657d450-f6e8-4866-bcfe-0cb2c9e100e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:19.766791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657d450-f6e8-4866-bcfe-0cb2c9e100e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:19.767557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657d450-f6e8-4866-bcfe-0cb2c9e100e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:19.768546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657d450-f6e8-4866-bcfe-0cb2c9e100e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:19.769972 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657d450-f6e8-4866-bcfe-0cb2c9e100e5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:19.811581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 865/1745] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:33:19.813048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f9d29-7141-42c2-adfc-d9822fdd7e35 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:19.824508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f9d29-7141-42c2-adfc-d9822fdd7e35 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:19.849529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb7f5b-297e-4bad-90e2-eb5acaee15d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:19.850423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb7f5b-297e-4bad-90e2-eb5acaee15d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:19.850944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb7f5b-297e-4bad-90e2-eb5acaee15d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:19.851465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb7f5b-297e-4bad-90e2-eb5acaee15d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:19.852403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb7f5b-297e-4bad-90e2-eb5acaee15d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:19.860675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb7f5b-297e-4bad-90e2-eb5acaee15d7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:19.927198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 881/1746] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:19 2022] POST /identity/v3/projects => generated 409 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:19.931573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657d450-f6e8-4866-bcfe-0cb2c9e100e5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:19.950358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657d450-f6e8-4866-bcfe-0cb2c9e100e5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:20.131561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5063f82-da12-4c0e-9e2d-d2d0f05f280c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:20.134318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5063f82-da12-4c0e-9e2d-d2d0f05f280c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:20.134796 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5063f82-da12-4c0e-9e2d-d2d0f05f280c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:20.141498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dd15e-fa8a-41c3-8039-497e148e1534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:20.142156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dd15e-fa8a-41c3-8039-497e148e1534 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:20.142263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dd15e-fa8a-41c3-8039-497e148e1534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:20.142526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dd15e-fa8a-41c3-8039-497e148e1534 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:20.143183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dd15e-fa8a-41c3-8039-497e148e1534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:20.145997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dd15e-fa8a-41c3-8039-497e148e1534 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:20.206906 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 866/1747] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:19 2022] POST /identity/v3/users => generated 305 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:20.208563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dd15e-fa8a-41c3-8039-497e148e1534 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:20.210164 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c5063f82-da12-4c0e-9e2d-d2d0f05f280c None None] MFA Rules not processed for user `8c68d5fdc4a946499ae86cdff0149470`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:20.216163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c5063f82-da12-4c0e-9e2d-d2d0f05f280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:20.228020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dd15e-fa8a-41c3-8039-497e148e1534 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:20.246331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b4eb2-85b7-4c75-8e6a-57b1ce91c2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:20.246960 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b4eb2-85b7-4c75-8e6a-57b1ce91c2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:20.247933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b4eb2-85b7-4c75-8e6a-57b1ce91c2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:20.247933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b4eb2-85b7-4c75-8e6a-57b1ce91c2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:20.248180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b4eb2-85b7-4c75-8e6a-57b1ce91c2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:20.249965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b4eb2-85b7-4c75-8e6a-57b1ce91c2c3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:20.274353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 867/1748] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:20.275552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b4eb2-85b7-4c75-8e6a-57b1ce91c2c3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:20.298125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b4eb2-85b7-4c75-8e6a-57b1ce91c2c3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:20.305123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b90457-d946-487a-b1e8-eee1a46b9f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:20.309730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b90457-d946-487a-b1e8-eee1a46b9f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:20.311563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b90457-d946-487a-b1e8-eee1a46b9f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:20.311912 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b90457-d946-487a-b1e8-eee1a46b9f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:20.312746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b90457-d946-487a-b1e8-eee1a46b9f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:20.316513 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b90457-d946-487a-b1e8-eee1a46b9f77 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:20.337755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:20.353207 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 868/1749] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:20.354204 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b90457-d946-487a-b1e8-eee1a46b9f77 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:20.397538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 882/1750] 10.222.0.36 () {58 vars in 1015 bytes} [Sun Aug 7 22:33:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:20.400367 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b90457-d946-487a-b1e8-eee1a46b9f77 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:20.429123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337244e-235b-44a8-ab35-530d0e87c558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:20.431001 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337244e-235b-44a8-ab35-530d0e87c558 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:20.433041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337244e-235b-44a8-ab35-530d0e87c558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:20.434547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337244e-235b-44a8-ab35-530d0e87c558 admin admin] PATH_INFO: `/v3/projects/b27919390da94223aa66c19e3bcaefa2/users/c0e276701e44473bb9c12e341b5d6ebd/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:20.442043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5063f82-da12-4c0e-9e2d-d2d0f05f280c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:20.443818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c5063f82-da12-4c0e-9e2d-d2d0f05f280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:20.472260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5063f82-da12-4c0e-9e2d-d2d0f05f280c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:20.483657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63d6fa-0c84-4de7-b179-7fbc54d4fdda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:20.484770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63d6fa-0c84-4de7-b179-7fbc54d4fdda service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:20.495605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63d6fa-0c84-4de7-b179-7fbc54d4fdda service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:20.500507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337244e-235b-44a8-ab35-530d0e87c558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27919390da94223aa66c19e3bcaefa2, user_id=c0e276701e44473bb9c12e341b5d6ebd, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:20.501994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63d6fa-0c84-4de7-b179-7fbc54d4fdda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:20.513453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337244e-235b-44a8-ab35-530d0e87c558 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:20.547506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63d6fa-0c84-4de7-b179-7fbc54d4fdda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:20.549129 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63d6fa-0c84-4de7-b179-7fbc54d4fdda service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:20.562181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 869/1751] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:20 2022] PUT /identity/v3/projects/b27919390da94223aa66c19e3bcaefa2/users/c0e276701e44473bb9c12e341b5d6ebd/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:20.562181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337244e-235b-44a8-ab35-530d0e87c558 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:20.577975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f337244e-235b-44a8-ab35-530d0e87c558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:20.598799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 883/1752] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:20.600036 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63d6fa-0c84-4de7-b179-7fbc54d4fdda service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:20.608709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3a63d6fa-0c84-4de7-b179-7fbc54d4fdda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:20.661281 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:20.665233 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63d6fa-0c84-4de7-b179-7fbc54d4fdda service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:20.847534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337244e-235b-44a8-ab35-530d0e87c558 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:20.856611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc90a3-b5d2-4750-a8fe-851146de8e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:20.857618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc90a3-b5d2-4750-a8fe-851146de8e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:20.860494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc90a3-b5d2-4750-a8fe-851146de8e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:20.860987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc90a3-b5d2-4750-a8fe-851146de8e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:20.872875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:20.873531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:20.873805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:20.874078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] PATH_INFO: `/v3/projects/bd8e10599a184752b83c061f50dea19b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:20.881537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8e10599a184752b83c061f50dea19b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:20.882313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc90a3-b5d2-4750-a8fe-851146de8e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:20.883526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:20.884257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc90a3-b5d2-4750-a8fe-851146de8e15 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:20.925362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 870/1753] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:20.927251 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d84735-b6be-499f-9b1b-518e1c7ea726 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:20.928197 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d84735-b6be-499f-9b1b-518e1c7ea726 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:20.929346 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d84735-b6be-499f-9b1b-518e1c7ea726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:21.025897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-45d84735-b6be-499f-9b1b-518e1c7ea726 None None] MFA Rules not processed for user `c0e276701e44473bb9c12e341b5d6ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:21.033044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-45d84735-b6be-499f-9b1b-518e1c7ea726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:21.155255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8e10599a184752b83c061f50dea19b', 'request_id': 'req-577756bc-2866-4ef5-89b0-f6959273305d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:21.175021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8e10599a184752b83c061f50dea19b', 'request_id': 'req-577756bc-2866-4ef5-89b0-f6959273305d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:21.200091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8e10599a184752b83c061f50dea19b', 'request_id': 'req-577756bc-2866-4ef5-89b0-f6959273305d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:21.229899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] The token cache is being invalidate because project bd8e10599a184752b83c061f50dea19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:21.230134 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:21.236130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:21.239136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 884/1754] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:20 2022] DELETE /identity/v3/projects/bd8e10599a184752b83c061f50dea19b => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:21.243638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:21.248196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:21.315572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 871/1755] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:20 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:21.320229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d84735-b6be-499f-9b1b-518e1c7ea726 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:21.326612 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-45d84735-b6be-499f-9b1b-518e1c7ea726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:21.400189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d84735-b6be-499f-9b1b-518e1c7ea726 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:21.406025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577756bc-2866-4ef5-89b0-f6959273305d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:21.416385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef06bc2-34f8-4445-8501-fa18a5c90e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:21.417014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef06bc2-34f8-4445-8501-fa18a5c90e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:21.420463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef06bc2-34f8-4445-8501-fa18a5c90e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:21.420790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef06bc2-34f8-4445-8501-fa18a5c90e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:21.421520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef06bc2-34f8-4445-8501-fa18a5c90e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:21.423332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:21.424059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:21.424346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:21.424616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] PATH_INFO: `/v3/users/94b464de5cc44f5b84bf2bb7d4ad3443` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:21.425822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b464de5cc44f5b84bf2bb7d4ad3443)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:21.427868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:21.429576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:21.447252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef06bc2-34f8-4445-8501-fa18a5c90e7c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:21.550353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b464de5cc44f5b84bf2bb7d4ad3443'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:21.558399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 872/1756] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:21 2022] POST /identity/v3/projects => generated 409 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:21.566117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef06bc2-34f8-4445-8501-fa18a5c90e7c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:21.569133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b464de5cc44f5b84bf2bb7d4ad3443'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:21.582646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b464de5cc44f5b84bf2bb7d4ad3443'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:21.583372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b464de5cc44f5b84bf2bb7d4ad3443'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:21.622772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b464de5cc44f5b84bf2bb7d4ad3443'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:21.658237 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 885/1757] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:21 2022] DELETE /identity/v3/users/94b464de5cc44f5b84bf2bb7d4ad3443 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:21.767121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef06bc2-34f8-4445-8501-fa18a5c90e7c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:21.821323 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:21.885768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbdb0e-3ed3-4f37-8424-305788fa89e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:21.885768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbdb0e-3ed3-4f37-8424-305788fa89e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:21.885934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbdb0e-3ed3-4f37-8424-305788fa89e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:21.886249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbdb0e-3ed3-4f37-8424-305788fa89e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:21.887131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbdb0e-3ed3-4f37-8424-305788fa89e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:21.889795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbdb0e-3ed3-4f37-8424-305788fa89e9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:21.944354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 873/1758] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:21 2022] POST /identity/v3/users => generated 311 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:21.945254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:21.947744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:21.974380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ca9ad-1c17-4618-8bf2-8db5d30f8fb9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:21.982814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325b112-4c0e-455f-aa5f-80a2f2346cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:21.984069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325b112-4c0e-455f-aa5f-80a2f2346cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:21.984628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325b112-4c0e-455f-aa5f-80a2f2346cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:21.985321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325b112-4c0e-455f-aa5f-80a2f2346cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:21.986313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325b112-4c0e-455f-aa5f-80a2f2346cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:21.988301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325b112-4c0e-455f-aa5f-80a2f2346cd8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:22.006505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 886/1759] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:22.006994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbdb0e-3ed3-4f37-8424-305788fa89e9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:22.032778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbdb0e-3ed3-4f37-8424-305788fa89e9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:22.052415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f566b4b-7834-4fa8-bf86-d738b2a7bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:22.056381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f566b4b-7834-4fa8-bf86-d738b2a7bd4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:22.057104 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f566b4b-7834-4fa8-bf86-d738b2a7bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:22.058996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f566b4b-7834-4fa8-bf86-d738b2a7bd4e admin admin] PATH_INFO: `/v3/projects/6bfe5c9589194741b9d39b4e39512a58/users/bd5ea4e7e59d4e7f9cdbc498c220a351/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:22.108494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f566b4b-7834-4fa8-bf86-d738b2a7bd4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfe5c9589194741b9d39b4e39512a58, user_id=bd5ea4e7e59d4e7f9cdbc498c220a351, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:22.114321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f566b4b-7834-4fa8-bf86-d738b2a7bd4e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:22.145571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 874/1760] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:22 2022] PUT /identity/v3/projects/6bfe5c9589194741b9d39b4e39512a58/users/bd5ea4e7e59d4e7f9cdbc498c220a351/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:22.149888 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325b112-4c0e-455f-aa5f-80a2f2346cd8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:22.173002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325b112-4c0e-455f-aa5f-80a2f2346cd8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:22.388620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf748fe-2560-4273-9ee1-7289788c43ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:22.389402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf748fe-2560-4273-9ee1-7289788c43ea admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:22.389599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf748fe-2560-4273-9ee1-7289788c43ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:22.389996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf748fe-2560-4273-9ee1-7289788c43ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:22.395725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf748fe-2560-4273-9ee1-7289788c43ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:22.398560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf748fe-2560-4273-9ee1-7289788c43ea admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:22.443714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 887/1761] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:22.447388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f566b4b-7834-4fa8-bf86-d738b2a7bd4e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:22.461162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f566b4b-7834-4fa8-bf86-d738b2a7bd4e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:22.474582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b372ac4-aea9-48c8-8677-251d7cf71854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:22.477833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b372ac4-aea9-48c8-8677-251d7cf71854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:22.478896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b372ac4-aea9-48c8-8677-251d7cf71854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:22.479504 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b372ac4-aea9-48c8-8677-251d7cf71854 admin admin] PATH_INFO: `/v3/projects/6bfe5c9589194741b9d39b4e39512a58/users/bd5ea4e7e59d4e7f9cdbc498c220a351/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:22.482564 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b372ac4-aea9-48c8-8677-251d7cf71854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfe5c9589194741b9d39b4e39512a58, user_id=bd5ea4e7e59d4e7f9cdbc498c220a351, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:22.502721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b372ac4-aea9-48c8-8677-251d7cf71854 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:22.537796 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 875/1762] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:22 2022] PUT /identity/v3/projects/6bfe5c9589194741b9d39b4e39512a58/users/bd5ea4e7e59d4e7f9cdbc498c220a351/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:22.549197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e95236-a575-41ba-a167-bbe2a7dc2142 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:22.549540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e95236-a575-41ba-a167-bbe2a7dc2142 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:22.549806 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e95236-a575-41ba-a167-bbe2a7dc2142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:22.642628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-88e95236-a575-41ba-a167-bbe2a7dc2142 None None] MFA Rules not processed for user `bd5ea4e7e59d4e7f9cdbc498c220a351`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:22.643931 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-88e95236-a575-41ba-a167-bbe2a7dc2142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:22.873787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:22.941524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 888/1763] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:22 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:22.949250 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b372ac4-aea9-48c8-8677-251d7cf71854 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:22.951675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2b372ac4-aea9-48c8-8677-251d7cf71854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:23.133798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b372ac4-aea9-48c8-8677-251d7cf71854 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:23.138725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9b588-4ce4-4f27-b8c3-85c24f39e6ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:23.140381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9b588-4ce4-4f27-b8c3-85c24f39e6ea service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:23.142142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9b588-4ce4-4f27-b8c3-85c24f39e6ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:23.143460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9b588-4ce4-4f27-b8c3-85c24f39e6ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:23.172840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9b588-4ce4-4f27-b8c3-85c24f39e6ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:23.174633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9b588-4ce4-4f27-b8c3-85c24f39e6ea service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:23.206413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 876/1764] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:22 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:23.658113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e95236-a575-41ba-a167-bbe2a7dc2142 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:23.680547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e95236-a575-41ba-a167-bbe2a7dc2142 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:23.686284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7d5a4-17ad-465d-9833-945891354236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:23.709097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7d5a4-17ad-465d-9833-945891354236 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:23.712393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7d5a4-17ad-465d-9833-945891354236 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:23.714090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7d5a4-17ad-465d-9833-945891354236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:23.721224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d1a7d5a4-17ad-465d-9833-945891354236 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:23.959401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7d5a4-17ad-465d-9833-945891354236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:23.961449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7d5a4-17ad-465d-9833-945891354236 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:23.969317 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9b588-4ce4-4f27-b8c3-85c24f39e6ea service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:23.970927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8dd9b588-4ce4-4f27-b8c3-85c24f39e6ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:23.974664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 889/1765] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:23 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:24.157774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9b588-4ce4-4f27-b8c3-85c24f39e6ea service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:24.176682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:24.179923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:24.180438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:24.181143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] PATH_INFO: `/v3/users/f7a5ef8227ea4a60ada4e74a1b66a6de` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:24.188428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a5ef8227ea4a60ada4e74a1b66a6de)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:24.194026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:24.292071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:24.367590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a5ef8227ea4a60ada4e74a1b66a6de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:24.391918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a5ef8227ea4a60ada4e74a1b66a6de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:24.392596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a5ef8227ea4a60ada4e74a1b66a6de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:24.393238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a5ef8227ea4a60ada4e74a1b66a6de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:24.433602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a5ef8227ea4a60ada4e74a1b66a6de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:24.489470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 877/1766] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:23 2022] DELETE /identity/v3/users/f7a5ef8227ea4a60ada4e74a1b66a6de => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:24.493937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d19579-2097-46b1-9ac2-28b5c01ec190 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:24.494106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d19579-2097-46b1-9ac2-28b5c01ec190 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:24.494418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d19579-2097-46b1-9ac2-28b5c01ec190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:24.551399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a5d19579-2097-46b1-9ac2-28b5c01ec190 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:24.553105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a5d19579-2097-46b1-9ac2-28b5c01ec190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:24.722702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 890/1767] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:24.820904 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:24.822412 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:24.997130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a35b6e-8026-4bf5-a9ef-9c28439fcc78 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:25.012889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f75d67-290c-44ea-8093-b0c392fe0960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:25.013643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f75d67-290c-44ea-8093-b0c392fe0960 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:25.014082 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f75d67-290c-44ea-8093-b0c392fe0960 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:25.014353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f75d67-290c-44ea-8093-b0c392fe0960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:25.037549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f75d67-290c-44ea-8093-b0c392fe0960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:25.039812 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f75d67-290c-44ea-8093-b0c392fe0960 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:25.058270 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 878/1768] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:25.186482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c0ca0-5927-42b1-a44b-e9f65c2d8e67 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:25.186781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c0ca0-5927-42b1-a44b-e9f65c2d8e67 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:25.187052 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c0ca0-5927-42b1-a44b-e9f65c2d8e67 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:25.188602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 891/1769] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:33:25.210694 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f75d67-290c-44ea-8093-b0c392fe0960 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:25.212321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-39f75d67-290c-44ea-8093-b0c392fe0960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:25.234309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f75d67-290c-44ea-8093-b0c392fe0960 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:25.245533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78147021-b20e-4a67-b086-c97a4167f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:25.246393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78147021-b20e-4a67-b086-c97a4167f8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:25.246680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78147021-b20e-4a67-b086-c97a4167f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:25.246956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78147021-b20e-4a67-b086-c97a4167f8cd admin admin] PATH_INFO: `/v3/projects/58c2fb09361745d8b39c8b1e1033bcea` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:25.248161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78147021-b20e-4a67-b086-c97a4167f8cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c2fb09361745d8b39c8b1e1033bcea)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:25.250111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78147021-b20e-4a67-b086-c97a4167f8cd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:25.253453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07dd0e-c63d-4bef-9e09-eb781a4130bb None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:25.253766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07dd0e-c63d-4bef-9e09-eb781a4130bb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:25.254033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07dd0e-c63d-4bef-9e09-eb781a4130bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:25.299598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0d07dd0e-c63d-4bef-9e09-eb781a4130bb None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:25.300834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0d07dd0e-c63d-4bef-9e09-eb781a4130bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:25.424326 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-78147021-b20e-4a67-b086-c97a4167f8cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c2fb09361745d8b39c8b1e1033bcea', 'request_id': 'req-78147021-b20e-4a67-b086-c97a4167f8cd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:25.431941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-78147021-b20e-4a67-b086-c97a4167f8cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c2fb09361745d8b39c8b1e1033bcea', 'request_id': 'req-78147021-b20e-4a67-b086-c97a4167f8cd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:25.444987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-78147021-b20e-4a67-b086-c97a4167f8cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c2fb09361745d8b39c8b1e1033bcea', 'request_id': 'req-78147021-b20e-4a67-b086-c97a4167f8cd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:25.473738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-78147021-b20e-4a67-b086-c97a4167f8cd admin admin] The token cache is being invalidate because project 58c2fb09361745d8b39c8b1e1033bcea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:25.474173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-78147021-b20e-4a67-b086-c97a4167f8cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:25.475008 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-78147021-b20e-4a67-b086-c97a4167f8cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:25.477108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 879/1770] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:25 2022] DELETE /identity/v3/projects/58c2fb09361745d8b39c8b1e1033bcea => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:25.485167 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0db1f9-f4d8-41d2-ba35-0254f34e3675 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:25.485675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0db1f9-f4d8-41d2-ba35-0254f34e3675 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:25.486046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0db1f9-f4d8-41d2-ba35-0254f34e3675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:25.504044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 892/1771] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:33:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:25.543650 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ce0db1f9-f4d8-41d2-ba35-0254f34e3675 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:25.545302 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ce0db1f9-f4d8-41d2-ba35-0254f34e3675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:25.630228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:25.727233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 880/1772] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:25.735484 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcebb9-56dc-407a-a022-d682cf3410b9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:25.736045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcebb9-56dc-407a-a022-d682cf3410b9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:25.736045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcebb9-56dc-407a-a022-d682cf3410b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:25.792414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d4bcebb9-56dc-407a-a022-d682cf3410b9 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:25.802485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d4bcebb9-56dc-407a-a022-d682cf3410b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:25.832781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 893/1773] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:25.837145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0db1f9-f4d8-41d2-ba35-0254f34e3675 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:25.854043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0db1f9-f4d8-41d2-ba35-0254f34e3675 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:25.865490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd325f-e0c1-4672-9ec2-a71f9d7ae772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:25.866132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd325f-e0c1-4672-9ec2-a71f9d7ae772 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:25.866409 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd325f-e0c1-4672-9ec2-a71f9d7ae772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:25.866683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd325f-e0c1-4672-9ec2-a71f9d7ae772 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:25.867979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd325f-e0c1-4672-9ec2-a71f9d7ae772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:25.868291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd325f-e0c1-4672-9ec2-a71f9d7ae772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:25.869940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd325f-e0c1-4672-9ec2-a71f9d7ae772 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:25.905127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 881/1774] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:33:25.909767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcebb9-56dc-407a-a022-d682cf3410b9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:25.938920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcebb9-56dc-407a-a022-d682cf3410b9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:25.977521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f8150-92d1-41e2-b2b1-5fed19c82b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:25.978272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f8150-92d1-41e2-b2b1-5fed19c82b8b admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:25.978413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f8150-92d1-41e2-b2b1-5fed19c82b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:25.978878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f8150-92d1-41e2-b2b1-5fed19c82b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:25.979722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f8150-92d1-41e2-b2b1-5fed19c82b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:25.995949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f8150-92d1-41e2-b2b1-5fed19c82b8b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:26.033270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:26.092344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 894/1775] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:25 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:26.097152 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd325f-e0c1-4672-9ec2-a71f9d7ae772 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:26.114867 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd325f-e0c1-4672-9ec2-a71f9d7ae772 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:26.295426 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88c5cf-b0c6-4d5a-8aff-33f6cd7df959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:26.296093 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c5cf-b0c6-4d5a-8aff-33f6cd7df959 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:26.296369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c5cf-b0c6-4d5a-8aff-33f6cd7df959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:26.296639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c5cf-b0c6-4d5a-8aff-33f6cd7df959 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:26.297273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88c5cf-b0c6-4d5a-8aff-33f6cd7df959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:26.301416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88c5cf-b0c6-4d5a-8aff-33f6cd7df959 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:26.342686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 882/1776] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:26 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:26.347314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f8150-92d1-41e2-b2b1-5fed19c82b8b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:26.360728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f8150-92d1-41e2-b2b1-5fed19c82b8b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:26.375866 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a0489-ce42-43eb-9b91-e56eac59cfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:26.376515 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a0489-ce42-43eb-9b91-e56eac59cfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:26.376775 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a0489-ce42-43eb-9b91-e56eac59cfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:26.377045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a0489-ce42-43eb-9b91-e56eac59cfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:26.377695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a0489-ce42-43eb-9b91-e56eac59cfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:26.379393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a0489-ce42-43eb-9b91-e56eac59cfa4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:26.409607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 895/1777] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:26.410757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88c5cf-b0c6-4d5a-8aff-33f6cd7df959 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:26.422136 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88c5cf-b0c6-4d5a-8aff-33f6cd7df959 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:26.436474 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae372-0ba2-47f3-bc82-4b86ba8fbf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:26.437224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae372-0ba2-47f3-bc82-4b86ba8fbf09 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:26.457543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae372-0ba2-47f3-bc82-4b86ba8fbf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:26.459425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae372-0ba2-47f3-bc82-4b86ba8fbf09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:26.475334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ae372-0ba2-47f3-bc82-4b86ba8fbf09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:26.475334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ae372-0ba2-47f3-bc82-4b86ba8fbf09 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:26.475334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 883/1778] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:26.479607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a0489-ce42-43eb-9b91-e56eac59cfa4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:26.491131 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a0489-ce42-43eb-9b91-e56eac59cfa4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:26.496952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6505a9-4b36-4c7e-ba20-f3a4ea689172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:26.497641 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6505a9-4b36-4c7e-ba20-f3a4ea689172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:26.497919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6505a9-4b36-4c7e-ba20-f3a4ea689172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:26.498193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6505a9-4b36-4c7e-ba20-f3a4ea689172 admin admin] PATH_INFO: `/v3/projects/ec47dfed10dd4f63971577875b2b4b10/users/49625c81497b4a79960018e9c8dc4ecc/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:26.517117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6505a9-4b36-4c7e-ba20-f3a4ea689172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec47dfed10dd4f63971577875b2b4b10, user_id=49625c81497b4a79960018e9c8dc4ecc, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:26.520229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6505a9-4b36-4c7e-ba20-f3a4ea689172 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:26.548452 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 896/1779] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:26 2022] PUT /identity/v3/projects/ec47dfed10dd4f63971577875b2b4b10/users/49625c81497b4a79960018e9c8dc4ecc/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:26.560939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee409f-78f5-4c73-9241-f49ef6eab160 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:26.561490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee409f-78f5-4c73-9241-f49ef6eab160 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:26.561909 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee409f-78f5-4c73-9241-f49ef6eab160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:26.616438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-88ee409f-78f5-4c73-9241-f49ef6eab160 None None] MFA Rules not processed for user `49625c81497b4a79960018e9c8dc4ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:26.618704 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-88ee409f-78f5-4c73-9241-f49ef6eab160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:26.728769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 884/1780] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:26.744300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6505a9-4b36-4c7e-ba20-f3a4ea689172 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:26.895982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6505a9-4b36-4c7e-ba20-f3a4ea689172 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:26.917313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7af73-18e6-49a4-98fb-a83292946f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:26.922123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7af73-18e6-49a4-98fb-a83292946f56 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:26.924488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7af73-18e6-49a4-98fb-a83292946f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:26.925249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7af73-18e6-49a4-98fb-a83292946f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:26.928321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7af73-18e6-49a4-98fb-a83292946f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:26.935630 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7af73-18e6-49a4-98fb-a83292946f56 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:27.044851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 897/1781] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:26 2022] POST /identity/v3/projects => generated 379 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:27.047073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee409f-78f5-4c73-9241-f49ef6eab160 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:27.075684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee409f-78f5-4c73-9241-f49ef6eab160 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:27.197392 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:27.243377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7af73-18e6-49a4-98fb-a83292946f56 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:27.245646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e5b7af73-18e6-49a4-98fb-a83292946f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:27.282948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb242b-1f4b-4bfa-a1b9-1a02ca1e9314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:27.287417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb242b-1f4b-4bfa-a1b9-1a02ca1e9314 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:27.287799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb242b-1f4b-4bfa-a1b9-1a02ca1e9314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:27.288173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb242b-1f4b-4bfa-a1b9-1a02ca1e9314 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:27.288924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb242b-1f4b-4bfa-a1b9-1a02ca1e9314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:27.291272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb242b-1f4b-4bfa-a1b9-1a02ca1e9314 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:27.337836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 885/1782] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:27 2022] POST /identity/v3/users => generated 296 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:27.342518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb242b-1f4b-4bfa-a1b9-1a02ca1e9314 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:27.364963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb242b-1f4b-4bfa-a1b9-1a02ca1e9314 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:27.373353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b01ab-d261-4800-9b4e-b58aa3d11403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:27.374371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b01ab-d261-4800-9b4e-b58aa3d11403 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:27.374829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b01ab-d261-4800-9b4e-b58aa3d11403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:27.375172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b01ab-d261-4800-9b4e-b58aa3d11403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:27.376024 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b01ab-d261-4800-9b4e-b58aa3d11403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:27.378052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b01ab-d261-4800-9b4e-b58aa3d11403 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:27.420975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 886/1783] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:27.424835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b01ab-d261-4800-9b4e-b58aa3d11403 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:27.472604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7af73-18e6-49a4-98fb-a83292946f56 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:27.486406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:27.487269 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:27.487548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:27.488013 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] PATH_INFO: `/v3/projects/8d607c32aaf946ff926082ee28e486d6` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:27.489298 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d607c32aaf946ff926082ee28e486d6)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:27.494123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:27.494901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b01ab-d261-4800-9b4e-b58aa3d11403 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:27.505462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbdb9f-910a-4580-867d-d1a128187437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:27.509766 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbdb9f-910a-4580-867d-d1a128187437 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:27.511472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbdb9f-910a-4580-867d-d1a128187437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:27.512631 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbdb9f-910a-4580-867d-d1a128187437 admin admin] PATH_INFO: `/v3/projects/06a3dc440f6049c68dd67a7baf779550/users/3befb8abf1104eb48daacb9366ab86cd/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:27.577083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbdb9f-910a-4580-867d-d1a128187437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a3dc440f6049c68dd67a7baf779550, user_id=3befb8abf1104eb48daacb9366ab86cd, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:27.579428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbdb9f-910a-4580-867d-d1a128187437 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:27.584545 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:27.593939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d607c32aaf946ff926082ee28e486d6', 'request_id': 'req-3189dc74-2868-4a87-a45b-eb60923e7bfd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:27.604369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 887/1784] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:27 2022] PUT /identity/v3/projects/06a3dc440f6049c68dd67a7baf779550/users/3befb8abf1104eb48daacb9366ab86cd/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:27.607311 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbdb9f-910a-4580-867d-d1a128187437 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:27.611195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d607c32aaf946ff926082ee28e486d6', 'request_id': 'req-3189dc74-2868-4a87-a45b-eb60923e7bfd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:27.611697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-31cbdb9f-910a-4580-867d-d1a128187437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:27.623342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d607c32aaf946ff926082ee28e486d6', 'request_id': 'req-3189dc74-2868-4a87-a45b-eb60923e7bfd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:27.650133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] The token cache is being invalidate because project 8d607c32aaf946ff926082ee28e486d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:27.650594 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:27.662907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:27.673227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 898/1785] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:27 2022] DELETE /identity/v3/projects/8d607c32aaf946ff926082ee28e486d6 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:27.674303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:27.676227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:27.788064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbdb9f-910a-4580-867d-d1a128187437 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:27.798773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b249128-56d8-4461-9543-80d1cbee14b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:27.799527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b249128-56d8-4461-9543-80d1cbee14b5 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:27.799991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b249128-56d8-4461-9543-80d1cbee14b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:27.800229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b249128-56d8-4461-9543-80d1cbee14b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:27.807372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9b249128-56d8-4461-9543-80d1cbee14b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:27.837051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b249128-56d8-4461-9543-80d1cbee14b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:27.841142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b249128-56d8-4461-9543-80d1cbee14b5 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:27.870040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189dc74-2868-4a87-a45b-eb60923e7bfd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:27.874296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 888/1786] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:27.876483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b249128-56d8-4461-9543-80d1cbee14b5 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:27.878284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9b249128-56d8-4461-9543-80d1cbee14b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:27.958525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfe27c-6f14-46a1-a600-e9228511c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:27.959516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfe27c-6f14-46a1-a600-e9228511c0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:27.959955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfe27c-6f14-46a1-a600-e9228511c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:27.960345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfe27c-6f14-46a1-a600-e9228511c0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:27.961260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfe27c-6f14-46a1-a600-e9228511c0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:27.961369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b249128-56d8-4461-9543-80d1cbee14b5 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:27.964519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfe27c-6f14-46a1-a600-e9228511c0d6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:27.976051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 899/1787] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:27.977151 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b33ac6-e294-429c-b7f5-f3b83910dd70 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:27.977429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b33ac6-e294-429c-b7f5-f3b83910dd70 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:27.977696 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b33ac6-e294-429c-b7f5-f3b83910dd70 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:27.980413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 900/1788] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:33:27.980413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b33ac6-e294-429c-b7f5-f3b83910dd70 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:27.982920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff6366-fd2c-4149-b47e-c2be6ef3c68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:27.988550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff6366-fd2c-4149-b47e-c2be6ef3c68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:27.988550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff6366-fd2c-4149-b47e-c2be6ef3c68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:27.988550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff6366-fd2c-4149-b47e-c2be6ef3c68b admin admin] PATH_INFO: `/v3/users/63bb5ee7610c400b9df18502e5a229b2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:27.988550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff6366-fd2c-4149-b47e-c2be6ef3c68b admin admin] RBAC: Authorizing `identity:delete_user(user_id=63bb5ee7610c400b9df18502e5a229b2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:27.988550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff6366-fd2c-4149-b47e-c2be6ef3c68b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:27.993983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:27.999497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b33ac6-e294-429c-b7f5-f3b83910dd70 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:28.007320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fbc5e-23fe-419d-864a-1228deeede4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:28.007982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fbc5e-23fe-419d-864a-1228deeede4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:28.008256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fbc5e-23fe-419d-864a-1228deeede4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:28.008524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fbc5e-23fe-419d-864a-1228deeede4a admin admin] PATH_INFO: `/v3/projects/06a3dc440f6049c68dd67a7baf779550/users/3befb8abf1104eb48daacb9366ab86cd/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:28.010820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fbc5e-23fe-419d-864a-1228deeede4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a3dc440f6049c68dd67a7baf779550, user_id=3befb8abf1104eb48daacb9366ab86cd, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:28.014481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fbc5e-23fe-419d-864a-1228deeede4a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:28.031981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 901/1789] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:27 2022] PUT /identity/v3/projects/06a3dc440f6049c68dd67a7baf779550/users/3befb8abf1104eb48daacb9366ab86cd/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:28.034815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f54fc9-e277-4603-bc5f-5d29e6a1c5c8 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:28.035383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f54fc9-e277-4603-bc5f-5d29e6a1c5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:28.036189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f54fc9-e277-4603-bc5f-5d29e6a1c5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:28.055244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dfff6366-fd2c-4149-b47e-c2be6ef3c68b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63bb5ee7610c400b9df18502e5a229b2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:28.066065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dfff6366-fd2c-4149-b47e-c2be6ef3c68b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63bb5ee7610c400b9df18502e5a229b2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:28.071626 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dfff6366-fd2c-4149-b47e-c2be6ef3c68b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63bb5ee7610c400b9df18502e5a229b2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:28.074130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dfff6366-fd2c-4149-b47e-c2be6ef3c68b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63bb5ee7610c400b9df18502e5a229b2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:28.095689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d8f54fc9-e277-4603-bc5f-5d29e6a1c5c8 None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:28.097199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dfff6366-fd2c-4149-b47e-c2be6ef3c68b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63bb5ee7610c400b9df18502e5a229b2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:28.098961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d8f54fc9-e277-4603-bc5f-5d29e6a1c5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:28.123631 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 889/1790] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:27 2022] DELETE /identity/v3/users/63bb5ee7610c400b9df18502e5a229b2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:28.125027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a668511-66ce-4a16-8f64-3d7bca7edc5f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:28.125305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a668511-66ce-4a16-8f64-3d7bca7edc5f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:28.125575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a668511-66ce-4a16-8f64-3d7bca7edc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:28.157308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9a668511-66ce-4a16-8f64-3d7bca7edc5f None None] MFA Rules not processed for user `3befb8abf1104eb48daacb9366ab86cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:28.158552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9a668511-66ce-4a16-8f64-3d7bca7edc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:28.226441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:28.243666 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 890/1791] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:28.254832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 902/1792] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:33:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:28.267908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a668511-66ce-4a16-8f64-3d7bca7edc5f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:28.269389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9a668511-66ce-4a16-8f64-3d7bca7edc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:28.347275 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a668511-66ce-4a16-8f64-3d7bca7edc5f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:28.352462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35972339-952f-402c-9dc4-89e642daf08c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:28.353329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35972339-952f-402c-9dc4-89e642daf08c service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:28.353803 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35972339-952f-402c-9dc4-89e642daf08c service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:28.354394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35972339-952f-402c-9dc4-89e642daf08c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:28.367175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35972339-952f-402c-9dc4-89e642daf08c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:28.368900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35972339-952f-402c-9dc4-89e642daf08c service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:28.399368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 891/1793] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:28.512882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f54fc9-e277-4603-bc5f-5d29e6a1c5c8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:28.514527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d8f54fc9-e277-4603-bc5f-5d29e6a1c5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:28.541703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35972339-952f-402c-9dc4-89e642daf08c service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:28.544770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-35972339-952f-402c-9dc4-89e642daf08c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:28.565214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35972339-952f-402c-9dc4-89e642daf08c service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:28.570250 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4a0c7-b89e-49b4-8ed4-545e3b14e17e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:28.571165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4a0c7-b89e-49b4-8ed4-545e3b14e17e service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:28.572804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4a0c7-b89e-49b4-8ed4-545e3b14e17e service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:28.573092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4a0c7-b89e-49b4-8ed4-545e3b14e17e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:28.577101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-39f4a0c7-b89e-49b4-8ed4-545e3b14e17e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:28.598621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:28.646003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f54fc9-e277-4603-bc5f-5d29e6a1c5c8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:28.664725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4a0c7-b89e-49b4-8ed4-545e3b14e17e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:28.666171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4a0c7-b89e-49b4-8ed4-545e3b14e17e service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:28.677055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 892/1794] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:33:28.677252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4a0c7-b89e-49b4-8ed4-545e3b14e17e service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:28.678484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-39f4a0c7-b89e-49b4-8ed4-545e3b14e17e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:28.718343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b96872-72e4-44aa-8e3e-f6763416ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:28.719483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b96872-72e4-44aa-8e3e-f6763416ebe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:28.719940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b96872-72e4-44aa-8e3e-f6763416ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:28.720414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b96872-72e4-44aa-8e3e-f6763416ebe3 admin admin] PATH_INFO: `/v3/projects/bf909e9b654f400994255294a02bd9b1` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:28.721776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b96872-72e4-44aa-8e3e-f6763416ebe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf909e9b654f400994255294a02bd9b1)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:28.724167 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b96872-72e4-44aa-8e3e-f6763416ebe3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:28.777311 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4a0c7-b89e-49b4-8ed4-545e3b14e17e service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:28.785983 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-19b96872-72e4-44aa-8e3e-f6763416ebe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf909e9b654f400994255294a02bd9b1', 'request_id': 'req-19b96872-72e4-44aa-8e3e-f6763416ebe3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:28.798002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-19b96872-72e4-44aa-8e3e-f6763416ebe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf909e9b654f400994255294a02bd9b1', 'request_id': 'req-19b96872-72e4-44aa-8e3e-f6763416ebe3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:28.813531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-19b96872-72e4-44aa-8e3e-f6763416ebe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf909e9b654f400994255294a02bd9b1', 'request_id': 'req-19b96872-72e4-44aa-8e3e-f6763416ebe3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:28.840278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-19b96872-72e4-44aa-8e3e-f6763416ebe3 admin admin] The token cache is being invalidate because project bf909e9b654f400994255294a02bd9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:28.840751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-19b96872-72e4-44aa-8e3e-f6763416ebe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:28.858692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-19b96872-72e4-44aa-8e3e-f6763416ebe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:28.861300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 903/1795] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:28 2022] DELETE /identity/v3/projects/bf909e9b654f400994255294a02bd9b1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:28.868970 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabc852-aaf7-4d59-b716-9634b0cf2e89 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:28.869253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabc852-aaf7-4d59-b716-9634b0cf2e89 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:28.869530 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabc852-aaf7-4d59-b716-9634b0cf2e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:28.905037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9be6b9-5fb9-4b78-8851-a7c35f36b617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:28.905660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9be6b9-5fb9-4b78-8851-a7c35f36b617 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:28.905934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9be6b9-5fb9-4b78-8851-a7c35f36b617 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:28.906213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9be6b9-5fb9-4b78-8851-a7c35f36b617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:28.912814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8f9be6b9-5fb9-4b78-8851-a7c35f36b617 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:28.921886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-cfabc852-aaf7-4d59-b716-9634b0cf2e89 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:28.923180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cfabc852-aaf7-4d59-b716-9634b0cf2e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:28.935924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9be6b9-5fb9-4b78-8851-a7c35f36b617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:28.938793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9be6b9-5fb9-4b78-8851-a7c35f36b617 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:28.951130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 893/1796] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:28.960146 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:29.002495 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 904/1797] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:29.009945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9085d52-97c4-4274-9aa3-93feb62950a2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.010291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9085d52-97c4-4274-9aa3-93feb62950a2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.010568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9085d52-97c4-4274-9aa3-93feb62950a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:29.033497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a9085d52-97c4-4274-9aa3-93feb62950a2 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:29.034694 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a9085d52-97c4-4274-9aa3-93feb62950a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:29.042981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 894/1798] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:29.047933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabc852-aaf7-4d59-b716-9634b0cf2e89 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:29.062176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabc852-aaf7-4d59-b716-9634b0cf2e89 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:29.069590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573471f2-da04-474a-b5d5-b51769816b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:29.070074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573471f2-da04-474a-b5d5-b51769816b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.070626 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573471f2-da04-474a-b5d5-b51769816b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.072299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573471f2-da04-474a-b5d5-b51769816b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:29.072975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573471f2-da04-474a-b5d5-b51769816b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:29.073280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573471f2-da04-474a-b5d5-b51769816b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:29.075428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573471f2-da04-474a-b5d5-b51769816b75 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:29.092405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 905/1799] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:33:29.096702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9085d52-97c4-4274-9aa3-93feb62950a2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:29.107302 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9085d52-97c4-4274-9aa3-93feb62950a2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:29.112682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e0c67-b264-4834-9cf4-078c6ea319dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:29.112890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e0c67-b264-4834-9cf4-078c6ea319dc admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.113171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e0c67-b264-4834-9cf4-078c6ea319dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.113443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e0c67-b264-4834-9cf4-078c6ea319dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:29.114078 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e0c67-b264-4834-9cf4-078c6ea319dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:29.116683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e0c67-b264-4834-9cf4-078c6ea319dc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:29.148284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 895/1800] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:29 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:29.153120 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573471f2-da04-474a-b5d5-b51769816b75 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:29.163413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573471f2-da04-474a-b5d5-b51769816b75 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:29.226300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a0e10-6e7c-4071-873d-5727fd1ccdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:29.227003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0e10-6e7c-4071-873d-5727fd1ccdf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.227309 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0e10-6e7c-4071-873d-5727fd1ccdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.227584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0e10-6e7c-4071-873d-5727fd1ccdf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:29.228204 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a0e10-6e7c-4071-873d-5727fd1ccdf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:29.230222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a0e10-6e7c-4071-873d-5727fd1ccdf9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:29.253962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 906/1801] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:29 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:29.258025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e0c67-b264-4834-9cf4-078c6ea319dc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:29.269914 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e0c67-b264-4834-9cf4-078c6ea319dc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:29.274878 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fad97-98e1-4cd6-832c-c95bf95346bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:29.275754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fad97-98e1-4cd6-832c-c95bf95346bf admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.276035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fad97-98e1-4cd6-832c-c95bf95346bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.276330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fad97-98e1-4cd6-832c-c95bf95346bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:29.276985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fad97-98e1-4cd6-832c-c95bf95346bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:29.279751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fad97-98e1-4cd6-832c-c95bf95346bf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:29.281128 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:29.291805 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 896/1802] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:29.296673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a0e10-6e7c-4071-873d-5727fd1ccdf9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:29.306744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a0e10-6e7c-4071-873d-5727fd1ccdf9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:29.311439 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c7485-9c54-4954-aa75-1f2de356fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:29.312035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c7485-9c54-4954-aa75-1f2de356fcdb admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.312308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c7485-9c54-4954-aa75-1f2de356fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.312572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c7485-9c54-4954-aa75-1f2de356fcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:29.313456 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c7485-9c54-4954-aa75-1f2de356fcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:29.314767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c7485-9c54-4954-aa75-1f2de356fcdb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:29.325937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 907/1803] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:29.330253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fad97-98e1-4cd6-832c-c95bf95346bf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:29.341669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fad97-98e1-4cd6-832c-c95bf95346bf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:29.347798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13505b9-f91e-466a-aabc-e1c3b71f3011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:29.349317 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13505b9-f91e-466a-aabc-e1c3b71f3011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.349697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13505b9-f91e-466a-aabc-e1c3b71f3011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.349972 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13505b9-f91e-466a-aabc-e1c3b71f3011 admin admin] PATH_INFO: `/v3/projects/bb1ed98510524c58ad0822ea30b3a069/users/d938562629ef460ab011195fc857250d/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:29.370582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13505b9-f91e-466a-aabc-e1c3b71f3011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1ed98510524c58ad0822ea30b3a069, user_id=d938562629ef460ab011195fc857250d, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:29.373284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13505b9-f91e-466a-aabc-e1c3b71f3011 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:29.390745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 897/1804] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:29 2022] PUT /identity/v3/projects/bb1ed98510524c58ad0822ea30b3a069/users/d938562629ef460ab011195fc857250d/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:29.404455 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666078f-4b22-45d5-9f70-bca3dce3bbf9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.404740 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666078f-4b22-45d5-9f70-bca3dce3bbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.405010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666078f-4b22-45d5-9f70-bca3dce3bbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:29.435413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7666078f-4b22-45d5-9f70-bca3dce3bbf9 None None] MFA Rules not processed for user `d938562629ef460ab011195fc857250d`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:29.436660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7666078f-4b22-45d5-9f70-bca3dce3bbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:29.525831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 908/1805] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:29.530744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13505b9-f91e-466a-aabc-e1c3b71f3011 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:29.653332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13505b9-f91e-466a-aabc-e1c3b71f3011 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:29.663035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70701fdf-5927-4cd1-a3bb-ba385a332207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:29.663687 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70701fdf-5927-4cd1-a3bb-ba385a332207 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.667362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70701fdf-5927-4cd1-a3bb-ba385a332207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.667362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70701fdf-5927-4cd1-a3bb-ba385a332207 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:29.667362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70701fdf-5927-4cd1-a3bb-ba385a332207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:29.667362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70701fdf-5927-4cd1-a3bb-ba385a332207 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:29.704889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 898/1806] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:29 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:29.709228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666078f-4b22-45d5-9f70-bca3dce3bbf9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:29.727864 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666078f-4b22-45d5-9f70-bca3dce3bbf9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:29.766326 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:29.814753 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cc9c7-0713-45cf-a02e-34899866a1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:29.815511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc9c7-0713-45cf-a02e-34899866a1aa admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.815823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc9c7-0713-45cf-a02e-34899866a1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.816412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc9c7-0713-45cf-a02e-34899866a1aa admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:29.816875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cc9c7-0713-45cf-a02e-34899866a1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:29.819599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cc9c7-0713-45cf-a02e-34899866a1aa admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:29.847123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 909/1807] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:29 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:29.850258 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70701fdf-5927-4cd1-a3bb-ba385a332207 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:29.862230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70701fdf-5927-4cd1-a3bb-ba385a332207 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:29.868154 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ad534-0d49-4c59-a459-54fd46401f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:29.868778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ad534-0d49-4c59-a459-54fd46401f0b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.869048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ad534-0d49-4c59-a459-54fd46401f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.869312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ad534-0d49-4c59-a459-54fd46401f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:29.869954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ad534-0d49-4c59-a459-54fd46401f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:29.872576 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ad534-0d49-4c59-a459-54fd46401f0b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:29.885576 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 899/1808] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:29.889990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cc9c7-0713-45cf-a02e-34899866a1aa admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:29.905674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cc9c7-0713-45cf-a02e-34899866a1aa admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:29.914776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d54a5-54f2-4eae-a612-c60f70898330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:29.916368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d54a5-54f2-4eae-a612-c60f70898330 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.916781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d54a5-54f2-4eae-a612-c60f70898330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.916931 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d54a5-54f2-4eae-a612-c60f70898330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:29.918133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d54a5-54f2-4eae-a612-c60f70898330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:29.920189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d54a5-54f2-4eae-a612-c60f70898330 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:29.959154 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 910/1809] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:29.961234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ad534-0d49-4c59-a459-54fd46401f0b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:29.973934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ad534-0d49-4c59-a459-54fd46401f0b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:29.980168 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d5ece-698c-4836-af06-ac366ba5cc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:29.981303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d5ece-698c-4836-af06-ac366ba5cc10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:29.981746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d5ece-698c-4836-af06-ac366ba5cc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:29.982168 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d5ece-698c-4836-af06-ac366ba5cc10 admin admin] PATH_INFO: `/v3/projects/a04cb0fe8a2447ff892483b9d86b70d4/users/ef7122aa8c534d0480d7665f859dbebc/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:30.001286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d5ece-698c-4836-af06-ac366ba5cc10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04cb0fe8a2447ff892483b9d86b70d4, user_id=ef7122aa8c534d0480d7665f859dbebc, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:30.005130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d5ece-698c-4836-af06-ac366ba5cc10 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:30.025181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 900/1810] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:29 2022] PUT /identity/v3/projects/a04cb0fe8a2447ff892483b9d86b70d4/users/ef7122aa8c534d0480d7665f859dbebc/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:30.036313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99557ad-fd2c-4fda-afa6-579b89d0ab83 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:30.036600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99557ad-fd2c-4fda-afa6-579b89d0ab83 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:30.036870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99557ad-fd2c-4fda-afa6-579b89d0ab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:30.082117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f99557ad-fd2c-4fda-afa6-579b89d0ab83 None None] MFA Rules not processed for user `ef7122aa8c534d0480d7665f859dbebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:30.083413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f99557ad-fd2c-4fda-afa6-579b89d0ab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:30.156110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 911/1811] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:30.159604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d5ece-698c-4836-af06-ac366ba5cc10 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:30.236944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d5ece-698c-4836-af06-ac366ba5cc10 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:30.245134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0337-a793-4c2d-8c31-bf1fbd5b0ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:30.245807 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0337-a793-4c2d-8c31-bf1fbd5b0ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:30.246088 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0337-a793-4c2d-8c31-bf1fbd5b0ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:30.246961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0337-a793-4c2d-8c31-bf1fbd5b0ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:30.247670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0337-a793-4c2d-8c31-bf1fbd5b0ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:30.249998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0337-a793-4c2d-8c31-bf1fbd5b0ab7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:30.283193 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 901/1812] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:30 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:30.287265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99557ad-fd2c-4fda-afa6-579b89d0ab83 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:30.304157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99557ad-fd2c-4fda-afa6-579b89d0ab83 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:30.393885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a94006-7f44-4c78-945b-5ebbbf83366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:30.397411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a94006-7f44-4c78-945b-5ebbbf83366d admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:30.397411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a94006-7f44-4c78-945b-5ebbbf83366d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:30.397411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a94006-7f44-4c78-945b-5ebbbf83366d admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:30.397411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a94006-7f44-4c78-945b-5ebbbf83366d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:30.397887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a94006-7f44-4c78-945b-5ebbbf83366d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:30.444810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 912/1813] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:30 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:30.446466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0337-a793-4c2d-8c31-bf1fbd5b0ab7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:30.460778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0337-a793-4c2d-8c31-bf1fbd5b0ab7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:30.472338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0fbd1-a37d-46b4-9f21-3a2b05c03ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:30.473075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0fbd1-a37d-46b4-9f21-3a2b05c03ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:30.473245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0fbd1-a37d-46b4-9f21-3a2b05c03ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:30.473507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0fbd1-a37d-46b4-9f21-3a2b05c03ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:30.474231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0fbd1-a37d-46b4-9f21-3a2b05c03ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:30.476031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0fbd1-a37d-46b4-9f21-3a2b05c03ae1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:30.477554 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:30.492977 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 902/1814] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:30.497577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a94006-7f44-4c78-945b-5ebbbf83366d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:30.508400 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a94006-7f44-4c78-945b-5ebbbf83366d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:30.513615 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b6792-aa78-4549-a1f3-237443d033db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:30.514281 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b6792-aa78-4549-a1f3-237443d033db admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:30.514559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b6792-aa78-4549-a1f3-237443d033db admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:30.514899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b6792-aa78-4549-a1f3-237443d033db admin admin] PATH_INFO: `/v3/projects/4c073411471942619a8ec43fcbff094a/users/62ea3f32dcc64d99b994108dcbd1c581/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:30.538975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b6792-aa78-4549-a1f3-237443d033db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c073411471942619a8ec43fcbff094a, user_id=62ea3f32dcc64d99b994108dcbd1c581, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:30.544068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b6792-aa78-4549-a1f3-237443d033db admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:30.553567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:30.560009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 913/1815] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:30 2022] PUT /identity/v3/projects/4c073411471942619a8ec43fcbff094a/users/62ea3f32dcc64d99b994108dcbd1c581/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:30.563815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0fbd1-a37d-46b4-9f21-3a2b05c03ae1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:30.573992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0fbd1-a37d-46b4-9f21-3a2b05c03ae1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:30.637033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901e8e0-6047-44da-97e6-4482e9aee378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:30.637905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901e8e0-6047-44da-97e6-4482e9aee378 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:30.638182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901e8e0-6047-44da-97e6-4482e9aee378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:30.638454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901e8e0-6047-44da-97e6-4482e9aee378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:30.639124 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901e8e0-6047-44da-97e6-4482e9aee378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:30.640755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901e8e0-6047-44da-97e6-4482e9aee378 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:30.650919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 903/1816] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:30.655791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b6792-aa78-4549-a1f3-237443d033db admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:30.666897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b6792-aa78-4549-a1f3-237443d033db admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:30.672910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d870bd1-f5f8-4318-ada2-f62430a294fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:30.673663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d870bd1-f5f8-4318-ada2-f62430a294fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:30.673833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d870bd1-f5f8-4318-ada2-f62430a294fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:30.674099 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d870bd1-f5f8-4318-ada2-f62430a294fd admin admin] PATH_INFO: `/v3/projects/4c073411471942619a8ec43fcbff094a/users/62ea3f32dcc64d99b994108dcbd1c581/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:30.676060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d870bd1-f5f8-4318-ada2-f62430a294fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c073411471942619a8ec43fcbff094a, user_id=62ea3f32dcc64d99b994108dcbd1c581, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:30.679764 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d870bd1-f5f8-4318-ada2-f62430a294fd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:30.700492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 914/1817] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:30 2022] PUT /identity/v3/projects/4c073411471942619a8ec43fcbff094a/users/62ea3f32dcc64d99b994108dcbd1c581/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:30.704571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075b5f2-e676-45ad-a23e-19f78bda51c2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:30.704954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075b5f2-e676-45ad-a23e-19f78bda51c2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:30.705239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075b5f2-e676-45ad-a23e-19f78bda51c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:30.757957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6075b5f2-e676-45ad-a23e-19f78bda51c2 None None] MFA Rules not processed for user `62ea3f32dcc64d99b994108dcbd1c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:30.759538 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6075b5f2-e676-45ad-a23e-19f78bda51c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:30.856585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 904/1818] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:30.870682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d870bd1-f5f8-4318-ada2-f62430a294fd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:30.873222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9d870bd1-f5f8-4318-ada2-f62430a294fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:30.910048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075b5f2-e676-45ad-a23e-19f78bda51c2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:30.911683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6075b5f2-e676-45ad-a23e-19f78bda51c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:30.962998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d870bd1-f5f8-4318-ada2-f62430a294fd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:30.968110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87826a6-411b-45ca-9d14-6d9400209198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:30.968916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87826a6-411b-45ca-9d14-6d9400209198 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:30.969102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87826a6-411b-45ca-9d14-6d9400209198 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:30.969366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87826a6-411b-45ca-9d14-6d9400209198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:30.980041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87826a6-411b-45ca-9d14-6d9400209198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:30.981508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87826a6-411b-45ca-9d14-6d9400209198 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:30.990933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075b5f2-e676-45ad-a23e-19f78bda51c2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:30.997022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 915/1819] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:30.997150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:30.997867 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:30.998263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:30.998605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] PATH_INFO: `/v3/users/c0e276701e44473bb9c12e341b5d6ebd` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:30.999856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e276701e44473bb9c12e341b5d6ebd)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:31.001853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:31.027101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:31.063897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e276701e44473bb9c12e341b5d6ebd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:31.078638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e276701e44473bb9c12e341b5d6ebd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:31.080153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e276701e44473bb9c12e341b5d6ebd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:31.080944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e276701e44473bb9c12e341b5d6ebd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:31.103570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e276701e44473bb9c12e341b5d6ebd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:31.127452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 905/1820] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:30 2022] DELETE /identity/v3/users/c0e276701e44473bb9c12e341b5d6ebd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:31.128837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2b571-bc24-472e-aa53-e22ea78e5d1b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:31.129211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2b571-bc24-472e-aa53-e22ea78e5d1b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:31.129479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2b571-bc24-472e-aa53-e22ea78e5d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:31.149054 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d9a2b571-bc24-472e-aa53-e22ea78e5d1b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:31.150505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d9a2b571-bc24-472e-aa53-e22ea78e5d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:31.217428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 916/1821] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:31.227133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:31.228588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:31.289597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77865441-430a-4972-836a-7e75c26f4a0e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:31.293431 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7372f8-54ec-41ac-86bb-c2ba08fd3526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:31.294044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7372f8-54ec-41ac-86bb-c2ba08fd3526 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:31.294321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7372f8-54ec-41ac-86bb-c2ba08fd3526 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:31.294590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7372f8-54ec-41ac-86bb-c2ba08fd3526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:31.303866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7372f8-54ec-41ac-86bb-c2ba08fd3526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:31.305231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7372f8-54ec-41ac-86bb-c2ba08fd3526 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:31.315952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 906/1822] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:31.583004 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2b571-bc24-472e-aa53-e22ea78e5d1b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:31.584776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d9a2b571-bc24-472e-aa53-e22ea78e5d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:31.661861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2b571-bc24-472e-aa53-e22ea78e5d1b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:31.665835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d75df-fe32-4a59-bc51-046bb123b09c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:31.666512 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d75df-fe32-4a59-bc51-046bb123b09c service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:31.666794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d75df-fe32-4a59-bc51-046bb123b09c service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:31.667212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d75df-fe32-4a59-bc51-046bb123b09c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:31.669299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-121d75df-fe32-4a59-bc51-046bb123b09c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:31.671424 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7372f8-54ec-41ac-86bb-c2ba08fd3526 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:31.673695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ba7372f8-54ec-41ac-86bb-c2ba08fd3526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:31.697502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7372f8-54ec-41ac-86bb-c2ba08fd3526 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:31.710724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:31.711405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:31.712769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:31.713044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] PATH_INFO: `/v3/projects/b27919390da94223aa66c19e3bcaefa2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:31.714401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27919390da94223aa66c19e3bcaefa2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:31.716364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:31.723744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:31.750358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d75df-fe32-4a59-bc51-046bb123b09c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:31.751915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d75df-fe32-4a59-bc51-046bb123b09c service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:31.764236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 917/1823] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:31.794074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27919390da94223aa66c19e3bcaefa2', 'request_id': 'req-ec261cfb-9168-4091-835d-7af54492f287'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:31.803169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27919390da94223aa66c19e3bcaefa2', 'request_id': 'req-ec261cfb-9168-4091-835d-7af54492f287'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:31.812342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27919390da94223aa66c19e3bcaefa2', 'request_id': 'req-ec261cfb-9168-4091-835d-7af54492f287'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:31.844243 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] The token cache is being invalidate because project b27919390da94223aa66c19e3bcaefa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:31.844964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:31.846205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:31.848277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 907/1824] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:31 2022] DELETE /identity/v3/projects/b27919390da94223aa66c19e3bcaefa2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:31.852730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d75df-fe32-4a59-bc51-046bb123b09c service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:31.869746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d75df-fe32-4a59-bc51-046bb123b09c service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:31.955994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325babc-76aa-48ae-aee1-8700ab62e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:31.958821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325babc-76aa-48ae-aee1-8700ab62e0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:31.959871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325babc-76aa-48ae-aee1-8700ab62e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:31.962275 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325babc-76aa-48ae-aee1-8700ab62e0b6 admin admin] PATH_INFO: `/v3/users/bd5ea4e7e59d4e7f9cdbc498c220a351` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:31.964478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325babc-76aa-48ae-aee1-8700ab62e0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5ea4e7e59d4e7f9cdbc498c220a351)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:31.968800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325babc-76aa-48ae-aee1-8700ab62e0b6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:32.035955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c325babc-76aa-48ae-aee1-8700ab62e0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5ea4e7e59d4e7f9cdbc498c220a351'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:32.044240 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c325babc-76aa-48ae-aee1-8700ab62e0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5ea4e7e59d4e7f9cdbc498c220a351'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:32.054001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c325babc-76aa-48ae-aee1-8700ab62e0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5ea4e7e59d4e7f9cdbc498c220a351'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:32.054782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c325babc-76aa-48ae-aee1-8700ab62e0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5ea4e7e59d4e7f9cdbc498c220a351'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:32.078134 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c325babc-76aa-48ae-aee1-8700ab62e0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5ea4e7e59d4e7f9cdbc498c220a351'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:32.078134 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 918/1825] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:31 2022] DELETE /identity/v3/users/bd5ea4e7e59d4e7f9cdbc498c220a351 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:32.391700 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:32.393284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:32.407342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec261cfb-9168-4091-835d-7af54492f287 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:32.427105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:32.468861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9a503-b3eb-4f33-8511-a2d30ead9739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:32.469595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9a503-b3eb-4f33-8511-a2d30ead9739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:32.469892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9a503-b3eb-4f33-8511-a2d30ead9739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:32.470203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9a503-b3eb-4f33-8511-a2d30ead9739 admin admin] PATH_INFO: `/v3/projects/6bfe5c9589194741b9d39b4e39512a58` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:32.471484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9a503-b3eb-4f33-8511-a2d30ead9739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfe5c9589194741b9d39b4e39512a58)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:32.473545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9a503-b3eb-4f33-8511-a2d30ead9739 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:32.604118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-abc9a503-b3eb-4f33-8511-a2d30ead9739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfe5c9589194741b9d39b4e39512a58', 'request_id': 'req-abc9a503-b3eb-4f33-8511-a2d30ead9739'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:32.651239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-abc9a503-b3eb-4f33-8511-a2d30ead9739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfe5c9589194741b9d39b4e39512a58', 'request_id': 'req-abc9a503-b3eb-4f33-8511-a2d30ead9739'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:32.668234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-abc9a503-b3eb-4f33-8511-a2d30ead9739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfe5c9589194741b9d39b4e39512a58', 'request_id': 'req-abc9a503-b3eb-4f33-8511-a2d30ead9739'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:32.690463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-abc9a503-b3eb-4f33-8511-a2d30ead9739 admin admin] The token cache is being invalidate because project 6bfe5c9589194741b9d39b4e39512a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:32.691529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-abc9a503-b3eb-4f33-8511-a2d30ead9739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:32.692387 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-abc9a503-b3eb-4f33-8511-a2d30ead9739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:32.694306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 908/1826] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:32 2022] DELETE /identity/v3/projects/6bfe5c9589194741b9d39b4e39512a58 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:32.699836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63dd62-ba93-46e0-a869-2d344788e43a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:32.700572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63dd62-ba93-46e0-a869-2d344788e43a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:32.700572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63dd62-ba93-46e0-a869-2d344788e43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:32.720721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1a63dd62-ba93-46e0-a869-2d344788e43a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:32.721978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1a63dd62-ba93-46e0-a869-2d344788e43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:32.793315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 919/1827] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:32.801394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604b875-eb39-4143-bd38-445f1b9b9054 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:32.801672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604b875-eb39-4143-bd38-445f1b9b9054 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:32.801939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604b875-eb39-4143-bd38-445f1b9b9054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:32.822432 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6604b875-eb39-4143-bd38-445f1b9b9054 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:32.823656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6604b875-eb39-4143-bd38-445f1b9b9054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:32.832494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 909/1828] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:32.836888 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63dd62-ba93-46e0-a869-2d344788e43a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:32.842962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:32.847007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63dd62-ba93-46e0-a869-2d344788e43a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:32.852789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f1f70-e41c-4722-8749-503182d04e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:32.853410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f1f70-e41c-4722-8749-503182d04e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:32.853853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f1f70-e41c-4722-8749-503182d04e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:32.854177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f1f70-e41c-4722-8749-503182d04e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:32.854949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f1f70-e41c-4722-8749-503182d04e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:32.855340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f1f70-e41c-4722-8749-503182d04e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:32.857079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f1f70-e41c-4722-8749-503182d04e36 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:32.868302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 920/1829] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:33:32.873297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604b875-eb39-4143-bd38-445f1b9b9054 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:32.882911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604b875-eb39-4143-bd38-445f1b9b9054 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:32.888829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65ab3-f561-4b1e-aaac-79ff3de2a382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:32.889512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65ab3-f561-4b1e-aaac-79ff3de2a382 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:32.889790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65ab3-f561-4b1e-aaac-79ff3de2a382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:32.890056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65ab3-f561-4b1e-aaac-79ff3de2a382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:32.890696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d65ab3-f561-4b1e-aaac-79ff3de2a382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:32.892762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d65ab3-f561-4b1e-aaac-79ff3de2a382 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:32.927800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 910/1830] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:32 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:33:32.931968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f1f70-e41c-4722-8749-503182d04e36 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:32.942391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f1f70-e41c-4722-8749-503182d04e36 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:33.069798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abed432-25a6-4634-b2dc-aa9bc59be993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:33.070375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abed432-25a6-4634-b2dc-aa9bc59be993 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:33.070459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abed432-25a6-4634-b2dc-aa9bc59be993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:33.070714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abed432-25a6-4634-b2dc-aa9bc59be993 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:33.071392 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abed432-25a6-4634-b2dc-aa9bc59be993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:33.073462 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abed432-25a6-4634-b2dc-aa9bc59be993 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:33.099581 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 921/1831] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:32 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:33.100816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65ab3-f561-4b1e-aaac-79ff3de2a382 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:33.111952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65ab3-f561-4b1e-aaac-79ff3de2a382 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:33.117860 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ed343-9172-4e1c-a718-e8a94a786e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:33.118523 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ed343-9172-4e1c-a718-e8a94a786e72 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:33.118807 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ed343-9172-4e1c-a718-e8a94a786e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:33.119099 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ed343-9172-4e1c-a718-e8a94a786e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:33.119856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ed343-9172-4e1c-a718-e8a94a786e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:33.121560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ed343-9172-4e1c-a718-e8a94a786e72 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:33.143436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 911/1832] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:33.143607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abed432-25a6-4634-b2dc-aa9bc59be993 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:33.167824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abed432-25a6-4634-b2dc-aa9bc59be993 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:33.185746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66799720-15d2-4916-b6ac-19a894f33767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:33.186373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66799720-15d2-4916-b6ac-19a894f33767 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:33.186650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66799720-15d2-4916-b6ac-19a894f33767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:33.186923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66799720-15d2-4916-b6ac-19a894f33767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:33.187599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66799720-15d2-4916-b6ac-19a894f33767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:33.189308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66799720-15d2-4916-b6ac-19a894f33767 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:33.287836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 922/1833] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:33.292001 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ed343-9172-4e1c-a718-e8a94a786e72 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:33.329149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ed343-9172-4e1c-a718-e8a94a786e72 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:33.344774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff9b35-6562-45c0-928a-e79333f206c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:33.345539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff9b35-6562-45c0-928a-e79333f206c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:33.345821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff9b35-6562-45c0-928a-e79333f206c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:33.346101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff9b35-6562-45c0-928a-e79333f206c5 admin admin] PATH_INFO: `/v3/projects/5a7a9880ff214f638376ad118fc4b012/users/e0dbd47f67074324afbb05099e68a57e/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:33.378273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff9b35-6562-45c0-928a-e79333f206c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7a9880ff214f638376ad118fc4b012, user_id=e0dbd47f67074324afbb05099e68a57e, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:33.383077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff9b35-6562-45c0-928a-e79333f206c5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:33.424160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 912/1834] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:33 2022] PUT /identity/v3/projects/5a7a9880ff214f638376ad118fc4b012/users/e0dbd47f67074324afbb05099e68a57e/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:33.426194 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04678123-f236-4258-a302-1264c5a2a868 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:33.426759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04678123-f236-4258-a302-1264c5a2a868 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:33.427322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04678123-f236-4258-a302-1264c5a2a868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:33.487120 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-04678123-f236-4258-a302-1264c5a2a868 None None] MFA Rules not processed for user `e0dbd47f67074324afbb05099e68a57e`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:33.489334 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-04678123-f236-4258-a302-1264c5a2a868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:33.599548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 923/1835] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:33.604372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff9b35-6562-45c0-928a-e79333f206c5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:33.665955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:33.687719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff9b35-6562-45c0-928a-e79333f206c5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:33.704005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38e970-2f38-49b3-98de-b0f66e98725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:33.705739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38e970-2f38-49b3-98de-b0f66e98725f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:33.705925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38e970-2f38-49b3-98de-b0f66e98725f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:33.706159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38e970-2f38-49b3-98de-b0f66e98725f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:33.708810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38e970-2f38-49b3-98de-b0f66e98725f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:33.711974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38e970-2f38-49b3-98de-b0f66e98725f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:33.755101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 913/1836] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:33 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:33.760180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04678123-f236-4258-a302-1264c5a2a868 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:33.792687 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04678123-f236-4258-a302-1264c5a2a868 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:33.866326 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5a9f9-0281-4b82-afbe-aea21debaf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:33.867032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5a9f9-0281-4b82-afbe-aea21debaf83 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:33.867409 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5a9f9-0281-4b82-afbe-aea21debaf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:33.867742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5a9f9-0281-4b82-afbe-aea21debaf83 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:33.868566 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5a9f9-0281-4b82-afbe-aea21debaf83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:33.870570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5a9f9-0281-4b82-afbe-aea21debaf83 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:33.879249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:33.912674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 924/1837] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:33 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:33.914317 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38e970-2f38-49b3-98de-b0f66e98725f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:33.928340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38e970-2f38-49b3-98de-b0f66e98725f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:33.933247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45f9ca-514c-44f7-8076-0ca0a078564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:33.933854 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45f9ca-514c-44f7-8076-0ca0a078564c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:33.934111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45f9ca-514c-44f7-8076-0ca0a078564c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:33.934376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45f9ca-514c-44f7-8076-0ca0a078564c admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:33.935019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45f9ca-514c-44f7-8076-0ca0a078564c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:33.936790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45f9ca-514c-44f7-8076-0ca0a078564c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:33.947935 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 914/1838] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:33.952572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5a9f9-0281-4b82-afbe-aea21debaf83 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:33.962570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5a9f9-0281-4b82-afbe-aea21debaf83 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:33.968161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cee748-d219-4523-bad7-18008c524ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:33.968823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee748-d219-4523-bad7-18008c524ade admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:33.969106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee748-d219-4523-bad7-18008c524ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:33.969487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee748-d219-4523-bad7-18008c524ade admin admin] PATH_INFO: `/v3/projects/ea04cda2068147bfb0d1f3fc17d9a164/users/f04e69ad2bdb4e0387fb012e5c8c5653/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:33.986261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cee748-d219-4523-bad7-18008c524ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea04cda2068147bfb0d1f3fc17d9a164, user_id=f04e69ad2bdb4e0387fb012e5c8c5653, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:33.989041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cee748-d219-4523-bad7-18008c524ade admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:34.003990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 925/1839] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:33 2022] PUT /identity/v3/projects/ea04cda2068147bfb0d1f3fc17d9a164/users/f04e69ad2bdb4e0387fb012e5c8c5653/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:34.007999 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45f9ca-514c-44f7-8076-0ca0a078564c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:34.018985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45f9ca-514c-44f7-8076-0ca0a078564c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:34.080276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc49a74-3790-4117-af96-af737977444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:34.080904 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc49a74-3790-4117-af96-af737977444d admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:34.081171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc49a74-3790-4117-af96-af737977444d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:34.081439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc49a74-3790-4117-af96-af737977444d admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:34.082075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc49a74-3790-4117-af96-af737977444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:34.083678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc49a74-3790-4117-af96-af737977444d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:34.093995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 915/1840] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:34.097974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cee748-d219-4523-bad7-18008c524ade admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:34.108353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cee748-d219-4523-bad7-18008c524ade admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:34.112976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf864-eee6-4350-bbf0-d29da45d680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:34.113619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf864-eee6-4350-bbf0-d29da45d680a admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:34.113895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf864-eee6-4350-bbf0-d29da45d680a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:34.114243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf864-eee6-4350-bbf0-d29da45d680a admin admin] PATH_INFO: `/v3/projects/ea04cda2068147bfb0d1f3fc17d9a164/users/f04e69ad2bdb4e0387fb012e5c8c5653/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:34.116166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baf864-eee6-4350-bbf0-d29da45d680a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea04cda2068147bfb0d1f3fc17d9a164, user_id=f04e69ad2bdb4e0387fb012e5c8c5653, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:34.119988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baf864-eee6-4350-bbf0-d29da45d680a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:34.130889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 926/1841] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:34 2022] PUT /identity/v3/projects/ea04cda2068147bfb0d1f3fc17d9a164/users/f04e69ad2bdb4e0387fb012e5c8c5653/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:34.142910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab6bbb-b0b3-4160-bb07-0609e740ba4e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:34.143355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab6bbb-b0b3-4160-bb07-0609e740ba4e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:34.143649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab6bbb-b0b3-4160-bb07-0609e740ba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:34.175378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-76ab6bbb-b0b3-4160-bb07-0609e740ba4e None None] MFA Rules not processed for user `f04e69ad2bdb4e0387fb012e5c8c5653`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:34.176630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-76ab6bbb-b0b3-4160-bb07-0609e740ba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:34.247763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 916/1842] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:34.259713 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf864-eee6-4350-bbf0-d29da45d680a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:34.261521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d3baf864-eee6-4350-bbf0-d29da45d680a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:34.318508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf864-eee6-4350-bbf0-d29da45d680a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:34.322308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d9b5c-c084-4817-ba34-7941c0bb9347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:34.322901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9b5c-c084-4817-ba34-7941c0bb9347 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:34.323210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9b5c-c084-4817-ba34-7941c0bb9347 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:34.323478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9b5c-c084-4817-ba34-7941c0bb9347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:34.332837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d9b5c-c084-4817-ba34-7941c0bb9347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:34.334234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d9b5c-c084-4817-ba34-7941c0bb9347 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:34.343459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 927/1843] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:34.429843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab6bbb-b0b3-4160-bb07-0609e740ba4e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:34.439769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab6bbb-b0b3-4160-bb07-0609e740ba4e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:34.443306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028da022-9b36-41b7-9c1f-cb42ff5e9970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:34.443889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028da022-9b36-41b7-9c1f-cb42ff5e9970 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:34.444162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028da022-9b36-41b7-9c1f-cb42ff5e9970 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:34.444432 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028da022-9b36-41b7-9c1f-cb42ff5e9970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:34.485002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:34.501065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028da022-9b36-41b7-9c1f-cb42ff5e9970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:34.502482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028da022-9b36-41b7-9c1f-cb42ff5e9970 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:34.511101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 917/1844] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:34.854841 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d9b5c-c084-4817-ba34-7941c0bb9347 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:35.016971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d9b5c-c084-4817-ba34-7941c0bb9347 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:35.025475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:35.028083 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:35.029616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:35.030106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] PATH_INFO: `/v3/users/e0dbd47f67074324afbb05099e68a57e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:35.032825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0dbd47f67074324afbb05099e68a57e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:35.036591 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:35.114762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0dbd47f67074324afbb05099e68a57e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:35.126966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0dbd47f67074324afbb05099e68a57e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:35.130973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:35.157871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0dbd47f67074324afbb05099e68a57e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:35.158634 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0dbd47f67074324afbb05099e68a57e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:35.185599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0dbd47f67074324afbb05099e68a57e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:35.194375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 928/1845] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:34 2022] DELETE /identity/v3/users/e0dbd47f67074324afbb05099e68a57e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:35.198599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71fc1d-bed3-4868-8aaa-97460e0470b6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:35.199113 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71fc1d-bed3-4868-8aaa-97460e0470b6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:35.200096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71fc1d-bed3-4868-8aaa-97460e0470b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:35.246937 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8f71fc1d-bed3-4868-8aaa-97460e0470b6 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:35.249599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8f71fc1d-bed3-4868-8aaa-97460e0470b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:35.338292 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 918/1846] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:35.348079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:35.351231 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:35.461612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0454f5-0422-429f-a3b9-d601ffc4109b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:35.465895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f1a1f-8140-4dbe-bc61-847848fb85a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:35.466693 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f1a1f-8140-4dbe-bc61-847848fb85a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:35.467044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f1a1f-8140-4dbe-bc61-847848fb85a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:35.467464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f1a1f-8140-4dbe-bc61-847848fb85a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:35.486298 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f1a1f-8140-4dbe-bc61-847848fb85a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:35.487871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f1a1f-8140-4dbe-bc61-847848fb85a6 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:35.501932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 929/1847] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:35.905053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71fc1d-bed3-4868-8aaa-97460e0470b6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:35.906493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8f71fc1d-bed3-4868-8aaa-97460e0470b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:35.920329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71fc1d-bed3-4868-8aaa-97460e0470b6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:35.925072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:35.925702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:35.925978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:35.926288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] PATH_INFO: `/v3/projects/5a7a9880ff214f638376ad118fc4b012` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:35.927901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7a9880ff214f638376ad118fc4b012)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:35.929800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:35.983038 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7a9880ff214f638376ad118fc4b012', 'request_id': 'req-972f4b28-8171-4782-b057-fd9d16926ffd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:35.989064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7a9880ff214f638376ad118fc4b012', 'request_id': 'req-972f4b28-8171-4782-b057-fd9d16926ffd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:35.996781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7a9880ff214f638376ad118fc4b012', 'request_id': 'req-972f4b28-8171-4782-b057-fd9d16926ffd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.012049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] The token cache is being invalidate because project 5a7a9880ff214f638376ad118fc4b012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:36.012814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.013747 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.015709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 919/1848] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:35 2022] DELETE /identity/v3/projects/5a7a9880ff214f638376ad118fc4b012 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:36.020237 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f1a1f-8140-4dbe-bc61-847848fb85a6 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:36.031123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f1a1f-8140-4dbe-bc61-847848fb85a6 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:36.095313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:36.095953 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:36.096217 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:36.096490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] PATH_INFO: `/v3/users/f04e69ad2bdb4e0387fb012e5c8c5653` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:36.097642 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04e69ad2bdb4e0387fb012e5c8c5653)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:36.099584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:36.170051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04e69ad2bdb4e0387fb012e5c8c5653'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.179248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04e69ad2bdb4e0387fb012e5c8c5653'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.191705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04e69ad2bdb4e0387fb012e5c8c5653'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.193962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04e69ad2bdb4e0387fb012e5c8c5653'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.213220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:36.216425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04e69ad2bdb4e0387fb012e5c8c5653'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.224447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 930/1849] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:36 2022] DELETE /identity/v3/users/f04e69ad2bdb4e0387fb012e5c8c5653 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:36.330224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:36.331690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:36.395986 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f4b28-8171-4782-b057-fd9d16926ffd admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:36.417109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:36.469641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87464aac-3711-4746-8dc4-83d0a8eec903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:36.470836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87464aac-3711-4746-8dc4-83d0a8eec903 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:36.471234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87464aac-3711-4746-8dc4-83d0a8eec903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:36.471513 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87464aac-3711-4746-8dc4-83d0a8eec903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:36.485664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-87464aac-3711-4746-8dc4-83d0a8eec903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:36.573753 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:36.575757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:36.594183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87464aac-3711-4746-8dc4-83d0a8eec903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:36.595880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87464aac-3711-4746-8dc4-83d0a8eec903 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:36.609189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 920/1850] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:36.672503 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9fce4-57c5-4ce9-90a9-a15d6b3b842f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:36.681125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf61cc-9ecc-492f-9011-1dfa291e2026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:36.681609 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf61cc-9ecc-492f-9011-1dfa291e2026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:36.682170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf61cc-9ecc-492f-9011-1dfa291e2026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:36.682950 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf61cc-9ecc-492f-9011-1dfa291e2026 admin admin] PATH_INFO: `/v3/projects/ea04cda2068147bfb0d1f3fc17d9a164` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:36.684872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf61cc-9ecc-492f-9011-1dfa291e2026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea04cda2068147bfb0d1f3fc17d9a164)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:36.687845 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf61cc-9ecc-492f-9011-1dfa291e2026 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:36.749835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87464aac-3711-4746-8dc4-83d0a8eec903 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:36.751498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-87464aac-3711-4746-8dc4-83d0a8eec903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:36.770589 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87464aac-3711-4746-8dc4-83d0a8eec903 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:36.795859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-88cf61cc-9ecc-492f-9011-1dfa291e2026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea04cda2068147bfb0d1f3fc17d9a164', 'request_id': 'req-88cf61cc-9ecc-492f-9011-1dfa291e2026'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.811055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-88cf61cc-9ecc-492f-9011-1dfa291e2026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea04cda2068147bfb0d1f3fc17d9a164', 'request_id': 'req-88cf61cc-9ecc-492f-9011-1dfa291e2026'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.821336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-88cf61cc-9ecc-492f-9011-1dfa291e2026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea04cda2068147bfb0d1f3fc17d9a164', 'request_id': 'req-88cf61cc-9ecc-492f-9011-1dfa291e2026'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.841668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-88cf61cc-9ecc-492f-9011-1dfa291e2026 admin admin] The token cache is being invalidate because project ea04cda2068147bfb0d1f3fc17d9a164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:36.841908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17cf0b-93e4-41c1-9ff2-9d531e2003cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:36.842509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-88cf61cc-9ecc-492f-9011-1dfa291e2026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.842637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17cf0b-93e4-41c1-9ff2-9d531e2003cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:36.842860 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17cf0b-93e4-41c1-9ff2-9d531e2003cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:36.843189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17cf0b-93e4-41c1-9ff2-9d531e2003cb admin admin] PATH_INFO: `/v3/users/49625c81497b4a79960018e9c8dc4ecc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:36.843461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-88cf61cc-9ecc-492f-9011-1dfa291e2026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.844922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17cf0b-93e4-41c1-9ff2-9d531e2003cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=49625c81497b4a79960018e9c8dc4ecc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:36.845458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 931/1851] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:36 2022] DELETE /identity/v3/projects/ea04cda2068147bfb0d1f3fc17d9a164 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:36.846376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17cf0b-93e4-41c1-9ff2-9d531e2003cb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:36.850001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad74d80-e1be-4629-a0f2-ee724f2a5288 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:36.850509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad74d80-e1be-4629-a0f2-ee724f2a5288 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:36.850994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad74d80-e1be-4629-a0f2-ee724f2a5288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:36.875836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1ad74d80-e1be-4629-a0f2-ee724f2a5288 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:36.877738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1ad74d80-e1be-4629-a0f2-ee724f2a5288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:36.889011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 932/1852] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:36.898587 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87877ffa-6015-4e41-aa44-1e3fe2b9ae4c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:36.899215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87877ffa-6015-4e41-aa44-1e3fe2b9ae4c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:36.899654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87877ffa-6015-4e41-aa44-1e3fe2b9ae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:36.925887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8f17cf0b-93e4-41c1-9ff2-9d531e2003cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49625c81497b4a79960018e9c8dc4ecc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.936331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-87877ffa-6015-4e41-aa44-1e3fe2b9ae4c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:36.938166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-87877ffa-6015-4e41-aa44-1e3fe2b9ae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:36.954068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 933/1853] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:36.955367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87877ffa-6015-4e41-aa44-1e3fe2b9ae4c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:36.962008 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8f17cf0b-93e4-41c1-9ff2-9d531e2003cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49625c81497b4a79960018e9c8dc4ecc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.962634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8f17cf0b-93e4-41c1-9ff2-9d531e2003cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49625c81497b4a79960018e9c8dc4ecc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.963789 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8f17cf0b-93e4-41c1-9ff2-9d531e2003cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49625c81497b4a79960018e9c8dc4ecc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.981199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8f17cf0b-93e4-41c1-9ff2-9d531e2003cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49625c81497b4a79960018e9c8dc4ecc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:36.985056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87877ffa-6015-4e41-aa44-1e3fe2b9ae4c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:36.987721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:36.998655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 921/1854] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:36 2022] DELETE /identity/v3/users/49625c81497b4a79960018e9c8dc4ecc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:37.002939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae2b58-91c9-4b95-93f5-d3b2a7fccc9f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:37.003367 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae2b58-91c9-4b95-93f5-d3b2a7fccc9f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:37.003871 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae2b58-91c9-4b95-93f5-d3b2a7fccc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:37.005714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3f972-e889-4a61-8efa-2ff7c3b22f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:37.006362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3f972-e889-4a61-8efa-2ff7c3b22f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:37.006650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3f972-e889-4a61-8efa-2ff7c3b22f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:37.006910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3f972-e889-4a61-8efa-2ff7c3b22f17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:37.007609 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3f972-e889-4a61-8efa-2ff7c3b22f17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:37.007915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3f972-e889-4a61-8efa-2ff7c3b22f17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:37.009669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3f972-e889-4a61-8efa-2ff7c3b22f17 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:37.022735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 934/1855] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:33:37.027230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3f972-e889-4a61-8efa-2ff7c3b22f17 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:37.029210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-43e3f972-e889-4a61-8efa-2ff7c3b22f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:37.031914 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-28ae2b58-91c9-4b95-93f5-d3b2a7fccc9f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:37.032906 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-28ae2b58-91c9-4b95-93f5-d3b2a7fccc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:37.045363 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3f972-e889-4a61-8efa-2ff7c3b22f17 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:37.116818 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 922/1856] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:37.118751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2592c4-8c57-410e-b51d-c86c924088ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:37.118936 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2592c4-8c57-410e-b51d-c86c924088ae admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:37.119418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2592c4-8c57-410e-b51d-c86c924088ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:37.119743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2592c4-8c57-410e-b51d-c86c924088ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:37.120378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2592c4-8c57-410e-b51d-c86c924088ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:37.123151 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2592c4-8c57-410e-b51d-c86c924088ae admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:37.128760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:37.131661 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae2b58-91c9-4b95-93f5-d3b2a7fccc9f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:37.133101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-28ae2b58-91c9-4b95-93f5-d3b2a7fccc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:37.182441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 935/1857] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:37 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:37.185339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2592c4-8c57-410e-b51d-c86c924088ae admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:37.243270 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae2b58-91c9-4b95-93f5-d3b2a7fccc9f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:37.264111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2592c4-8c57-410e-b51d-c86c924088ae admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:37.270691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22442821-554b-4dc7-b2eb-3671822e8519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:37.271508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22442821-554b-4dc7-b2eb-3671822e8519 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:37.271952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22442821-554b-4dc7-b2eb-3671822e8519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:37.272524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22442821-554b-4dc7-b2eb-3671822e8519 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:37.273412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22442821-554b-4dc7-b2eb-3671822e8519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:37.275605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22442821-554b-4dc7-b2eb-3671822e8519 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:37.307333 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 936/1858] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:37 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:37.309572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22442821-554b-4dc7-b2eb-3671822e8519 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:37.324091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22442821-554b-4dc7-b2eb-3671822e8519 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:37.329614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e337553-af58-4626-918e-f464513379eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:37.330273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e337553-af58-4626-918e-f464513379eb admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:37.330546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e337553-af58-4626-918e-f464513379eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:37.330809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e337553-af58-4626-918e-f464513379eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:37.331532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e337553-af58-4626-918e-f464513379eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:37.333100 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e337553-af58-4626-918e-f464513379eb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:37.345112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 937/1859] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:37.349071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e337553-af58-4626-918e-f464513379eb admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:37.358748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f55f5-15df-4c79-9a27-0e18db3ae1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:37.359419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f55f5-15df-4c79-9a27-0e18db3ae1fc service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:37.359678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f55f5-15df-4c79-9a27-0e18db3ae1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:37.359951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f55f5-15df-4c79-9a27-0e18db3ae1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:37.361893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e337553-af58-4626-918e-f464513379eb admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:37.366919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb08c3-d863-48bb-af4f-5a1c5e53464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:37.367834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb08c3-d863-48bb-af4f-5a1c5e53464d admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:37.368202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb08c3-d863-48bb-af4f-5a1c5e53464d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:37.368612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb08c3-d863-48bb-af4f-5a1c5e53464d admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:37.369628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb08c3-d863-48bb-af4f-5a1c5e53464d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:37.371460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb08c3-d863-48bb-af4f-5a1c5e53464d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:37.371721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f55f5-15df-4c79-9a27-0e18db3ae1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:37.373765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f55f5-15df-4c79-9a27-0e18db3ae1fc service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:37.383210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 938/1860] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:37.386430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 923/1861] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:37.387620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb08c3-d863-48bb-af4f-5a1c5e53464d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:37.399143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb08c3-d863-48bb-af4f-5a1c5e53464d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:37.405008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787585-3ec0-43f7-b64c-8ecebf9b304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:37.405946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787585-3ec0-43f7-b64c-8ecebf9b304c admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:37.406315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787585-3ec0-43f7-b64c-8ecebf9b304c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:37.406679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787585-3ec0-43f7-b64c-8ecebf9b304c admin admin] PATH_INFO: `/v3/projects/7956b878c247416faf6fa61c6354ac77/users/0f3914c27fe042179d8bdd1c2cfbd3a1/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:37.415534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd37e2-53c7-4974-9856-2fede6abccb6 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:37.416028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd37e2-53c7-4974-9856-2fede6abccb6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:37.416392 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd37e2-53c7-4974-9856-2fede6abccb6 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:37.418118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 924/1862] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:33:37.434335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2a219-acf7-4820-b005-d6d85136a232 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:37.434701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2a219-acf7-4820-b005-d6d85136a232 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:37.435413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2a219-acf7-4820-b005-d6d85136a232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:37.460890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d787585-3ec0-43f7-b64c-8ecebf9b304c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7956b878c247416faf6fa61c6354ac77, user_id=0f3914c27fe042179d8bdd1c2cfbd3a1, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:37.468782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d787585-3ec0-43f7-b64c-8ecebf9b304c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:37.478964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dbe2a219-acf7-4820-b005-d6d85136a232 None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:37.480210 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dbe2a219-acf7-4820-b005-d6d85136a232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:37.517437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 939/1863] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:37 2022] PUT /identity/v3/projects/7956b878c247416faf6fa61c6354ac77/users/0f3914c27fe042179d8bdd1c2cfbd3a1/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:37.521245 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b306d-3eda-4426-83d2-3af7f61c956c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:37.522000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b306d-3eda-4426-83d2-3af7f61c956c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:37.522116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b306d-3eda-4426-83d2-3af7f61c956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:37.600046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5c7b306d-3eda-4426-83d2-3af7f61c956c None None] MFA Rules not processed for user `0f3914c27fe042179d8bdd1c2cfbd3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:37.601286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5c7b306d-3eda-4426-83d2-3af7f61c956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:37.604301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:37.628602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 925/1864] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:33:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:37.696206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 940/1865] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:37.707770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2a219-acf7-4820-b005-d6d85136a232 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:37.709625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dbe2a219-acf7-4820-b005-d6d85136a232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:37.794712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2a219-acf7-4820-b005-d6d85136a232 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:37.860220 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534e467-90a6-401f-881a-5f19659ad1f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:37.860859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534e467-90a6-401f-881a-5f19659ad1f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:37.861137 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534e467-90a6-401f-881a-5f19659ad1f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:37.861412 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534e467-90a6-401f-881a-5f19659ad1f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:37.871571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534e467-90a6-401f-881a-5f19659ad1f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:37.873033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534e467-90a6-401f-881a-5f19659ad1f4 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:37.899502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 926/1866] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:38.125153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b306d-3eda-4426-83d2-3af7f61c956c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:38.127054 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5c7b306d-3eda-4426-83d2-3af7f61c956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:38.156076 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:38.266766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b306d-3eda-4426-83d2-3af7f61c956c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:38.276200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd10a9-bb1f-4864-8cd0-4e5958d18a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:38.276849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd10a9-bb1f-4864-8cd0-4e5958d18a7a service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:38.277181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd10a9-bb1f-4864-8cd0-4e5958d18a7a service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:38.277482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd10a9-bb1f-4864-8cd0-4e5958d18a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:38.291363 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd10a9-bb1f-4864-8cd0-4e5958d18a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:38.293101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd10a9-bb1f-4864-8cd0-4e5958d18a7a service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:38.307313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 941/1867] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:38.524928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534e467-90a6-401f-881a-5f19659ad1f4 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:38.526450 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0534e467-90a6-401f-881a-5f19659ad1f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:38.623311 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534e467-90a6-401f-881a-5f19659ad1f4 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:38.629123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:38.629752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:38.630021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:38.630286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] PATH_INFO: `/v3/projects/ec47dfed10dd4f63971577875b2b4b10` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:38.631526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec47dfed10dd4f63971577875b2b4b10)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:38.633443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:38.684910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:38.688524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec47dfed10dd4f63971577875b2b4b10', 'request_id': 'req-772f5e75-d685-44f4-95d8-2b781c3c0a05'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:38.695790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec47dfed10dd4f63971577875b2b4b10', 'request_id': 'req-772f5e75-d685-44f4-95d8-2b781c3c0a05'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:38.703035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec47dfed10dd4f63971577875b2b4b10', 'request_id': 'req-772f5e75-d685-44f4-95d8-2b781c3c0a05'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:38.717816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] The token cache is being invalidate because project ec47dfed10dd4f63971577875b2b4b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:38.718162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:38.718890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:38.720857 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 927/1868] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:38 2022] DELETE /identity/v3/projects/ec47dfed10dd4f63971577875b2b4b10 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:38.724904 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd10a9-bb1f-4864-8cd0-4e5958d18a7a service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:38.737220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd10a9-bb1f-4864-8cd0-4e5958d18a7a service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:38.807212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8da3a8-ff15-4fc8-af82-1d57f4fa9c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:38.807857 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8da3a8-ff15-4fc8-af82-1d57f4fa9c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:38.808126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8da3a8-ff15-4fc8-af82-1d57f4fa9c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:38.808392 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8da3a8-ff15-4fc8-af82-1d57f4fa9c4a admin admin] PATH_INFO: `/v3/users/3befb8abf1104eb48daacb9366ab86cd` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:38.810059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8da3a8-ff15-4fc8-af82-1d57f4fa9c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3befb8abf1104eb48daacb9366ab86cd)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:38.812443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8da3a8-ff15-4fc8-af82-1d57f4fa9c4a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:38.869717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9a8da3a8-ff15-4fc8-af82-1d57f4fa9c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3befb8abf1104eb48daacb9366ab86cd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:38.883552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9a8da3a8-ff15-4fc8-af82-1d57f4fa9c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3befb8abf1104eb48daacb9366ab86cd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:38.896869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9a8da3a8-ff15-4fc8-af82-1d57f4fa9c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3befb8abf1104eb48daacb9366ab86cd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:38.897488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9a8da3a8-ff15-4fc8-af82-1d57f4fa9c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3befb8abf1104eb48daacb9366ab86cd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:38.913513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9a8da3a8-ff15-4fc8-af82-1d57f4fa9c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3befb8abf1104eb48daacb9366ab86cd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:38.920653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 942/1869] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:38 2022] DELETE /identity/v3/users/3befb8abf1104eb48daacb9366ab86cd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:39.149530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:39.151118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:39.179118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f5e75-d685-44f4-95d8-2b781c3c0a05 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:39.312067 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:39.312672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:39.312951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:39.313214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] PATH_INFO: `/v3/users/d938562629ef460ab011195fc857250d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:39.314393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d938562629ef460ab011195fc857250d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:39.316625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:39.420529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd938562629ef460ab011195fc857250d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:39.475960 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd938562629ef460ab011195fc857250d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:39.476848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd938562629ef460ab011195fc857250d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:39.478248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd938562629ef460ab011195fc857250d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:39.516773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd938562629ef460ab011195fc857250d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:39.544397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 928/1870] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:39 2022] DELETE /identity/v3/users/d938562629ef460ab011195fc857250d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:39.545770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abd5f-453c-4e03-9380-08f31abcc0aa None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:39.546702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abd5f-453c-4e03-9380-08f31abcc0aa None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:39.546910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abd5f-453c-4e03-9380-08f31abcc0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:39.559758 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:39.562314 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:39.581140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0f5abd5f-453c-4e03-9380-08f31abcc0aa None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:39.582267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0f5abd5f-453c-4e03-9380-08f31abcc0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:39.603874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:39.672122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:39.678271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466d85b-2c91-4705-a3ff-f380403d2d3f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:39.685286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2770343-1f11-407f-be2c-ef613bfb259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:39.686266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2770343-1f11-407f-be2c-ef613bfb259c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:39.686923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2770343-1f11-407f-be2c-ef613bfb259c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:39.687539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2770343-1f11-407f-be2c-ef613bfb259c admin admin] PATH_INFO: `/v3/projects/06a3dc440f6049c68dd67a7baf779550` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:39.688821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 943/1871] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:39.691934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2770343-1f11-407f-be2c-ef613bfb259c admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a3dc440f6049c68dd67a7baf779550)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:39.693901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2770343-1f11-407f-be2c-ef613bfb259c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:39.698354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abd5f-453c-4e03-9380-08f31abcc0aa None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:39.701801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0f5abd5f-453c-4e03-9380-08f31abcc0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:39.784707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2770343-1f11-407f-be2c-ef613bfb259c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a3dc440f6049c68dd67a7baf779550', 'request_id': 'req-c2770343-1f11-407f-be2c-ef613bfb259c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:39.793274 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2770343-1f11-407f-be2c-ef613bfb259c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a3dc440f6049c68dd67a7baf779550', 'request_id': 'req-c2770343-1f11-407f-be2c-ef613bfb259c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:39.807237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2770343-1f11-407f-be2c-ef613bfb259c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a3dc440f6049c68dd67a7baf779550', 'request_id': 'req-c2770343-1f11-407f-be2c-ef613bfb259c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:39.821798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abd5f-453c-4e03-9380-08f31abcc0aa None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:39.834790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2770343-1f11-407f-be2c-ef613bfb259c admin admin] The token cache is being invalidate because project 06a3dc440f6049c68dd67a7baf779550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:39.836569 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2770343-1f11-407f-be2c-ef613bfb259c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:39.839452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2770343-1f11-407f-be2c-ef613bfb259c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:39.841187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 929/1872] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:39 2022] DELETE /identity/v3/projects/06a3dc440f6049c68dd67a7baf779550 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:39.845974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad85758-94d5-41a2-a919-9e3748fd8afc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:39.846728 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad85758-94d5-41a2-a919-9e3748fd8afc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:39.846728 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad85758-94d5-41a2-a919-9e3748fd8afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:39.880388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fad85758-94d5-41a2-a919-9e3748fd8afc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:39.882526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fad85758-94d5-41a2-a919-9e3748fd8afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:39.892145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52c4b0-35ff-4629-bf25-20ff38c0ebab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:39.892967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52c4b0-35ff-4629-bf25-20ff38c0ebab service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:39.893250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52c4b0-35ff-4629-bf25-20ff38c0ebab service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:39.893523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52c4b0-35ff-4629-bf25-20ff38c0ebab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:39.895849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5d52c4b0-35ff-4629-bf25-20ff38c0ebab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:39.962584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 930/1873] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:39.970194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378249f-7ea3-4d46-868d-8d2014d40905 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:39.970478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378249f-7ea3-4d46-868d-8d2014d40905 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:39.970578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52c4b0-35ff-4629-bf25-20ff38c0ebab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:39.970753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378249f-7ea3-4d46-868d-8d2014d40905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:39.972292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52c4b0-35ff-4629-bf25-20ff38c0ebab service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:39.982207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 944/1874] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:39.992858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1378249f-7ea3-4d46-868d-8d2014d40905 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:39.994145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1378249f-7ea3-4d46-868d-8d2014d40905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:40.002933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 931/1875] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:40.007109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52c4b0-35ff-4629-bf25-20ff38c0ebab service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:40.016839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52c4b0-35ff-4629-bf25-20ff38c0ebab service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:40.022944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ecdf5-3ada-4c70-b644-082821944566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:40.023541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ecdf5-3ada-4c70-b644-082821944566 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:40.023823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ecdf5-3ada-4c70-b644-082821944566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:40.024096 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ecdf5-3ada-4c70-b644-082821944566 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:40.024809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ecdf5-3ada-4c70-b644-082821944566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:40.025181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ecdf5-3ada-4c70-b644-082821944566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:40.026942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ecdf5-3ada-4c70-b644-082821944566 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:40.045018 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 945/1876] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:33:40.046479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378249f-7ea3-4d46-868d-8d2014d40905 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:40.061467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378249f-7ea3-4d46-868d-8d2014d40905 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:40.067205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826f0d7-7734-4f1c-91fc-6932ebb27499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:40.067947 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826f0d7-7734-4f1c-91fc-6932ebb27499 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:40.068334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826f0d7-7734-4f1c-91fc-6932ebb27499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:40.068703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826f0d7-7734-4f1c-91fc-6932ebb27499 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:40.069595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826f0d7-7734-4f1c-91fc-6932ebb27499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:40.071998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826f0d7-7734-4f1c-91fc-6932ebb27499 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:40.098781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 932/1877] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:40 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:40.102802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ecdf5-3ada-4c70-b644-082821944566 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:40.113287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ecdf5-3ada-4c70-b644-082821944566 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:40.126646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:40.200454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45af4cd-8932-4d55-99d7-3d06152bce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:40.201271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45af4cd-8932-4d55-99d7-3d06152bce23 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:40.201609 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45af4cd-8932-4d55-99d7-3d06152bce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:40.202008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45af4cd-8932-4d55-99d7-3d06152bce23 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:40.202708 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45af4cd-8932-4d55-99d7-3d06152bce23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:40.205405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45af4cd-8932-4d55-99d7-3d06152bce23 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:40.247252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 946/1878] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:40 2022] POST /identity/v3/users => generated 282 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:40.251000 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826f0d7-7734-4f1c-91fc-6932ebb27499 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:40.269915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826f0d7-7734-4f1c-91fc-6932ebb27499 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:40.278669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b852b-8b6f-4186-91e0-5c4ac503f520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:40.279320 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b852b-8b6f-4186-91e0-5c4ac503f520 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:40.279915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b852b-8b6f-4186-91e0-5c4ac503f520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:40.280195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b852b-8b6f-4186-91e0-5c4ac503f520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:40.282641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b852b-8b6f-4186-91e0-5c4ac503f520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:40.285877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b852b-8b6f-4186-91e0-5c4ac503f520 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:40.319680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 933/1879] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:40.323781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45af4cd-8932-4d55-99d7-3d06152bce23 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:40.335197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45af4cd-8932-4d55-99d7-3d06152bce23 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:40.343048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c09ea-3a57-42a7-bdb8-af728b7c8cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:40.344354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c09ea-3a57-42a7-bdb8-af728b7c8cce admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:40.344637 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c09ea-3a57-42a7-bdb8-af728b7c8cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:40.344906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c09ea-3a57-42a7-bdb8-af728b7c8cce admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:40.345566 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c09ea-3a57-42a7-bdb8-af728b7c8cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:40.347867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c09ea-3a57-42a7-bdb8-af728b7c8cce admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:40.362353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 947/1880] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:40.369966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b852b-8b6f-4186-91e0-5c4ac503f520 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:40.382366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b852b-8b6f-4186-91e0-5c4ac503f520 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:40.388391 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861a11c-e02c-4d11-8491-54f465938f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:40.389268 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861a11c-e02c-4d11-8491-54f465938f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:40.389653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861a11c-e02c-4d11-8491-54f465938f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:40.390090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861a11c-e02c-4d11-8491-54f465938f46 admin admin] PATH_INFO: `/v3/projects/66927ce2166840fe8b2c0c39548c2bf3/users/c9e54e83407244838dd52c7690e08763/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:40.409036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861a11c-e02c-4d11-8491-54f465938f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66927ce2166840fe8b2c0c39548c2bf3, user_id=c9e54e83407244838dd52c7690e08763, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:40.412089 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861a11c-e02c-4d11-8491-54f465938f46 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:40.437412 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 934/1881] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:40 2022] PUT /identity/v3/projects/66927ce2166840fe8b2c0c39548c2bf3/users/c9e54e83407244838dd52c7690e08763/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:40.448176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffda93-19f6-4183-8e41-5f277ef6ff61 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:40.448460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffda93-19f6-4183-8e41-5f277ef6ff61 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:40.448724 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffda93-19f6-4183-8e41-5f277ef6ff61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:40.485187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-33ffda93-19f6-4183-8e41-5f277ef6ff61 None None] MFA Rules not processed for user `c9e54e83407244838dd52c7690e08763`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:40.486399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-33ffda93-19f6-4183-8e41-5f277ef6ff61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:40.580497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 948/1882] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:40.585373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861a11c-e02c-4d11-8491-54f465938f46 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:40.621341 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:40.672751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861a11c-e02c-4d11-8491-54f465938f46 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:40.679934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0d70a-bdb4-4663-b5cc-019b011fd876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:40.680842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0d70a-bdb4-4663-b5cc-019b011fd876 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:40.681137 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0d70a-bdb4-4663-b5cc-019b011fd876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:40.681712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0d70a-bdb4-4663-b5cc-019b011fd876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:40.682052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0d70a-bdb4-4663-b5cc-019b011fd876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:40.684484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0d70a-bdb4-4663-b5cc-019b011fd876 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:40.717290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 935/1883] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:40 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:33:40.721008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffda93-19f6-4183-8e41-5f277ef6ff61 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:40.734909 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffda93-19f6-4183-8e41-5f277ef6ff61 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:40.817566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0d70a-bdb4-4663-b5cc-019b011fd876 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:40.820294 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5fc0d70a-bdb4-4663-b5cc-019b011fd876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:40.878736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a5729-a80d-4e53-bca5-688f44f097b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:40.879399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a5729-a80d-4e53-bca5-688f44f097b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:40.879674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a5729-a80d-4e53-bca5-688f44f097b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:40.879943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a5729-a80d-4e53-bca5-688f44f097b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:40.880573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a5729-a80d-4e53-bca5-688f44f097b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:40.895116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a5729-a80d-4e53-bca5-688f44f097b1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:40.923751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 949/1884] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:40 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:40.925909 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a5729-a80d-4e53-bca5-688f44f097b1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:40.949021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a5729-a80d-4e53-bca5-688f44f097b1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:40.975226 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2b5e6-a808-40d6-a07c-20ea870367ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:40.976193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2b5e6-a808-40d6-a07c-20ea870367ec admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:40.976617 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2b5e6-a808-40d6-a07c-20ea870367ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:40.977381 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2b5e6-a808-40d6-a07c-20ea870367ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:40.978119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2b5e6-a808-40d6-a07c-20ea870367ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:40.980125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2b5e6-a808-40d6-a07c-20ea870367ec admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:40.992216 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 950/1885] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:40.997840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2b5e6-a808-40d6-a07c-20ea870367ec admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:41.003292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:41.004655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0d70a-bdb4-4663-b5cc-019b011fd876 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:41.009915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2b5e6-a808-40d6-a07c-20ea870367ec admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:41.014530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:41.015479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:41.017283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:41.018372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] PATH_INFO: `/v3/projects/bb1ed98510524c58ad0822ea30b3a069` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:41.019312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb0b73-865b-431c-965f-b7ff0f5098bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:41.020261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb0b73-865b-431c-965f-b7ff0f5098bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:41.020738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb0b73-865b-431c-965f-b7ff0f5098bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:41.020853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1ed98510524c58ad0822ea30b3a069)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:41.021022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb0b73-865b-431c-965f-b7ff0f5098bb admin admin] PATH_INFO: `/v3/projects/d780de3a84984460b9f6c8c78de7c43a/users/e036c3ba77bd452fb7d1df1fbc119065/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:41.023338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:41.070365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb0b73-865b-431c-965f-b7ff0f5098bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d780de3a84984460b9f6c8c78de7c43a, user_id=e036c3ba77bd452fb7d1df1fbc119065, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:41.078088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb0b73-865b-431c-965f-b7ff0f5098bb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:41.105426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 951/1886] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:40 2022] PUT /identity/v3/projects/d780de3a84984460b9f6c8c78de7c43a/users/e036c3ba77bd452fb7d1df1fbc119065/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:41.110301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb0b73-865b-431c-965f-b7ff0f5098bb admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:41.121076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1ed98510524c58ad0822ea30b3a069', 'request_id': 'req-2732306a-7db2-435e-8266-e6254745a6ed'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:41.134211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1ed98510524c58ad0822ea30b3a069', 'request_id': 'req-2732306a-7db2-435e-8266-e6254745a6ed'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:41.145921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1ed98510524c58ad0822ea30b3a069', 'request_id': 'req-2732306a-7db2-435e-8266-e6254745a6ed'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:41.176737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] The token cache is being invalidate because project bb1ed98510524c58ad0822ea30b3a069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:41.177067 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:41.177760 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:41.183169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 936/1887] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:40 2022] DELETE /identity/v3/projects/bb1ed98510524c58ad0822ea30b3a069 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:41.184232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:41.196351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:41.231383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb0b73-865b-431c-965f-b7ff0f5098bb admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:41.238295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f532caa-4d43-4041-ae66-230b49bb2070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:41.239265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f532caa-4d43-4041-ae66-230b49bb2070 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:41.239837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f532caa-4d43-4041-ae66-230b49bb2070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:41.240371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f532caa-4d43-4041-ae66-230b49bb2070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:41.241233 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f532caa-4d43-4041-ae66-230b49bb2070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:41.243223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f532caa-4d43-4041-ae66-230b49bb2070 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:41.267461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 952/1888] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:41.271178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f532caa-4d43-4041-ae66-230b49bb2070 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:41.273189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3f532caa-4d43-4041-ae66-230b49bb2070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:41.297161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f532caa-4d43-4041-ae66-230b49bb2070 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:41.305413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711e710-f2bb-4d19-8b5d-4e09ed8ec073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:41.306059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:41.308242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711e710-f2bb-4d19-8b5d-4e09ed8ec073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:41.311069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711e710-f2bb-4d19-8b5d-4e09ed8ec073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:41.311605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711e710-f2bb-4d19-8b5d-4e09ed8ec073 admin admin] PATH_INFO: `/v3/projects/d780de3a84984460b9f6c8c78de7c43a/users/e036c3ba77bd452fb7d1df1fbc119065/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:41.317394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711e710-f2bb-4d19-8b5d-4e09ed8ec073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d780de3a84984460b9f6c8c78de7c43a, user_id=e036c3ba77bd452fb7d1df1fbc119065, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:41.321743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711e710-f2bb-4d19-8b5d-4e09ed8ec073 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:41.335759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 953/1889] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:41 2022] PUT /identity/v3/projects/d780de3a84984460b9f6c8c78de7c43a/users/e036c3ba77bd452fb7d1df1fbc119065/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:41.346206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5688607-6475-409b-8bde-1619a523b20d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:41.347214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5688607-6475-409b-8bde-1619a523b20d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:41.349418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5688607-6475-409b-8bde-1619a523b20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:41.351413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732306a-7db2-435e-8266-e6254745a6ed admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:41.427549 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a5688607-6475-409b-8bde-1619a523b20d None None] MFA Rules not processed for user `e036c3ba77bd452fb7d1df1fbc119065`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:41.429246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a5688607-6475-409b-8bde-1619a523b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:41.508866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:41.509612 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:41.510127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:41.510492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] PATH_INFO: `/v3/users/ef7122aa8c534d0480d7665f859dbebc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:41.512393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7122aa8c534d0480d7665f859dbebc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:41.516135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:41.591267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 954/1890] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:41.591788 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7122aa8c534d0480d7665f859dbebc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:41.600707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5688607-6475-409b-8bde-1619a523b20d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:41.602633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7122aa8c534d0480d7665f859dbebc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:41.603349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7122aa8c534d0480d7665f859dbebc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:41.604274 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7122aa8c534d0480d7665f859dbebc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:41.608513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a5688607-6475-409b-8bde-1619a523b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:41.638121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7122aa8c534d0480d7665f859dbebc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:41.656586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 937/1891] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:41 2022] DELETE /identity/v3/users/ef7122aa8c534d0480d7665f859dbebc => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:41.686689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:41.701010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5688607-6475-409b-8bde-1619a523b20d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:41.765364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df036e9d-13e2-4e29-803c-f2e362bef31e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:41.766373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df036e9d-13e2-4e29-803c-f2e362bef31e service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:41.767109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df036e9d-13e2-4e29-803c-f2e362bef31e service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:41.768003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df036e9d-13e2-4e29-803c-f2e362bef31e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:41.770556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-df036e9d-13e2-4e29-803c-f2e362bef31e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:41.853627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df036e9d-13e2-4e29-803c-f2e362bef31e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:41.855202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df036e9d-13e2-4e29-803c-f2e362bef31e service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:41.870538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 955/1892] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:42.109452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:42.110913 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:42.227573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90604fb-c65b-44d3-9a9d-17bace36dd03 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:42.232922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:42.233567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:42.233846 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:42.234119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] PATH_INFO: `/v3/projects/a04cb0fe8a2447ff892483b9d86b70d4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:42.235443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04cb0fe8a2447ff892483b9d86b70d4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:42.237419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:42.245220 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:42.303150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04cb0fe8a2447ff892483b9d86b70d4', 'request_id': 'req-e3fa18a3-f247-40d6-9408-7591c88f95d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.314865 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04cb0fe8a2447ff892483b9d86b70d4', 'request_id': 'req-e3fa18a3-f247-40d6-9408-7591c88f95d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.324154 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04cb0fe8a2447ff892483b9d86b70d4', 'request_id': 'req-e3fa18a3-f247-40d6-9408-7591c88f95d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.351708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] The token cache is being invalidate because project a04cb0fe8a2447ff892483b9d86b70d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:42.352175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.352991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.355740 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 938/1893] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:42 2022] DELETE /identity/v3/projects/a04cb0fe8a2447ff892483b9d86b70d4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:42.360466 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df036e9d-13e2-4e29-803c-f2e362bef31e service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:42.374782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df036e9d-13e2-4e29-803c-f2e362bef31e service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:42.445776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:42.447322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:42.453127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1d351-e5df-4338-b02c-9828e8bfb9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:42.454268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1d351-e5df-4338-b02c-9828e8bfb9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:42.454653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1d351-e5df-4338-b02c-9828e8bfb9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:42.455001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1d351-e5df-4338-b02c-9828e8bfb9bb admin admin] PATH_INFO: `/v3/users/62ea3f32dcc64d99b994108dcbd1c581` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:42.456378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1d351-e5df-4338-b02c-9828e8bfb9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ea3f32dcc64d99b994108dcbd1c581)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:42.459267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1d351-e5df-4338-b02c-9828e8bfb9bb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:42.460840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa18a3-f247-40d6-9408-7591c88f95d1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:42.467185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:42.467823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:42.468098 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:42.468369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] PATH_INFO: `/v3/users/c9e54e83407244838dd52c7690e08763` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:42.469560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e54e83407244838dd52c7690e08763)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:42.471553 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:42.513652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f7f1d351-e5df-4338-b02c-9828e8bfb9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ea3f32dcc64d99b994108dcbd1c581'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.519697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:42.522468 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f7f1d351-e5df-4338-b02c-9828e8bfb9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ea3f32dcc64d99b994108dcbd1c581'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.526927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e54e83407244838dd52c7690e08763'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.533848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f7f1d351-e5df-4338-b02c-9828e8bfb9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ea3f32dcc64d99b994108dcbd1c581'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.534601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f7f1d351-e5df-4338-b02c-9828e8bfb9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ea3f32dcc64d99b994108dcbd1c581'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.537779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e54e83407244838dd52c7690e08763'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.538512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e54e83407244838dd52c7690e08763'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.539268 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e54e83407244838dd52c7690e08763'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.547710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f7f1d351-e5df-4338-b02c-9828e8bfb9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ea3f32dcc64d99b994108dcbd1c581'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.552759 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e54e83407244838dd52c7690e08763'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:42.554063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 956/1894] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:42 2022] DELETE /identity/v3/users/62ea3f32dcc64d99b994108dcbd1c581 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:42.565611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 939/1895] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:42 2022] DELETE /identity/v3/users/c9e54e83407244838dd52c7690e08763 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:42.570202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95019d-1ae1-4806-b762-8f708d9c4f58 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:42.570493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95019d-1ae1-4806-b762-8f708d9c4f58 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:42.570772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95019d-1ae1-4806-b762-8f708d9c4f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:42.590770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-dc95019d-1ae1-4806-b762-8f708d9c4f58 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:42.592031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dc95019d-1ae1-4806-b762-8f708d9c4f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:42.658328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 957/1896] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:42.668252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:42.669836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:42.731725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c22b37-a42b-4337-943c-f849e4a62ad0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:42.736033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cd0c8-ffc2-44fc-aed4-b7fbeb70ba13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:42.736647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cd0c8-ffc2-44fc-aed4-b7fbeb70ba13 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:42.736924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cd0c8-ffc2-44fc-aed4-b7fbeb70ba13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:42.737200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cd0c8-ffc2-44fc-aed4-b7fbeb70ba13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:42.747373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cd0c8-ffc2-44fc-aed4-b7fbeb70ba13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:42.749429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cd0c8-ffc2-44fc-aed4-b7fbeb70ba13 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:42.764389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 940/1897] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:42.968258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95019d-1ae1-4806-b762-8f708d9c4f58 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:42.969689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dc95019d-1ae1-4806-b762-8f708d9c4f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:42.983299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95019d-1ae1-4806-b762-8f708d9c4f58 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:43.006353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fee00-2182-4e06-b818-1be014ad317c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:43.007140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fee00-2182-4e06-b818-1be014ad317c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:43.007421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fee00-2182-4e06-b818-1be014ad317c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:43.007692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fee00-2182-4e06-b818-1be014ad317c admin admin] PATH_INFO: `/v3/projects/4c073411471942619a8ec43fcbff094a` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:43.008830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fee00-2182-4e06-b818-1be014ad317c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c073411471942619a8ec43fcbff094a)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:43.010736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fee00-2182-4e06-b818-1be014ad317c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:43.078992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-529fee00-2182-4e06-b818-1be014ad317c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c073411471942619a8ec43fcbff094a', 'request_id': 'req-529fee00-2182-4e06-b818-1be014ad317c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.093492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-529fee00-2182-4e06-b818-1be014ad317c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c073411471942619a8ec43fcbff094a', 'request_id': 'req-529fee00-2182-4e06-b818-1be014ad317c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.111397 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-529fee00-2182-4e06-b818-1be014ad317c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c073411471942619a8ec43fcbff094a', 'request_id': 'req-529fee00-2182-4e06-b818-1be014ad317c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.132385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-529fee00-2182-4e06-b818-1be014ad317c admin admin] The token cache is being invalidate because project 4c073411471942619a8ec43fcbff094a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:43.132975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-529fee00-2182-4e06-b818-1be014ad317c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.134112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-529fee00-2182-4e06-b818-1be014ad317c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.136362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 958/1898] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:42 2022] DELETE /identity/v3/projects/4c073411471942619a8ec43fcbff094a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:43.142574 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cd0c8-ffc2-44fc-aed4-b7fbeb70ba13 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:43.143425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589f068-0a9b-45c8-987b-01cdb48a5099 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:43.143761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589f068-0a9b-45c8-987b-01cdb48a5099 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:43.144050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589f068-0a9b-45c8-987b-01cdb48a5099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:43.144669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-212cd0c8-ffc2-44fc-aed4-b7fbeb70ba13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:43.183190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cd0c8-ffc2-44fc-aed4-b7fbeb70ba13 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:43.192703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1589f068-0a9b-45c8-987b-01cdb48a5099 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:43.194224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1589f068-0a9b-45c8-987b-01cdb48a5099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:43.198291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:43.291279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:43.291279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:43.291279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:43.291279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] PATH_INFO: `/v3/projects/66927ce2166840fe8b2c0c39548c2bf3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:43.291670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66927ce2166840fe8b2c0c39548c2bf3)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:43.291670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:43.291820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:43.314564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 959/1899] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:43.323472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2cc9e-ed05-4d52-a17d-537adc22a0f2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:43.324724 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2cc9e-ed05-4d52-a17d-537adc22a0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:43.325007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2cc9e-ed05-4d52-a17d-537adc22a0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:43.350568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66927ce2166840fe8b2c0c39548c2bf3', 'request_id': 'req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.355612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-72e2cc9e-ed05-4d52-a17d-537adc22a0f2 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:43.358125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-72e2cc9e-ed05-4d52-a17d-537adc22a0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:43.359063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66927ce2166840fe8b2c0c39548c2bf3', 'request_id': 'req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.369839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66927ce2166840fe8b2c0c39548c2bf3', 'request_id': 'req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.398898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] The token cache is being invalidate because project 66927ce2166840fe8b2c0c39548c2bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:43.400516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.401441 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.409575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 941/1900] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:43 2022] DELETE /identity/v3/projects/66927ce2166840fe8b2c0c39548c2bf3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:43.413168 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:43.415131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:43.491697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 960/1901] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:43.492815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2cc9e-ed05-4d52-a17d-537adc22a0f2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:43.502908 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2cc9e-ed05-4d52-a17d-537adc22a0f2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:43.508624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd567b08-6207-46fa-a33c-9454bce4d73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:43.509349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd567b08-6207-46fa-a33c-9454bce4d73f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:43.509734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd567b08-6207-46fa-a33c-9454bce4d73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:43.510062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd567b08-6207-46fa-a33c-9454bce4d73f admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:43.510819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd567b08-6207-46fa-a33c-9454bce4d73f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:43.511222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd567b08-6207-46fa-a33c-9454bce4d73f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:43.513249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd567b08-6207-46fa-a33c-9454bce4d73f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:43.526018 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 961/1902] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:33:43.526761 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa234d-2fc9-4faf-be82-c6d0f7fa6823 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:43.530724 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd567b08-6207-46fa-a33c-9454bce4d73f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:43.536678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:43.537324 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:43.537599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:43.537867 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] PATH_INFO: `/v3/users/e036c3ba77bd452fb7d1df1fbc119065` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:43.539241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e036c3ba77bd452fb7d1df1fbc119065)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:43.541203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:43.541664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd567b08-6207-46fa-a33c-9454bce4d73f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:43.548542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42989d49-9ee9-4a96-a4f2-180aa7a8b15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:43.549128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42989d49-9ee9-4a96-a4f2-180aa7a8b15b admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:43.549404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42989d49-9ee9-4a96-a4f2-180aa7a8b15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:43.549663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42989d49-9ee9-4a96-a4f2-180aa7a8b15b admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:43.550667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42989d49-9ee9-4a96-a4f2-180aa7a8b15b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:43.552300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42989d49-9ee9-4a96-a4f2-180aa7a8b15b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:43.583132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 962/1903] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:43 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:33:43.586990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42989d49-9ee9-4a96-a4f2-180aa7a8b15b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:43.595702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:43.604377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e036c3ba77bd452fb7d1df1fbc119065'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.624031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e036c3ba77bd452fb7d1df1fbc119065'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.625068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e036c3ba77bd452fb7d1df1fbc119065'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.625856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e036c3ba77bd452fb7d1df1fbc119065'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.640467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e036c3ba77bd452fb7d1df1fbc119065'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:43.656574 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 942/1904] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:43 2022] DELETE /identity/v3/users/e036c3ba77bd452fb7d1df1fbc119065 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:43.662655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42989d49-9ee9-4a96-a4f2-180aa7a8b15b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:43.732592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7a1b8-6b26-4f0d-a051-88ba648fdbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:43.733284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7a1b8-6b26-4f0d-a051-88ba648fdbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:43.733559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7a1b8-6b26-4f0d-a051-88ba648fdbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:43.733822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7a1b8-6b26-4f0d-a051-88ba648fdbf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:43.734433 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7a1b8-6b26-4f0d-a051-88ba648fdbf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:43.736356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7a1b8-6b26-4f0d-a051-88ba648fdbf2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:43.751749 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:43.757883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 963/1905] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:43 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:43.763592 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:43.765123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:43.782388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f49af-6504-40c0-87b0-7b160ccc457f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:43.787401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947a9cd-056c-4ef2-8fa3-ce747713bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:43.788110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947a9cd-056c-4ef2-8fa3-ce747713bc63 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:43.788457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947a9cd-056c-4ef2-8fa3-ce747713bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:43.788731 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947a9cd-056c-4ef2-8fa3-ce747713bc63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:43.789378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947a9cd-056c-4ef2-8fa3-ce747713bc63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:43.790973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947a9cd-056c-4ef2-8fa3-ce747713bc63 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:43.806382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 943/1906] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:43.807619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7a1b8-6b26-4f0d-a051-88ba648fdbf2 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:43.830276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7a1b8-6b26-4f0d-a051-88ba648fdbf2 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:43.835436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b1110-4616-4dcb-be5e-99f89bc6b73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:43.836063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b1110-4616-4dcb-be5e-99f89bc6b73a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:43.836451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b1110-4616-4dcb-be5e-99f89bc6b73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:43.836676 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b1110-4616-4dcb-be5e-99f89bc6b73a admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:43.837953 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b1110-4616-4dcb-be5e-99f89bc6b73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:43.839610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b1110-4616-4dcb-be5e-99f89bc6b73a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:43.852153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 964/1907] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:43.856401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947a9cd-056c-4ef2-8fa3-ce747713bc63 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:43.866701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947a9cd-056c-4ef2-8fa3-ce747713bc63 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:43.872239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e757f2a-a9ea-40d9-a537-4a3035b48c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:43.872900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e757f2a-a9ea-40d9-a537-4a3035b48c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:43.873323 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e757f2a-a9ea-40d9-a537-4a3035b48c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:43.873604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e757f2a-a9ea-40d9-a537-4a3035b48c39 admin admin] PATH_INFO: `/v3/projects/f811f29ab2974d13901072c30365dedd/users/c7c30443cb0a4488986e826f6d2a8e32/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:43.890535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e757f2a-a9ea-40d9-a537-4a3035b48c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f811f29ab2974d13901072c30365dedd, user_id=c7c30443cb0a4488986e826f6d2a8e32, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:43.894119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e757f2a-a9ea-40d9-a537-4a3035b48c39 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:43.909810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 944/1908] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:43 2022] PUT /identity/v3/projects/f811f29ab2974d13901072c30365dedd/users/c7c30443cb0a4488986e826f6d2a8e32/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:43.920835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88eb05-d39c-4c65-9fd6-a6d9fde54358 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:43.921130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88eb05-d39c-4c65-9fd6-a6d9fde54358 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:43.921395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88eb05-d39c-4c65-9fd6-a6d9fde54358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:43.957548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ef88eb05-d39c-4c65-9fd6-a6d9fde54358 None None] MFA Rules not processed for user `c7c30443cb0a4488986e826f6d2a8e32`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:43.958794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ef88eb05-d39c-4c65-9fd6-a6d9fde54358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:43.964540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e757f2a-a9ea-40d9-a537-4a3035b48c39 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:43.967414 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3e757f2a-a9ea-40d9-a537-4a3035b48c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:44.040229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e757f2a-a9ea-40d9-a537-4a3035b48c39 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.045014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f28047-c31e-4834-a3c8-bd81827b1d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.045641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f28047-c31e-4834-a3c8-bd81827b1d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.045920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f28047-c31e-4834-a3c8-bd81827b1d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.046025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 965/1909] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:44.046268 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f28047-c31e-4834-a3c8-bd81827b1d76 admin admin] PATH_INFO: `/v3/projects/d780de3a84984460b9f6c8c78de7c43a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.047514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f28047-c31e-4834-a3c8-bd81827b1d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d780de3a84984460b9f6c8c78de7c43a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.049892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f28047-c31e-4834-a3c8-bd81827b1d76 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.050637 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88eb05-d39c-4c65-9fd6-a6d9fde54358 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.062141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88eb05-d39c-4c65-9fd6-a6d9fde54358 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.067749 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb9fb2-d64d-4efc-bd0c-fdedd1399355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.068362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb9fb2-d64d-4efc-bd0c-fdedd1399355 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.068646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb9fb2-d64d-4efc-bd0c-fdedd1399355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.069046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb9fb2-d64d-4efc-bd0c-fdedd1399355 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.069538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb9fb2-d64d-4efc-bd0c-fdedd1399355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.071552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb9fb2-d64d-4efc-bd0c-fdedd1399355 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.106913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 966/1910] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:44 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:33:44.107252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6f28047-c31e-4834-a3c8-bd81827b1d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd780de3a84984460b9f6c8c78de7c43a', 'request_id': 'req-b6f28047-c31e-4834-a3c8-bd81827b1d76'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:44.108054 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb9fb2-d64d-4efc-bd0c-fdedd1399355 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.112049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6f28047-c31e-4834-a3c8-bd81827b1d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd780de3a84984460b9f6c8c78de7c43a', 'request_id': 'req-b6f28047-c31e-4834-a3c8-bd81827b1d76'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:44.118555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6f28047-c31e-4834-a3c8-bd81827b1d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd780de3a84984460b9f6c8c78de7c43a', 'request_id': 'req-b6f28047-c31e-4834-a3c8-bd81827b1d76'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:44.134994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6f28047-c31e-4834-a3c8-bd81827b1d76 admin admin] The token cache is being invalidate because project d780de3a84984460b9f6c8c78de7c43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:44.135350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6f28047-c31e-4834-a3c8-bd81827b1d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:44.135996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6f28047-c31e-4834-a3c8-bd81827b1d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:44.138581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 945/1911] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:43 2022] DELETE /identity/v3/projects/d780de3a84984460b9f6c8c78de7c43a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:44.143059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7f450-b6e7-4b94-9a67-7ddfd23e38db None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.143362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7f450-b6e7-4b94-9a67-7ddfd23e38db None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.143632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7f450-b6e7-4b94-9a67-7ddfd23e38db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.165725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d7d7f450-b6e7-4b94-9a67-7ddfd23e38db None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:44.166936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d7d7f450-b6e7-4b94-9a67-7ddfd23e38db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:44.183426 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:44.205595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb9fb2-d64d-4efc-bd0c-fdedd1399355 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.210678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3997c19-6f27-484d-a98b-6adf10f0fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.211287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3997c19-6f27-484d-a98b-6adf10f0fcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.211563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3997c19-6f27-484d-a98b-6adf10f0fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.211827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3997c19-6f27-484d-a98b-6adf10f0fcd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.212440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3997c19-6f27-484d-a98b-6adf10f0fcd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.214328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3997c19-6f27-484d-a98b-6adf10f0fcd2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.235558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 967/1912] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:44 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:44.239514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3997c19-6f27-484d-a98b-6adf10f0fcd2 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.241108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d3997c19-6f27-484d-a98b-6adf10f0fcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:44.244057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 946/1913] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:44.253705 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bca319-676f-42b0-bd0f-c19c4c840fa7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.253910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bca319-676f-42b0-bd0f-c19c4c840fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.254165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bca319-676f-42b0-bd0f-c19c4c840fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.254268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3997c19-6f27-484d-a98b-6adf10f0fcd2 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.260011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f137abf-17a4-4145-8c67-f5799a110e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.260671 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f137abf-17a4-4145-8c67-f5799a110e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.261013 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f137abf-17a4-4145-8c67-f5799a110e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.261364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f137abf-17a4-4145-8c67-f5799a110e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.263042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f137abf-17a4-4145-8c67-f5799a110e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.264743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f137abf-17a4-4145-8c67-f5799a110e38 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.276921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 968/1914] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:44.279798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e7bca319-676f-42b0-bd0f-c19c4c840fa7 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:44.281072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e7bca319-676f-42b0-bd0f-c19c4c840fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:44.282711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f137abf-17a4-4145-8c67-f5799a110e38 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.290921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 947/1915] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:44.291793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bca319-676f-42b0-bd0f-c19c4c840fa7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.293197 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e7bca319-676f-42b0-bd0f-c19c4c840fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:44.296500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f137abf-17a4-4145-8c67-f5799a110e38 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.301135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9dcb2-0e76-432b-b055-0ba1a124c1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.301796 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9dcb2-0e76-432b-b055-0ba1a124c1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.302073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9dcb2-0e76-432b-b055-0ba1a124c1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.302597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9dcb2-0e76-432b-b055-0ba1a124c1d1 admin admin] PATH_INFO: `/v3/projects/3ba7a34ecc7c481e95ea66c5b8495de0/users/7617140a9e964f3e8d3362a94ce5e21f/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.305593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bca319-676f-42b0-bd0f-c19c4c840fa7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.310860 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.311770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.312165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.312500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] PATH_INFO: `/v3/users/0f3914c27fe042179d8bdd1c2cfbd3a1` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.313790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3914c27fe042179d8bdd1c2cfbd3a1)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.315821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.319123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9dcb2-0e76-432b-b055-0ba1a124c1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba7a34ecc7c481e95ea66c5b8495de0, user_id=7617140a9e964f3e8d3362a94ce5e21f, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.321612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9dcb2-0e76-432b-b055-0ba1a124c1d1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.337723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 969/1916] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:44 2022] PUT /identity/v3/projects/3ba7a34ecc7c481e95ea66c5b8495de0/users/7617140a9e964f3e8d3362a94ce5e21f/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:44.338452 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9dcb2-0e76-432b-b055-0ba1a124c1d1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.350190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:44.375806 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3914c27fe042179d8bdd1c2cfbd3a1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:44.386019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3914c27fe042179d8bdd1c2cfbd3a1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:44.386629 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3914c27fe042179d8bdd1c2cfbd3a1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:44.389244 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3914c27fe042179d8bdd1c2cfbd3a1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:44.405048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3914c27fe042179d8bdd1c2cfbd3a1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:44.413073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9dcb2-0e76-432b-b055-0ba1a124c1d1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.418338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5a580-0709-4448-8d97-c73581ec999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.418648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 948/1917] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:44 2022] DELETE /identity/v3/users/0f3914c27fe042179d8bdd1c2cfbd3a1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:44.418946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5a580-0709-4448-8d97-c73581ec999c admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.419306 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5a580-0709-4448-8d97-c73581ec999c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.419494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.419590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5a580-0709-4448-8d97-c73581ec999c admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.420180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5a580-0709-4448-8d97-c73581ec999c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:44.420479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5a580-0709-4448-8d97-c73581ec999c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.422078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5a580-0709-4448-8d97-c73581ec999c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.422779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:44.438780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 970/1918] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:33:44.438780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f639f7-584d-4da1-9a5a-bf2afe3d68cc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.438780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f639f7-584d-4da1-9a5a-bf2afe3d68cc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.438780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f639f7-584d-4da1-9a5a-bf2afe3d68cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.459260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b0f639f7-584d-4da1-9a5a-bf2afe3d68cc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:44.460751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b0f639f7-584d-4da1-9a5a-bf2afe3d68cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:44.516178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58faf15-7aec-4ed8-8dbd-fc251cab9bb6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.521195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd344e-a812-4329-a08a-468575a6919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.521809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd344e-a812-4329-a08a-468575a6919a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.522096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd344e-a812-4329-a08a-468575a6919a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.522369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd344e-a812-4329-a08a-468575a6919a admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.523039 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd344e-a812-4329-a08a-468575a6919a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.524686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd344e-a812-4329-a08a-468575a6919a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.529080 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 971/1919] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:44.530066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f639f7-584d-4da1-9a5a-bf2afe3d68cc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.531796 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b0f639f7-584d-4da1-9a5a-bf2afe3d68cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:44.540883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 949/1920] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:44.545892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd344e-a812-4329-a08a-468575a6919a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.547721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f639f7-584d-4da1-9a5a-bf2afe3d68cc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.553077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122d7cf-7bfb-4e73-9286-7c910eddcd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.553688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122d7cf-7bfb-4e73-9286-7c910eddcd6f admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.553970 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122d7cf-7bfb-4e73-9286-7c910eddcd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.554241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122d7cf-7bfb-4e73-9286-7c910eddcd6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.554869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122d7cf-7bfb-4e73-9286-7c910eddcd6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.556292 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd344e-a812-4329-a08a-468575a6919a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.556877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122d7cf-7bfb-4e73-9286-7c910eddcd6f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.561683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64756c4-1d54-4813-86f5-1f5acf31badc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.562333 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64756c4-1d54-4813-86f5-1f5acf31badc admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.562617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64756c4-1d54-4813-86f5-1f5acf31badc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.562864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64756c4-1d54-4813-86f5-1f5acf31badc admin admin] PATH_INFO: `/v3/projects/3ba7a34ecc7c481e95ea66c5b8495de0/users/7617140a9e964f3e8d3362a94ce5e21f/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.564825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64756c4-1d54-4813-86f5-1f5acf31badc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba7a34ecc7c481e95ea66c5b8495de0, user_id=7617140a9e964f3e8d3362a94ce5e21f, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.567480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64756c4-1d54-4813-86f5-1f5acf31badc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.578525 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 950/1921] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:44 2022] PUT /identity/v3/projects/3ba7a34ecc7c481e95ea66c5b8495de0/users/7617140a9e964f3e8d3362a94ce5e21f/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:44.579636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64756c4-1d54-4813-86f5-1f5acf31badc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.581321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f64756c4-1d54-4813-86f5-1f5acf31badc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:44.592473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:44.601322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 972/1922] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:44 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:44.602686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad56b4-6de0-4310-a1db-2850f0e14775 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.602976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad56b4-6de0-4310-a1db-2850f0e14775 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.603335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad56b4-6de0-4310-a1db-2850f0e14775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.634922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-52ad56b4-6de0-4310-a1db-2850f0e14775 None None] MFA Rules not processed for user `7617140a9e964f3e8d3362a94ce5e21f`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:44.636157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-52ad56b4-6de0-4310-a1db-2850f0e14775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:44.673014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64756c4-1d54-4813-86f5-1f5acf31badc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.724576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 973/1923] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:44.725340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad56b4-6de0-4310-a1db-2850f0e14775 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.739075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:44.747819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa8a2b-582b-4e4f-93fb-cb5489d264c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.749339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa8a2b-582b-4e4f-93fb-cb5489d264c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.749617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa8a2b-582b-4e4f-93fb-cb5489d264c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.750580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa8a2b-582b-4e4f-93fb-cb5489d264c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.801106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad56b4-6de0-4310-a1db-2850f0e14775 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.806047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdb99c-0579-434c-99cc-f6a338374faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.806651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdb99c-0579-434c-99cc-f6a338374faf admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.806929 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdb99c-0579-434c-99cc-f6a338374faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.807222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdb99c-0579-434c-99cc-f6a338374faf admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.807835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdb99c-0579-434c-99cc-f6a338374faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.810314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdb99c-0579-434c-99cc-f6a338374faf admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.823938 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa8a2b-582b-4e4f-93fb-cb5489d264c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.825615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa8a2b-582b-4e4f-93fb-cb5489d264c5 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.833578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 974/1924] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:44 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:44.834634 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdb99c-0579-434c-99cc-f6a338374faf admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.836789 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 951/1925] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:44.837667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa8a2b-582b-4e4f-93fb-cb5489d264c5 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.838798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-87bdb99c-0579-434c-99cc-f6a338374faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:44.848854 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa8a2b-582b-4e4f-93fb-cb5489d264c5 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.853959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e292-4d78-4071-85c9-8b064821c7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.854560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e292-4d78-4071-85c9-8b064821c7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.854884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e292-4d78-4071-85c9-8b064821c7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.855203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e292-4d78-4071-85c9-8b064821c7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.856452 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13e292-4d78-4071-85c9-8b064821c7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.858073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13e292-4d78-4071-85c9-8b064821c7e9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.868341 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 952/1926] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:44.872436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e292-4d78-4071-85c9-8b064821c7e9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.900755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e292-4d78-4071-85c9-8b064821c7e9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.906117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780cdb5-02c7-4a9a-9238-71b2142f1bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.906729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780cdb5-02c7-4a9a-9238-71b2142f1bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.907004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780cdb5-02c7-4a9a-9238-71b2142f1bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.907307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780cdb5-02c7-4a9a-9238-71b2142f1bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.908745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780cdb5-02c7-4a9a-9238-71b2142f1bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.910526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780cdb5-02c7-4a9a-9238-71b2142f1bd3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.916566 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdb99c-0579-434c-99cc-f6a338374faf admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.921454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63083d6-85c7-4d0d-8dfe-b21d317c4857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.922066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63083d6-85c7-4d0d-8dfe-b21d317c4857 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.922342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63083d6-85c7-4d0d-8dfe-b21d317c4857 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.922753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 953/1927] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:44.922864 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63083d6-85c7-4d0d-8dfe-b21d317c4857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.926700 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780cdb5-02c7-4a9a-9238-71b2142f1bd3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:44.935233 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63083d6-85c7-4d0d-8dfe-b21d317c4857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.936483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780cdb5-02c7-4a9a-9238-71b2142f1bd3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:44.936810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63083d6-85c7-4d0d-8dfe-b21d317c4857 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.942247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154af9e-1abb-40df-b4d5-ac35990b5167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:44.942646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154af9e-1abb-40df-b4d5-ac35990b5167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.942923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154af9e-1abb-40df-b4d5-ac35990b5167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:44.943232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154af9e-1abb-40df-b4d5-ac35990b5167 admin admin] PATH_INFO: `/v3/projects/5592a74700c9422c9999e2533bd171a3/users/59c61f87632441d3a785f75ec5cc323d/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:44.947341 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 975/1928] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:44.959190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154af9e-1abb-40df-b4d5-ac35990b5167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5592a74700c9422c9999e2533bd171a3, user_id=59c61f87632441d3a785f75ec5cc323d, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:44.961838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154af9e-1abb-40df-b4d5-ac35990b5167 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:44.991454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 954/1929] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:44 2022] PUT /identity/v3/projects/5592a74700c9422c9999e2533bd171a3/users/59c61f87632441d3a785f75ec5cc323d/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:44.999139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7098f-9b75-4ad4-9b48-b8c737c94a76 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:44.999788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7098f-9b75-4ad4-9b48-b8c737c94a76 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:45.003272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7098f-9b75-4ad4-9b48-b8c737c94a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:45.073657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-28a7098f-9b75-4ad4-9b48-b8c737c94a76 None None] MFA Rules not processed for user `59c61f87632441d3a785f75ec5cc323d`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:45.074939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-28a7098f-9b75-4ad4-9b48-b8c737c94a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:45.098394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154af9e-1abb-40df-b4d5-ac35990b5167 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:45.131556 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:45.172057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154af9e-1abb-40df-b4d5-ac35990b5167 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:45.176176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab56e3f-608c-47af-af7f-05e2305b78de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:45.176795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab56e3f-608c-47af-af7f-05e2305b78de service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:45.177075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab56e3f-608c-47af-af7f-05e2305b78de service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:45.177344 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab56e3f-608c-47af-af7f-05e2305b78de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:45.179875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3ab56e3f-608c-47af-af7f-05e2305b78de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:45.180426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 976/1930] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:45.185126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7098f-9b75-4ad4-9b48-b8c737c94a76 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:45.234173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:45.275491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab56e3f-608c-47af-af7f-05e2305b78de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:45.277337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab56e3f-608c-47af-af7f-05e2305b78de service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:45.279334 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7098f-9b75-4ad4-9b48-b8c737c94a76 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:45.285822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c54c6b-9b49-40eb-8bbb-80d064e0e53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:45.286443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c54c6b-9b49-40eb-8bbb-80d064e0e53d admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:45.286718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c54c6b-9b49-40eb-8bbb-80d064e0e53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:45.286987 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c54c6b-9b49-40eb-8bbb-80d064e0e53d admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:45.287650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c54c6b-9b49-40eb-8bbb-80d064e0e53d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:45.291445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c54c6b-9b49-40eb-8bbb-80d064e0e53d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:45.305471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 955/1931] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:45.332314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 977/1932] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:45 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:33:45.333339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab56e3f-608c-47af-af7f-05e2305b78de service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:45.347289 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab56e3f-608c-47af-af7f-05e2305b78de service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:45.495288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230e75e-8b25-470c-9132-2f280951ef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:45.497886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230e75e-8b25-470c-9132-2f280951ef4e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:45.498248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230e75e-8b25-470c-9132-2f280951ef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:45.498874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230e75e-8b25-470c-9132-2f280951ef4e admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:45.500132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230e75e-8b25-470c-9132-2f280951ef4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:45.510060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230e75e-8b25-470c-9132-2f280951ef4e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:45.574101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 956/1933] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:45 2022] POST /identity/v3/users => generated 296 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:33:45.576300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c54c6b-9b49-40eb-8bbb-80d064e0e53d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:45.588781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c54c6b-9b49-40eb-8bbb-80d064e0e53d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:45.604378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b6012-1c52-42cb-aaf8-4a49a47109aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:45.605614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b6012-1c52-42cb-aaf8-4a49a47109aa admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:45.606027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b6012-1c52-42cb-aaf8-4a49a47109aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:45.606399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b6012-1c52-42cb-aaf8-4a49a47109aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:45.607106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b6012-1c52-42cb-aaf8-4a49a47109aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:45.608768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b6012-1c52-42cb-aaf8-4a49a47109aa admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:45.627664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 978/1934] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:45.630840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230e75e-8b25-470c-9132-2f280951ef4e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:45.646739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230e75e-8b25-470c-9132-2f280951ef4e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:45.654229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc976c-2566-4c12-977d-cdf1a7963dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:45.655864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc976c-2566-4c12-977d-cdf1a7963dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:45.656466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc976c-2566-4c12-977d-cdf1a7963dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:45.657297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc976c-2566-4c12-977d-cdf1a7963dd1 admin admin] PATH_INFO: `/v3/projects/afe839553f734e8d8de79652221dd634/users/b8b6baca9f6c45c1911ae661776a9c70/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:45.683478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc976c-2566-4c12-977d-cdf1a7963dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe839553f734e8d8de79652221dd634, user_id=b8b6baca9f6c45c1911ae661776a9c70, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:45.687764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc976c-2566-4c12-977d-cdf1a7963dd1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:45.716329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 957/1935] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:45 2022] PUT /identity/v3/projects/afe839553f734e8d8de79652221dd634/users/b8b6baca9f6c45c1911ae661776a9c70/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:45.720817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b6012-1c52-42cb-aaf8-4a49a47109aa admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:45.766271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b6012-1c52-42cb-aaf8-4a49a47109aa admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:45.872372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b8fe-b230-4bec-ba75-06f6b38a24f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:45.872999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b8fe-b230-4bec-ba75-06f6b38a24f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:45.873367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b8fe-b230-4bec-ba75-06f6b38a24f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:45.873688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b8fe-b230-4bec-ba75-06f6b38a24f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:45.874569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50b8fe-b230-4bec-ba75-06f6b38a24f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:45.876872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50b8fe-b230-4bec-ba75-06f6b38a24f6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:45.894504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 979/1936] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:45.895914 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc976c-2566-4c12-977d-cdf1a7963dd1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:45.907728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b8fe-b230-4bec-ba75-06f6b38a24f6 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:45.909781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3d50b8fe-b230-4bec-ba75-06f6b38a24f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:45.911205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc976c-2566-4c12-977d-cdf1a7963dd1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:45.918354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7096ad0-a283-4c12-8458-50e3193ad7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:45.919118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7096ad0-a283-4c12-8458-50e3193ad7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:45.919477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7096ad0-a283-4c12-8458-50e3193ad7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:45.919811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7096ad0-a283-4c12-8458-50e3193ad7a2 admin admin] PATH_INFO: `/v3/projects/afe839553f734e8d8de79652221dd634/users/b8b6baca9f6c45c1911ae661776a9c70/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:45.922306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7096ad0-a283-4c12-8458-50e3193ad7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe839553f734e8d8de79652221dd634, user_id=b8b6baca9f6c45c1911ae661776a9c70, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:45.925339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7096ad0-a283-4c12-8458-50e3193ad7a2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:45.928252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b8fe-b230-4bec-ba75-06f6b38a24f6 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:45.935778 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506de94-7141-4128-8faa-14e38b9cf14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:45.936419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506de94-7141-4128-8faa-14e38b9cf14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:45.936702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506de94-7141-4128-8faa-14e38b9cf14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:45.936976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506de94-7141-4128-8faa-14e38b9cf14c admin admin] PATH_INFO: `/v3/projects/7956b878c247416faf6fa61c6354ac77` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:45.938235 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506de94-7141-4128-8faa-14e38b9cf14c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7956b878c247416faf6fa61c6354ac77)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:45.940112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 958/1937] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:45 2022] PUT /identity/v3/projects/afe839553f734e8d8de79652221dd634/users/b8b6baca9f6c45c1911ae661776a9c70/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:45.951266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506de94-7141-4128-8faa-14e38b9cf14c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:45.959227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac7674-c46b-4dd3-bf4d-17e91e6c4b7b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:45.959838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac7674-c46b-4dd3-bf4d-17e91e6c4b7b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:45.960900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac7674-c46b-4dd3-bf4d-17e91e6c4b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.006381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dcac7674-c46b-4dd3-bf4d-17e91e6c4b7b None None] MFA Rules not processed for user `b8b6baca9f6c45c1911ae661776a9c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:46.008094 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dcac7674-c46b-4dd3-bf4d-17e91e6c4b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:46.015148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2506de94-7141-4128-8faa-14e38b9cf14c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7956b878c247416faf6fa61c6354ac77', 'request_id': 'req-2506de94-7141-4128-8faa-14e38b9cf14c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:46.024527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2506de94-7141-4128-8faa-14e38b9cf14c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7956b878c247416faf6fa61c6354ac77', 'request_id': 'req-2506de94-7141-4128-8faa-14e38b9cf14c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:46.032825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:46.041451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2506de94-7141-4128-8faa-14e38b9cf14c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7956b878c247416faf6fa61c6354ac77', 'request_id': 'req-2506de94-7141-4128-8faa-14e38b9cf14c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:46.074011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2506de94-7141-4128-8faa-14e38b9cf14c admin admin] The token cache is being invalidate because project 7956b878c247416faf6fa61c6354ac77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:46.074365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2506de94-7141-4128-8faa-14e38b9cf14c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:46.075433 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2506de94-7141-4128-8faa-14e38b9cf14c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:46.082087 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 980/1938] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:45 2022] DELETE /identity/v3/projects/7956b878c247416faf6fa61c6354ac77 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:46.087895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49042b9-95ea-455d-af61-7fe57e28aae0 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:46.088563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49042b9-95ea-455d-af61-7fe57e28aae0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:46.089430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49042b9-95ea-455d-af61-7fe57e28aae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.116143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 959/1939] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:46.123698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f49042b9-95ea-455d-af61-7fe57e28aae0 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:46.125099 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f49042b9-95ea-455d-af61-7fe57e28aae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:46.134066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac7674-c46b-4dd3-bf4d-17e91e6c4b7b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:46.136434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dcac7674-c46b-4dd3-bf4d-17e91e6c4b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:46.151004 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:46.253517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 981/1940] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:46.271886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e059b5-7f4b-43f5-9729-87eca52fa84a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:46.273182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e059b5-7f4b-43f5-9729-87eca52fa84a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:46.273595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e059b5-7f4b-43f5-9729-87eca52fa84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.276799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac7674-c46b-4dd3-bf4d-17e91e6c4b7b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:46.285849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8e6f8-9f5e-462a-918c-9b67881628cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:46.287696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8e6f8-9f5e-462a-918c-9b67881628cb service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:46.287998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8e6f8-9f5e-462a-918c-9b67881628cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:46.289055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8e6f8-9f5e-462a-918c-9b67881628cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.312257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8e6f8-9f5e-462a-918c-9b67881628cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:46.313710 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8e6f8-9f5e-462a-918c-9b67881628cb service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:46.314314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-24e059b5-7f4b-43f5-9729-87eca52fa84a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:46.315981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-24e059b5-7f4b-43f5-9729-87eca52fa84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:46.325112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 960/1941] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:46.330073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 982/1942] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:46.337614 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8e6f8-9f5e-462a-918c-9b67881628cb service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:46.353851 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8e6f8-9f5e-462a-918c-9b67881628cb service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:46.363975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b580bb-08ad-45d7-90dc-d98cceeebf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:46.364588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b580bb-08ad-45d7-90dc-d98cceeebf42 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:46.364868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b580bb-08ad-45d7-90dc-d98cceeebf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:46.365306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b580bb-08ad-45d7-90dc-d98cceeebf42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.365962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b580bb-08ad-45d7-90dc-d98cceeebf42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:46.366265 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b580bb-08ad-45d7-90dc-d98cceeebf42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:46.368425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b580bb-08ad-45d7-90dc-d98cceeebf42 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:46.383859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 961/1943] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:33:46.388610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e059b5-7f4b-43f5-9729-87eca52fa84a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:46.404657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e059b5-7f4b-43f5-9729-87eca52fa84a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:46.413111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89593b03-7f4e-4bf3-b390-e9db3f780243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:46.413736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89593b03-7f4e-4bf3-b390-e9db3f780243 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:46.414012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89593b03-7f4e-4bf3-b390-e9db3f780243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:46.414280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89593b03-7f4e-4bf3-b390-e9db3f780243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.414914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89593b03-7f4e-4bf3-b390-e9db3f780243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:46.416996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89593b03-7f4e-4bf3-b390-e9db3f780243 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:46.451952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 983/1944] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:46 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:46.455542 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b580bb-08ad-45d7-90dc-d98cceeebf42 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:46.473791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b580bb-08ad-45d7-90dc-d98cceeebf42 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:46.549252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef249c37-932b-43e2-a4f0-ff22ff991cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:46.549855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249c37-932b-43e2-a4f0-ff22ff991cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:46.550194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249c37-932b-43e2-a4f0-ff22ff991cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:46.550651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249c37-932b-43e2-a4f0-ff22ff991cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.555200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef249c37-932b-43e2-a4f0-ff22ff991cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:46.555200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef249c37-932b-43e2-a4f0-ff22ff991cf3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:46.578618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 962/1945] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:46 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:46.582880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89593b03-7f4e-4bf3-b390-e9db3f780243 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:46.593709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89593b03-7f4e-4bf3-b390-e9db3f780243 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:46.598539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f314e-81cf-4f13-88cc-163a307cf02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:46.599157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f314e-81cf-4f13-88cc-163a307cf02f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:46.599434 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f314e-81cf-4f13-88cc-163a307cf02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:46.599827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f314e-81cf-4f13-88cc-163a307cf02f admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.600540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f314e-81cf-4f13-88cc-163a307cf02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:46.602115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f314e-81cf-4f13-88cc-163a307cf02f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:46.613135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 984/1946] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:46.617925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef249c37-932b-43e2-a4f0-ff22ff991cf3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:46.628511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef249c37-932b-43e2-a4f0-ff22ff991cf3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:46.633108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d065e9-4cec-410d-93ea-38f48d73ca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:46.633706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d065e9-4cec-410d-93ea-38f48d73ca4c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:46.633981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d065e9-4cec-410d-93ea-38f48d73ca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:46.634252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d065e9-4cec-410d-93ea-38f48d73ca4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.634893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d065e9-4cec-410d-93ea-38f48d73ca4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:46.636572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d065e9-4cec-410d-93ea-38f48d73ca4c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:46.647431 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 963/1947] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:46.651751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f314e-81cf-4f13-88cc-163a307cf02f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:46.662432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f314e-81cf-4f13-88cc-163a307cf02f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:46.667176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30a9ec-6ca5-4623-baf1-84896ae3dae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:46.667842 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30a9ec-6ca5-4623-baf1-84896ae3dae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:46.668694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30a9ec-6ca5-4623-baf1-84896ae3dae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:46.668963 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30a9ec-6ca5-4623-baf1-84896ae3dae6 admin admin] PATH_INFO: `/v3/projects/7c6c7a6a9fcd48e3acc658aff62ca1b4/users/6800c08c5767432e8e1975cf76b89929/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.683443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30a9ec-6ca5-4623-baf1-84896ae3dae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6c7a6a9fcd48e3acc658aff62ca1b4, user_id=6800c08c5767432e8e1975cf76b89929, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:46.686125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30a9ec-6ca5-4623-baf1-84896ae3dae6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:46.688409 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d065e9-4cec-410d-93ea-38f48d73ca4c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:46.699785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 985/1948] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:46 2022] PUT /identity/v3/projects/7c6c7a6a9fcd48e3acc658aff62ca1b4/users/6800c08c5767432e8e1975cf76b89929/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:46.709887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e71b44-4881-40ee-98ce-fb9e34b13c4a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:46.710172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e71b44-4881-40ee-98ce-fb9e34b13c4a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:46.710439 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e71b44-4881-40ee-98ce-fb9e34b13c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.716019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:46.737375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c9e71b44-4881-40ee-98ce-fb9e34b13c4a None None] MFA Rules not processed for user `6800c08c5767432e8e1975cf76b89929`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:46.738560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c9e71b44-4881-40ee-98ce-fb9e34b13c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:46.753422 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d065e9-4cec-410d-93ea-38f48d73ca4c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:46.818267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d13d24-e401-4d2b-9d23-3c709f9c9e25 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b6baca9f6c45c1911ae661776a9c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe839553f734e8d8de79652221dd634', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:46.818903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d13d24-e401-4d2b-9d23-3c709f9c9e25 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:46.819213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d13d24-e401-4d2b-9d23-3c709f9c9e25 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:46.819495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d13d24-e401-4d2b-9d23-3c709f9c9e25 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.820058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 986/1949] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:46.820458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d13d24-e401-4d2b-9d23-3c709f9c9e25 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:46.820618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d13d24-e401-4d2b-9d23-3c709f9c9e25 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:46.822154 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d13d24-e401-4d2b-9d23-3c709f9c9e25 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:46.832067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e71b44-4881-40ee-98ce-fb9e34b13c4a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:46.852602 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 964/1950] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:33:46.857311 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d13d24-e401-4d2b-9d23-3c709f9c9e25 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:46.870532 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d13d24-e401-4d2b-9d23-3c709f9c9e25 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:46.891939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97de77e-8947-4574-bc75-bdfb74ec8c2b tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b6baca9f6c45c1911ae661776a9c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe839553f734e8d8de79652221dd634', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:46.892837 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97de77e-8947-4574-bc75-bdfb74ec8c2b tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:46.893087 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97de77e-8947-4574-bc75-bdfb74ec8c2b tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:46.893364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97de77e-8947-4574-bc75-bdfb74ec8c2b tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:46.893993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97de77e-8947-4574-bc75-bdfb74ec8c2b tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:46.897437 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97de77e-8947-4574-bc75-bdfb74ec8c2b tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:46.919169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:46.936369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 965/1951] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:46 2022] POST /identity/v3/projects => generated 355 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:46.938968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e71b44-4881-40ee-98ce-fb9e34b13c4a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:46.941890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97de77e-8947-4574-bc75-bdfb74ec8c2b tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:47.044689 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97de77e-8947-4574-bc75-bdfb74ec8c2b tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:47.053422 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221f6cf-7a50-43cc-9548-a258a787bfc9 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b6baca9f6c45c1911ae661776a9c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe839553f734e8d8de79652221dd634', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:47.054235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221f6cf-7a50-43cc-9548-a258a787bfc9 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:47.054720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221f6cf-7a50-43cc-9548-a258a787bfc9 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:47.055149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221f6cf-7a50-43cc-9548-a258a787bfc9 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:47.055890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221f6cf-7a50-43cc-9548-a258a787bfc9 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:47.056284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221f6cf-7a50-43cc-9548-a258a787bfc9 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:47.058399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221f6cf-7a50-43cc-9548-a258a787bfc9 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:47.077949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 966/1952] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:33:47.080883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737029a-514e-4b8c-a158-1b5b2f61e8a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:47.081558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737029a-514e-4b8c-a158-1b5b2f61e8a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:47.081930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737029a-514e-4b8c-a158-1b5b2f61e8a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:47.082308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737029a-514e-4b8c-a158-1b5b2f61e8a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:47.156847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221f6cf-7a50-43cc-9548-a258a787bfc9 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:47.157718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737029a-514e-4b8c-a158-1b5b2f61e8a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:47.159195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737029a-514e-4b8c-a158-1b5b2f61e8a1 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:47.169084 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221f6cf-7a50-43cc-9548-a258a787bfc9 tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:47.177523 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef105e-ebd9-4975-86f8-d3b030fb753d tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b6baca9f6c45c1911ae661776a9c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe839553f734e8d8de79652221dd634', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:47.178160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef105e-ebd9-4975-86f8-d3b030fb753d tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:47.178737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef105e-ebd9-4975-86f8-d3b030fb753d tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:47.178737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef105e-ebd9-4975-86f8-d3b030fb753d tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] PATH_INFO: `/v3/projects/9cfa8febd1354d9d981348718fb26f9a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:47.179892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef105e-ebd9-4975-86f8-d3b030fb753d tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9cfa8febd1354d9d981348718fb26f9a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:47.183467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef105e-ebd9-4975-86f8-d3b030fb753d tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:47.192287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 987/1953] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:33:47.233253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:47.252603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-efef105e-ebd9-4975-86f8-d3b030fb753d tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cfa8febd1354d9d981348718fb26f9a', 'request_id': 'req-efef105e-ebd9-4975-86f8-d3b030fb753d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:47.260282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-efef105e-ebd9-4975-86f8-d3b030fb753d tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cfa8febd1354d9d981348718fb26f9a', 'request_id': 'req-efef105e-ebd9-4975-86f8-d3b030fb753d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:47.270157 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-efef105e-ebd9-4975-86f8-d3b030fb753d tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cfa8febd1354d9d981348718fb26f9a', 'request_id': 'req-efef105e-ebd9-4975-86f8-d3b030fb753d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:47.289512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-efef105e-ebd9-4975-86f8-d3b030fb753d tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] The token cache is being invalidate because project 9cfa8febd1354d9d981348718fb26f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:47.289836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-efef105e-ebd9-4975-86f8-d3b030fb753d tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:47.290415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-efef105e-ebd9-4975-86f8-d3b030fb753d tempest-VolumeQuotaClassesTest-923913699 tempest-VolumeQuotaClassesTest-923913699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:47.291990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 967/1954] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:47 2022] DELETE /identity/v3/projects/9cfa8febd1354d9d981348718fb26f9a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:47.601805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737029a-514e-4b8c-a158-1b5b2f61e8a1 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:47.603289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f737029a-514e-4b8c-a158-1b5b2f61e8a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:47.714007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737029a-514e-4b8c-a158-1b5b2f61e8a1 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:47.788288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:47.788921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:47.789198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:47.789469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] PATH_INFO: `/v3/users/59c61f87632441d3a785f75ec5cc323d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:47.790680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c61f87632441d3a785f75ec5cc323d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:47.792568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:47.803875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:47.868026 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c61f87632441d3a785f75ec5cc323d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:47.876098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c61f87632441d3a785f75ec5cc323d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:47.891819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c61f87632441d3a785f75ec5cc323d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:47.892592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c61f87632441d3a785f75ec5cc323d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:47.911428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c61f87632441d3a785f75ec5cc323d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:47.928571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 988/1955] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:47 2022] DELETE /identity/v3/users/59c61f87632441d3a785f75ec5cc323d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:47.930196 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c402945-79fa-4b73-980f-3a89159e5af1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:47.930653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c402945-79fa-4b73-980f-3a89159e5af1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:47.930751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c402945-79fa-4b73-980f-3a89159e5af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:47.963331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7c402945-79fa-4b73-980f-3a89159e5af1 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:47.964541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7c402945-79fa-4b73-980f-3a89159e5af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:48.037749 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 968/1956] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:48.049012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:48.050607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:48.120853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632046b-3a02-41a9-a4fa-5fdc0d1df3b4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:48.125427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baa9cf-868e-4ae1-8db3-9624d6b731e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:48.126461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baa9cf-868e-4ae1-8db3-9624d6b731e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:48.126711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baa9cf-868e-4ae1-8db3-9624d6b731e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:48.127271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baa9cf-868e-4ae1-8db3-9624d6b731e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:48.136985 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baa9cf-868e-4ae1-8db3-9624d6b731e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:48.138892 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baa9cf-868e-4ae1-8db3-9624d6b731e0 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:48.148963 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 989/1957] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:48.280358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c402945-79fa-4b73-980f-3a89159e5af1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:48.282071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7c402945-79fa-4b73-980f-3a89159e5af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:48.296546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c402945-79fa-4b73-980f-3a89159e5af1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:48.317706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:48.318342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:48.318618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:48.318886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] PATH_INFO: `/v3/users/c7c30443cb0a4488986e826f6d2a8e32` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:48.320052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c30443cb0a4488986e826f6d2a8e32)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:48.321959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:48.374201 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c30443cb0a4488986e826f6d2a8e32'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.381704 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c30443cb0a4488986e826f6d2a8e32'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.382572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c30443cb0a4488986e826f6d2a8e32'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.383182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c30443cb0a4488986e826f6d2a8e32'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.395167 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c30443cb0a4488986e826f6d2a8e32'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.408113 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 969/1958] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:48 2022] DELETE /identity/v3/users/c7c30443cb0a4488986e826f6d2a8e32 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:48.412613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921ff65-c6dd-4909-ba9e-f42c88537826 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:48.412902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921ff65-c6dd-4909-ba9e-f42c88537826 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:48.413178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921ff65-c6dd-4909-ba9e-f42c88537826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:48.433522 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5921ff65-c6dd-4909-ba9e-f42c88537826 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:48.435346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5921ff65-c6dd-4909-ba9e-f42c88537826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:48.439330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:48.440922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:48.483580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:48.510391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 990/1959] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:48.516715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0d177-24e8-4ebd-85a9-26e370f6da49 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:48.520390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921ff65-c6dd-4909-ba9e-f42c88537826 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:48.521560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:48.521715 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5921ff65-c6dd-4909-ba9e-f42c88537826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:48.522238 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:48.522514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:48.522785 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] PATH_INFO: `/v3/projects/5592a74700c9422c9999e2533bd171a3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:48.523931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5592a74700c9422c9999e2533bd171a3)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:48.525801 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:48.552519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:48.575454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5592a74700c9422c9999e2533bd171a3', 'request_id': 'req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.581608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5592a74700c9422c9999e2533bd171a3', 'request_id': 'req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.581865 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921ff65-c6dd-4909-ba9e-f42c88537826 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:48.588987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5592a74700c9422c9999e2533bd171a3', 'request_id': 'req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.615576 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] The token cache is being invalidate because project 5592a74700c9422c9999e2533bd171a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:48.615877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.617147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.620112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 970/1960] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:48 2022] DELETE /identity/v3/projects/5592a74700c9422c9999e2533bd171a3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:48.623769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:48.625228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:48.647243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edbe88-39a3-4bb2-9840-31e413df3468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:48.647950 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edbe88-39a3-4bb2-9840-31e413df3468 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:48.648339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edbe88-39a3-4bb2-9840-31e413df3468 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:48.648635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edbe88-39a3-4bb2-9840-31e413df3468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:48.650487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-80edbe88-39a3-4bb2-9840-31e413df3468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:48.771719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2f4ed-3e27-40d7-b692-e19f6d64dd44 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:48.778816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518a99f-4966-40a4-b965-91f17d2f6c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:48.779711 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518a99f-4966-40a4-b965-91f17d2f6c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:48.779990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518a99f-4966-40a4-b965-91f17d2f6c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:48.780259 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518a99f-4966-40a4-b965-91f17d2f6c16 admin admin] PATH_INFO: `/v3/users/b8b6baca9f6c45c1911ae661776a9c70` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:48.781550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518a99f-4966-40a4-b965-91f17d2f6c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b6baca9f6c45c1911ae661776a9c70)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:48.783924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518a99f-4966-40a4-b965-91f17d2f6c16 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:48.791113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edbe88-39a3-4bb2-9840-31e413df3468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:48.792759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edbe88-39a3-4bb2-9840-31e413df3468 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:48.808350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 991/1961] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:33:48.851997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a518a99f-4966-40a4-b965-91f17d2f6c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b6baca9f6c45c1911ae661776a9c70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.862399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a518a99f-4966-40a4-b965-91f17d2f6c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b6baca9f6c45c1911ae661776a9c70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.863545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a518a99f-4966-40a4-b965-91f17d2f6c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b6baca9f6c45c1911ae661776a9c70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.864656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a518a99f-4966-40a4-b965-91f17d2f6c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b6baca9f6c45c1911ae661776a9c70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.877695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:48.886099 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a518a99f-4966-40a4-b965-91f17d2f6c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b6baca9f6c45c1911ae661776a9c70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:48.904550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 971/1962] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:48 2022] DELETE /identity/v3/users/b8b6baca9f6c45c1911ae661776a9c70 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:49.230990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edbe88-39a3-4bb2-9840-31e413df3468 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:49.247961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edbe88-39a3-4bb2-9840-31e413df3468 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:49.318168 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:49.318697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:49.318954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:49.319330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8 admin admin] PATH_INFO: `/v3/projects/afe839553f734e8d8de79652221dd634` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:49.320534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe839553f734e8d8de79652221dd634)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:49.322445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:49.364005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:49.374939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe839553f734e8d8de79652221dd634', 'request_id': 'req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:49.380322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe839553f734e8d8de79652221dd634', 'request_id': 'req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:49.388362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe839553f734e8d8de79652221dd634', 'request_id': 'req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:49.401847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8 admin admin] The token cache is being invalidate because project afe839553f734e8d8de79652221dd634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:49.402147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:49.402828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-56f1411f-ca98-45cd-8d28-9eec50b1f1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:49.404679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 992/1963] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:49 2022] DELETE /identity/v3/projects/afe839553f734e8d8de79652221dd634 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:49.409959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68b1c-eb7d-4676-a843-66a3c5e03212 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:49.410443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68b1c-eb7d-4676-a843-66a3c5e03212 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:49.410521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68b1c-eb7d-4676-a843-66a3c5e03212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:49.432777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-67e68b1c-eb7d-4676-a843-66a3c5e03212 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:49.434468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-67e68b1c-eb7d-4676-a843-66a3c5e03212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:49.497852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 972/1964] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:49.506219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13667658-71ef-4393-9b43-1c8530ef4d46 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:49.506494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13667658-71ef-4393-9b43-1c8530ef4d46 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:49.506762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13667658-71ef-4393-9b43-1c8530ef4d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:49.528913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-13667658-71ef-4393-9b43-1c8530ef4d46 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:49.530127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-13667658-71ef-4393-9b43-1c8530ef4d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:49.540722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 993/1965] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:49.546628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e68b1c-eb7d-4676-a843-66a3c5e03212 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:49.573096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e68b1c-eb7d-4676-a843-66a3c5e03212 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:49.580713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9876c9b-4562-41da-aa9a-1571c6499d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:49.581578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876c9b-4562-41da-aa9a-1571c6499d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:49.581863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876c9b-4562-41da-aa9a-1571c6499d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:49.582188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876c9b-4562-41da-aa9a-1571c6499d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:49.582905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9876c9b-4562-41da-aa9a-1571c6499d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:49.583236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9876c9b-4562-41da-aa9a-1571c6499d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:49.585398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9876c9b-4562-41da-aa9a-1571c6499d63 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:49.600466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 973/1966] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:33:49.604629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13667658-71ef-4393-9b43-1c8530ef4d46 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:49.614317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13667658-71ef-4393-9b43-1c8530ef4d46 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:49.619244 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4cb00-2816-4ac0-9db5-a746810973a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:49.619942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4cb00-2816-4ac0-9db5-a746810973a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:49.620313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4cb00-2816-4ac0-9db5-a746810973a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:49.620672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4cb00-2816-4ac0-9db5-a746810973a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:49.621924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4cb00-2816-4ac0-9db5-a746810973a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:49.623946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4cb00-2816-4ac0-9db5-a746810973a8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:49.666436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 994/1967] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:49 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:49.670816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9876c9b-4562-41da-aa9a-1571c6499d63 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:49.686177 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9876c9b-4562-41da-aa9a-1571c6499d63 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:49.772406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fce0a-4bc4-4604-93d2-94776304706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:49.773269 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fce0a-4bc4-4604-93d2-94776304706f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:49.774079 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fce0a-4bc4-4604-93d2-94776304706f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:49.774437 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fce0a-4bc4-4604-93d2-94776304706f admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:49.775389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fce0a-4bc4-4604-93d2-94776304706f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:49.778465 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fce0a-4bc4-4604-93d2-94776304706f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:49.790517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4cb00-2816-4ac0-9db5-a746810973a8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:49.794274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1bc4cb00-2816-4ac0-9db5-a746810973a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:49.803903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 974/1968] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:49 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:49.807797 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fce0a-4bc4-4604-93d2-94776304706f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:49.812807 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4cb00-2816-4ac0-9db5-a746810973a8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:49.818202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:49.818418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fce0a-4bc4-4604-93d2-94776304706f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:49.818861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:49.819163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:49.819438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] PATH_INFO: `/v3/projects/f811f29ab2974d13901072c30365dedd` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:49.820581 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f811f29ab2974d13901072c30365dedd)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:49.822402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:49.823331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e8599-a6e9-424c-baff-bf5396886e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:49.823931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e8599-a6e9-424c-baff-bf5396886e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:49.824207 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e8599-a6e9-424c-baff-bf5396886e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:49.825010 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e8599-a6e9-424c-baff-bf5396886e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:49.825655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e8599-a6e9-424c-baff-bf5396886e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:49.827345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e8599-a6e9-424c-baff-bf5396886e35 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:49.838320 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 975/1969] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:49.842716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e8599-a6e9-424c-baff-bf5396886e35 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:49.853854 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e8599-a6e9-424c-baff-bf5396886e35 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:49.858558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b831c-7ef4-4a27-bca0-e62d5231036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:49.859195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b831c-7ef4-4a27-bca0-e62d5231036d admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:49.859476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b831c-7ef4-4a27-bca0-e62d5231036d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:49.859750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b831c-7ef4-4a27-bca0-e62d5231036d admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:49.860381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b831c-7ef4-4a27-bca0-e62d5231036d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:49.861954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b831c-7ef4-4a27-bca0-e62d5231036d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:49.871204 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f811f29ab2974d13901072c30365dedd', 'request_id': 'req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:49.875279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 976/1970] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:49.876567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b831c-7ef4-4a27-bca0-e62d5231036d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:49.877840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f811f29ab2974d13901072c30365dedd', 'request_id': 'req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:49.885423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f811f29ab2974d13901072c30365dedd', 'request_id': 'req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:49.888072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b831c-7ef4-4a27-bca0-e62d5231036d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:49.899623 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] The token cache is being invalidate because project f811f29ab2974d13901072c30365dedd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:49.900173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:49.900855 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:49.903276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 995/1971] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:49 2022] DELETE /identity/v3/projects/f811f29ab2974d13901072c30365dedd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:49.906975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:49.908407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:49.924050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:49.961716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e819d60-651c-4645-86f2-0cbd41e73f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:49.961716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e819d60-651c-4645-86f2-0cbd41e73f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:49.961716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e819d60-651c-4645-86f2-0cbd41e73f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:49.961716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e819d60-651c-4645-86f2-0cbd41e73f0a admin admin] PATH_INFO: `/v3/projects/083e704b0f6b42c08713a3db7099c91c/users/5ef70e52872a455088e1b380e60da042/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:49.973621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e819d60-651c-4645-86f2-0cbd41e73f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=083e704b0f6b42c08713a3db7099c91c, user_id=5ef70e52872a455088e1b380e60da042, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:49.976356 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e819d60-651c-4645-86f2-0cbd41e73f0a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:49.976869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da793bb1-6cdf-42c5-9af0-0cd5301ebc5a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:49.981607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:49.982424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:49.982650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:49.982889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] PATH_INFO: `/v3/users/7617140a9e964f3e8d3362a94ce5e21f` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:49.989172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7617140a9e964f3e8d3362a94ce5e21f)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:49.989172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:49.996016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 977/1972] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:49 2022] PUT /identity/v3/projects/083e704b0f6b42c08713a3db7099c91c/users/5ef70e52872a455088e1b380e60da042/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:50.006531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a9dde-70ef-4d2f-ac8a-1dd8bdac0a6a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:50.007908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a9dde-70ef-4d2f-ac8a-1dd8bdac0a6a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:50.008282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a9dde-70ef-4d2f-ac8a-1dd8bdac0a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:50.014986 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:50.044903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5e2a9dde-70ef-4d2f-ac8a-1dd8bdac0a6a None None] MFA Rules not processed for user `5ef70e52872a455088e1b380e60da042`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:50.046790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5e2a9dde-70ef-4d2f-ac8a-1dd8bdac0a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:50.053342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7617140a9e964f3e8d3362a94ce5e21f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:50.080863 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7617140a9e964f3e8d3362a94ce5e21f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:50.097626 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7617140a9e964f3e8d3362a94ce5e21f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:50.099724 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7617140a9e964f3e8d3362a94ce5e21f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:50.118093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7617140a9e964f3e8d3362a94ce5e21f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:50.127226 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 996/1973] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:49 2022] DELETE /identity/v3/users/7617140a9e964f3e8d3362a94ce5e21f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:50.145826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 978/1974] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:50.150495 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:50.152388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:50.257751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb641532-3f83-4121-bb15-bb28ed26934d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:50.265075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dcc11-f330-4936-8b3d-fbdb905a85e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:50.265794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dcc11-f330-4936-8b3d-fbdb905a85e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:50.266248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dcc11-f330-4936-8b3d-fbdb905a85e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:50.266622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dcc11-f330-4936-8b3d-fbdb905a85e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:50.267428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dcc11-f330-4936-8b3d-fbdb905a85e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:50.269566 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dcc11-f330-4936-8b3d-fbdb905a85e4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:50.302078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 997/1975] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:50 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:33:50.306178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a9dde-70ef-4d2f-ac8a-1dd8bdac0a6a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:50.390496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a9dde-70ef-4d2f-ac8a-1dd8bdac0a6a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:50.460580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:50.461156 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dcc11-f330-4936-8b3d-fbdb905a85e4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:50.463179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b00dcc11-f330-4936-8b3d-fbdb905a85e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:50.470682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d9559-54a1-4225-b33e-1c1e688b1999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:50.472160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d9559-54a1-4225-b33e-1c1e688b1999 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:50.472757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d9559-54a1-4225-b33e-1c1e688b1999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:50.473425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d9559-54a1-4225-b33e-1c1e688b1999 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:50.474755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d9559-54a1-4225-b33e-1c1e688b1999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:50.477188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d9559-54a1-4225-b33e-1c1e688b1999 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:50.519628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 979/1976] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:50 2022] POST /identity/v3/users => generated 296 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:50.522056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d9559-54a1-4225-b33e-1c1e688b1999 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:50.531628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d9559-54a1-4225-b33e-1c1e688b1999 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:50.536333 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb75bcc-b23f-49ca-a0a4-99093cf2be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:50.536937 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb75bcc-b23f-49ca-a0a4-99093cf2be58 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:50.537211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb75bcc-b23f-49ca-a0a4-99093cf2be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:50.537479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb75bcc-b23f-49ca-a0a4-99093cf2be58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:50.538182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb75bcc-b23f-49ca-a0a4-99093cf2be58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:50.539846 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb75bcc-b23f-49ca-a0a4-99093cf2be58 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:50.550912 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 980/1977] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:50.553196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dcc11-f330-4936-8b3d-fbdb905a85e4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:50.555331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb75bcc-b23f-49ca-a0a4-99093cf2be58 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:50.562826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:50.563507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:50.564377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:50.564666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e admin admin] PATH_INFO: `/v3/projects/3ba7a34ecc7c481e95ea66c5b8495de0` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:50.565826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba7a34ecc7c481e95ea66c5b8495de0)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:50.567816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:50.569014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb75bcc-b23f-49ca-a0a4-99093cf2be58 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:50.576110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1d3ca-ea21-43e3-a09c-0a927f898897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:50.576770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1d3ca-ea21-43e3-a09c-0a927f898897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:50.577109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1d3ca-ea21-43e3-a09c-0a927f898897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:50.578009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1d3ca-ea21-43e3-a09c-0a927f898897 admin admin] PATH_INFO: `/v3/projects/c0a45f32fdb8429fbef49d8d91be495a/users/5b13186bc31d49b4af3f22e558207667/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:50.597710 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1d3ca-ea21-43e3-a09c-0a927f898897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a45f32fdb8429fbef49d8d91be495a, user_id=5b13186bc31d49b4af3f22e558207667, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:50.600899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1d3ca-ea21-43e3-a09c-0a927f898897 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:50.612557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:50.622431 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 981/1978] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:50 2022] PUT /identity/v3/projects/c0a45f32fdb8429fbef49d8d91be495a/users/5b13186bc31d49b4af3f22e558207667/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:50.626987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1d3ca-ea21-43e3-a09c-0a927f898897 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:50.641527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba7a34ecc7c481e95ea66c5b8495de0', 'request_id': 'req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:50.647714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba7a34ecc7c481e95ea66c5b8495de0', 'request_id': 'req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:50.654401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba7a34ecc7c481e95ea66c5b8495de0', 'request_id': 'req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:50.671780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e admin admin] The token cache is being invalidate because project 3ba7a34ecc7c481e95ea66c5b8495de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:50.671780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:50.672359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6bee2a7b-1b67-41a2-bd7e-0e6ac19a749e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:50.674966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 998/1979] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:50 2022] DELETE /identity/v3/projects/3ba7a34ecc7c481e95ea66c5b8495de0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:50.680550 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e3074-fdd1-42db-a5a6-46d56f693d63 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:50.681166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e3074-fdd1-42db-a5a6-46d56f693d63 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:50.681681 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e3074-fdd1-42db-a5a6-46d56f693d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:50.704333 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8c6e3074-fdd1-42db-a5a6-46d56f693d63 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:50.705663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8c6e3074-fdd1-42db-a5a6-46d56f693d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:50.710890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1d3ca-ea21-43e3-a09c-0a927f898897 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:50.785896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c85de5-49e0-4d6f-ac5a-ec2ee0e2d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:50.786657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c85de5-49e0-4d6f-ac5a-ec2ee0e2d300 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:50.787000 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c85de5-49e0-4d6f-ac5a-ec2ee0e2d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:50.787425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c85de5-49e0-4d6f-ac5a-ec2ee0e2d300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:50.788116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c85de5-49e0-4d6f-ac5a-ec2ee0e2d300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:50.790158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c85de5-49e0-4d6f-ac5a-ec2ee0e2d300 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:50.801318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 982/1980] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:50.805327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c85de5-49e0-4d6f-ac5a-ec2ee0e2d300 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:50.807584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a8c85de5-49e0-4d6f-ac5a-ec2ee0e2d300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:50.816599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 999/1981] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:50.823180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c85de5-49e0-4d6f-ac5a-ec2ee0e2d300 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:50.824660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1678f19-7568-4de7-b014-0cecd12e973e None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:50.824968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1678f19-7568-4de7-b014-0cecd12e973e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:50.825294 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1678f19-7568-4de7-b014-0cecd12e973e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:50.830285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a72fd1-2aaf-47a6-a71b-6f7eafbd4ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:50.831161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a72fd1-2aaf-47a6-a71b-6f7eafbd4ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:50.831518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a72fd1-2aaf-47a6-a71b-6f7eafbd4ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:50.831886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a72fd1-2aaf-47a6-a71b-6f7eafbd4ea2 admin admin] PATH_INFO: `/v3/projects/c0a45f32fdb8429fbef49d8d91be495a/users/5b13186bc31d49b4af3f22e558207667/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:50.834194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a72fd1-2aaf-47a6-a71b-6f7eafbd4ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a45f32fdb8429fbef49d8d91be495a, user_id=5b13186bc31d49b4af3f22e558207667, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:50.837002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a72fd1-2aaf-47a6-a71b-6f7eafbd4ea2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:50.851697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 983/1982] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:50 2022] PUT /identity/v3/projects/c0a45f32fdb8429fbef49d8d91be495a/users/5b13186bc31d49b4af3f22e558207667/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:50.858280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c1678f19-7568-4de7-b014-0cecd12e973e None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:50.859513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c1678f19-7568-4de7-b014-0cecd12e973e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:50.863104 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692cde6-3c27-4065-8a64-053b7400d876 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:50.863969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692cde6-3c27-4065-8a64-053b7400d876 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:50.863969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692cde6-3c27-4065-8a64-053b7400d876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:50.892995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a692cde6-3c27-4065-8a64-053b7400d876 None None] MFA Rules not processed for user `5b13186bc31d49b4af3f22e558207667`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:50.894182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a692cde6-3c27-4065-8a64-053b7400d876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:50.927302 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:50.931778 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1000/1983] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:50.936339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1678f19-7568-4de7-b014-0cecd12e973e None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:50.951183 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1678f19-7568-4de7-b014-0cecd12e973e None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:50.958485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2aa46-38d9-4c9a-b006-b9b04b6d85be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:50.959450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2aa46-38d9-4c9a-b006-b9b04b6d85be admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:50.959861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2aa46-38d9-4c9a-b006-b9b04b6d85be admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:50.960329 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2aa46-38d9-4c9a-b006-b9b04b6d85be admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:50.960988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2aa46-38d9-4c9a-b006-b9b04b6d85be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:50.961299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2aa46-38d9-4c9a-b006-b9b04b6d85be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:50.962892 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2aa46-38d9-4c9a-b006-b9b04b6d85be admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:50.978970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 984/1984] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:50.979594 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1001/1985] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:33:50.992706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692cde6-3c27-4065-8a64-053b7400d876 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:50.997238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2aa46-38d9-4c9a-b006-b9b04b6d85be admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:51.002962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ade2aa46-38d9-4c9a-b006-b9b04b6d85be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:51.019362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692cde6-3c27-4065-8a64-053b7400d876 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:51.026711 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60905ee2-c6da-4b90-9474-e9bfc891ab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:51.028023 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60905ee2-c6da-4b90-9474-e9bfc891ab6f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:51.028365 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60905ee2-c6da-4b90-9474-e9bfc891ab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:51.028728 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60905ee2-c6da-4b90-9474-e9bfc891ab6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:51.029471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60905ee2-c6da-4b90-9474-e9bfc891ab6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:51.031582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60905ee2-c6da-4b90-9474-e9bfc891ab6f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:51.069300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 985/1986] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:50 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:51.070625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60905ee2-c6da-4b90-9474-e9bfc891ab6f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:51.083428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:51.102002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2aa46-38d9-4c9a-b006-b9b04b6d85be admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:51.162110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60905ee2-c6da-4b90-9474-e9bfc891ab6f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:51.169318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84ef28-ad25-4bde-aee6-58ead58028c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:51.170371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ef28-ad25-4bde-aee6-58ead58028c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:51.170713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ef28-ad25-4bde-aee6-58ead58028c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:51.171212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ef28-ad25-4bde-aee6-58ead58028c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:51.172051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84ef28-ad25-4bde-aee6-58ead58028c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:51.176916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84ef28-ad25-4bde-aee6-58ead58028c8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:51.182719 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9263d75-461a-405b-acc2-84f5f985c98b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:51.183384 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263d75-461a-405b-acc2-84f5f985c98b service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:51.183684 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263d75-461a-405b-acc2-84f5f985c98b service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:51.183980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263d75-461a-405b-acc2-84f5f985c98b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:51.219210 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 986/1987] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:51 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:51.220305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84ef28-ad25-4bde-aee6-58ead58028c8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:51.254183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84ef28-ad25-4bde-aee6-58ead58028c8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:51.258897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015320db-c1fd-4407-a226-1ae1b65b76da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:51.259542 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015320db-c1fd-4407-a226-1ae1b65b76da admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:51.260418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015320db-c1fd-4407-a226-1ae1b65b76da admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:51.260418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015320db-c1fd-4407-a226-1ae1b65b76da admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:51.260816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015320db-c1fd-4407-a226-1ae1b65b76da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:51.263361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015320db-c1fd-4407-a226-1ae1b65b76da admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:51.273637 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9263d75-461a-405b-acc2-84f5f985c98b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:51.275407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 987/1988] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:51.276816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9263d75-461a-405b-acc2-84f5f985c98b service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:51.280083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015320db-c1fd-4407-a226-1ae1b65b76da admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:51.290099 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1002/1989] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:51.291703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015320db-c1fd-4407-a226-1ae1b65b76da admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:51.296545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133f5fb-0ceb-4f0c-b4db-9b0daf0bd071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:51.297136 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133f5fb-0ceb-4f0c-b4db-9b0daf0bd071 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:51.297411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133f5fb-0ceb-4f0c-b4db-9b0daf0bd071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:51.297699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133f5fb-0ceb-4f0c-b4db-9b0daf0bd071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:51.298334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133f5fb-0ceb-4f0c-b4db-9b0daf0bd071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:51.300883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133f5fb-0ceb-4f0c-b4db-9b0daf0bd071 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:51.312809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 988/1990] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:33:51.317010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9263d75-461a-405b-acc2-84f5f985c98b service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:51.334101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9263d75-461a-405b-acc2-84f5f985c98b service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:51.349695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56492bf1-6d02-4603-b3b1-e4504f322fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:51.351444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56492bf1-6d02-4603-b3b1-e4504f322fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:51.351896 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56492bf1-6d02-4603-b3b1-e4504f322fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:51.352317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56492bf1-6d02-4603-b3b1-e4504f322fc7 admin admin] PATH_INFO: `/v3/projects/937b09d0a1b94582ac4ebc9e68f36d89/users/300dd327543b466d8202d987b214dc6e/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:51.396295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56492bf1-6d02-4603-b3b1-e4504f322fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937b09d0a1b94582ac4ebc9e68f36d89, user_id=300dd327543b466d8202d987b214dc6e, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:51.397689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56492bf1-6d02-4603-b3b1-e4504f322fc7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:51.423555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1003/1991] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:51 2022] PUT /identity/v3/projects/937b09d0a1b94582ac4ebc9e68f36d89/users/300dd327543b466d8202d987b214dc6e/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:51.434459 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93991b-a5c1-4201-905d-3a03c43f8964 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:51.434975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93991b-a5c1-4201-905d-3a03c43f8964 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:51.436697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93991b-a5c1-4201-905d-3a03c43f8964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:51.498751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1b93991b-a5c1-4201-905d-3a03c43f8964 None None] MFA Rules not processed for user `300dd327543b466d8202d987b214dc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:51.499999 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1b93991b-a5c1-4201-905d-3a03c43f8964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:51.582990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:51.587350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 989/1992] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:51.600358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56492bf1-6d02-4603-b3b1-e4504f322fc7 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:51.660160 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56492bf1-6d02-4603-b3b1-e4504f322fc7 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:51.663791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f806c67-5a51-41eb-a432-c9a0429e2860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:51.664392 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f806c67-5a51-41eb-a432-c9a0429e2860 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:51.664674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f806c67-5a51-41eb-a432-c9a0429e2860 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:51.664946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f806c67-5a51-41eb-a432-c9a0429e2860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:51.673081 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f806c67-5a51-41eb-a432-c9a0429e2860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:51.674482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f806c67-5a51-41eb-a432-c9a0429e2860 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:51.683437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1004/1993] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:33:51.712351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93991b-a5c1-4201-905d-3a03c43f8964 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:51.790841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93991b-a5c1-4201-905d-3a03c43f8964 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:51.796215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ffff4-83e2-4fa0-a1bc-934a7376519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:51.796933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ffff4-83e2-4fa0-a1bc-934a7376519c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:51.797328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ffff4-83e2-4fa0-a1bc-934a7376519c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:51.797748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ffff4-83e2-4fa0-a1bc-934a7376519c admin admin] PATH_INFO: `/v3/users/300dd327543b466d8202d987b214dc6e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:51.799178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ffff4-83e2-4fa0-a1bc-934a7376519c admin admin] RBAC: Authorizing `identity:delete_user(user_id=300dd327543b466d8202d987b214dc6e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:51.801395 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ffff4-83e2-4fa0-a1bc-934a7376519c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:51.869248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f806c67-5a51-41eb-a432-c9a0429e2860 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:51.890723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-401ffff4-83e2-4fa0-a1bc-934a7376519c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300dd327543b466d8202d987b214dc6e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:51.895228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f806c67-5a51-41eb-a432-c9a0429e2860 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:51.902380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397ed5c-92bc-4390-8bcd-4517e5ba8648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:51.903009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397ed5c-92bc-4390-8bcd-4517e5ba8648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:51.903323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397ed5c-92bc-4390-8bcd-4517e5ba8648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:51.903587 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397ed5c-92bc-4390-8bcd-4517e5ba8648 admin admin] PATH_INFO: `/v3/users/5ef70e52872a455088e1b380e60da042` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:51.905302 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-401ffff4-83e2-4fa0-a1bc-934a7376519c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300dd327543b466d8202d987b214dc6e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:51.905736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397ed5c-92bc-4390-8bcd-4517e5ba8648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef70e52872a455088e1b380e60da042)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:51.906193 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-401ffff4-83e2-4fa0-a1bc-934a7376519c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300dd327543b466d8202d987b214dc6e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:51.907115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-401ffff4-83e2-4fa0-a1bc-934a7376519c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300dd327543b466d8202d987b214dc6e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:51.907661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397ed5c-92bc-4390-8bcd-4517e5ba8648 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:51.928588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-401ffff4-83e2-4fa0-a1bc-934a7376519c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300dd327543b466d8202d987b214dc6e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:51.935723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:51.950239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 990/1994] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:51 2022] DELETE /identity/v3/users/300dd327543b466d8202d987b214dc6e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:51.954777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1dbd8-6214-4d47-8e20-12b42e737520 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:51.955641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1dbd8-6214-4d47-8e20-12b42e737520 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:51.956443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1dbd8-6214-4d47-8e20-12b42e737520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:51.969972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0397ed5c-92bc-4390-8bcd-4517e5ba8648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef70e52872a455088e1b380e60da042'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:51.979051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7de1dbd8-6214-4d47-8e20-12b42e737520 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:51.980106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0397ed5c-92bc-4390-8bcd-4517e5ba8648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef70e52872a455088e1b380e60da042'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:51.980256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7de1dbd8-6214-4d47-8e20-12b42e737520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:51.995006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0397ed5c-92bc-4390-8bcd-4517e5ba8648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef70e52872a455088e1b380e60da042'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:51.995671 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0397ed5c-92bc-4390-8bcd-4517e5ba8648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef70e52872a455088e1b380e60da042'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:52.012777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0397ed5c-92bc-4390-8bcd-4517e5ba8648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef70e52872a455088e1b380e60da042'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:52.020192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1005/1995] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:51 2022] DELETE /identity/v3/users/5ef70e52872a455088e1b380e60da042 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:52.026060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885ce8f-aa52-4a79-8045-09f81c8be38a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:52.026550 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885ce8f-aa52-4a79-8045-09f81c8be38a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:52.026971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885ce8f-aa52-4a79-8045-09f81c8be38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:52.063968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7885ce8f-aa52-4a79-8045-09f81c8be38a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:52.066702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7885ce8f-aa52-4a79-8045-09f81c8be38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:52.067601 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 991/1996] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:52.089823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1dbd8-6214-4d47-8e20-12b42e737520 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:52.091896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7de1dbd8-6214-4d47-8e20-12b42e737520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:52.119110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:52.143653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1006/1997] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:33:52.155486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885ce8f-aa52-4a79-8045-09f81c8be38a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:52.163362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1dbd8-6214-4d47-8e20-12b42e737520 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:52.220284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619119e-9962-437b-b2cf-0e02e00d934e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:52.220825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885ce8f-aa52-4a79-8045-09f81c8be38a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:52.220976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619119e-9962-437b-b2cf-0e02e00d934e service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:52.221156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619119e-9962-437b-b2cf-0e02e00d934e service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:52.221455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619119e-9962-437b-b2cf-0e02e00d934e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:52.224893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628282e-1dc1-4100-b39d-41438fa3a02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:52.225521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628282e-1dc1-4100-b39d-41438fa3a02c service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:52.225796 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628282e-1dc1-4100-b39d-41438fa3a02c service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:52.226067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628282e-1dc1-4100-b39d-41438fa3a02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:52.232690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619119e-9962-437b-b2cf-0e02e00d934e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:52.234143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619119e-9962-437b-b2cf-0e02e00d934e service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:52.240637 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628282e-1dc1-4100-b39d-41438fa3a02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:52.242253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628282e-1dc1-4100-b39d-41438fa3a02c service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:52.254256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1007/1998] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:33:52.266723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 992/1999] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:33:52.784485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628282e-1dc1-4100-b39d-41438fa3a02c service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:52.786110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8628282e-1dc1-4100-b39d-41438fa3a02c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:52.795526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619119e-9962-437b-b2cf-0e02e00d934e service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:52.797651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e619119e-9962-437b-b2cf-0e02e00d934e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:52.803226 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628282e-1dc1-4100-b39d-41438fa3a02c service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:52.808474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:52.810192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:52.810595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:52.810867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] PATH_INFO: `/v3/projects/083e704b0f6b42c08713a3db7099c91c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:52.812056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=083e704b0f6b42c08713a3db7099c91c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:52.814160 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:52.838006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619119e-9962-437b-b2cf-0e02e00d934e service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:52.847504 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:52.848240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:52.848519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:52.852369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] PATH_INFO: `/v3/projects/937b09d0a1b94582ac4ebc9e68f36d89` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:52.853660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] RBAC: Authorizing `identity:delete_project(project_id=937b09d0a1b94582ac4ebc9e68f36d89)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:52.862237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:52.870931 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:52.884799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083e704b0f6b42c08713a3db7099c91c', 'request_id': 'req-887f6f7f-549c-4bbe-83d2-99accb653889'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:52.893967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083e704b0f6b42c08713a3db7099c91c', 'request_id': 'req-887f6f7f-549c-4bbe-83d2-99accb653889'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:52.907950 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083e704b0f6b42c08713a3db7099c91c', 'request_id': 'req-887f6f7f-549c-4bbe-83d2-99accb653889'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:52.926673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] The token cache is being invalidate because project 083e704b0f6b42c08713a3db7099c91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:52.926978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:52.929182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:52.935460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1008/2000] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:52 2022] DELETE /identity/v3/projects/083e704b0f6b42c08713a3db7099c91c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:52.937937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:52.943681 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:52.947922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937b09d0a1b94582ac4ebc9e68f36d89', 'request_id': 'req-97aff8fd-1290-4d2e-9d75-14341ad3b3df'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:52.956164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937b09d0a1b94582ac4ebc9e68f36d89', 'request_id': 'req-97aff8fd-1290-4d2e-9d75-14341ad3b3df'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:52.964304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937b09d0a1b94582ac4ebc9e68f36d89', 'request_id': 'req-97aff8fd-1290-4d2e-9d75-14341ad3b3df'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:52.986497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] The token cache is being invalidate because project 937b09d0a1b94582ac4ebc9e68f36d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:52.986791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:52.987474 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:52.989079 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 993/2001] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:52 2022] DELETE /identity/v3/projects/937b09d0a1b94582ac4ebc9e68f36d89 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:53.038062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f6f7f-549c-4bbe-83d2-99accb653889 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:53.116768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da4fa4-73d5-496b-b905-6e4ad907f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:53.117769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da4fa4-73d5-496b-b905-6e4ad907f79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:53.117769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da4fa4-73d5-496b-b905-6e4ad907f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:53.118000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da4fa4-73d5-496b-b905-6e4ad907f79f admin admin] PATH_INFO: `/v3/users/5b13186bc31d49b4af3f22e558207667` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:53.119359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da4fa4-73d5-496b-b905-6e4ad907f79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b13186bc31d49b4af3f22e558207667)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:53.121515 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da4fa4-73d5-496b-b905-6e4ad907f79f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:53.184801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-09da4fa4-73d5-496b-b905-6e4ad907f79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b13186bc31d49b4af3f22e558207667'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:53.192391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-09da4fa4-73d5-496b-b905-6e4ad907f79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b13186bc31d49b4af3f22e558207667'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:53.201636 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-09da4fa4-73d5-496b-b905-6e4ad907f79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b13186bc31d49b4af3f22e558207667'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:53.202357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-09da4fa4-73d5-496b-b905-6e4ad907f79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b13186bc31d49b4af3f22e558207667'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:53.211522 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:53.219009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-09da4fa4-73d5-496b-b905-6e4ad907f79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b13186bc31d49b4af3f22e558207667'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:53.226959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1009/2002] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:33:52 2022] DELETE /identity/v3/users/5b13186bc31d49b4af3f22e558207667 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:33:53.511156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:53.515583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:53.540866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aff8fd-1290-4d2e-9d75-14341ad3b3df admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:53.601721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15e65-a9f5-488e-986a-828318f353f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:53.602350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15e65-a9f5-488e-986a-828318f353f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:53.602625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15e65-a9f5-488e-986a-828318f353f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:53.602893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15e65-a9f5-488e-986a-828318f353f5 admin admin] PATH_INFO: `/v3/projects/c0a45f32fdb8429fbef49d8d91be495a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:53.604031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d15e65-a9f5-488e-986a-828318f353f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a45f32fdb8429fbef49d8d91be495a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:53.605981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d15e65-a9f5-488e-986a-828318f353f5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:53.608795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:53.663842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-74d15e65-a9f5-488e-986a-828318f353f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a45f32fdb8429fbef49d8d91be495a', 'request_id': 'req-74d15e65-a9f5-488e-986a-828318f353f5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:53.671198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-74d15e65-a9f5-488e-986a-828318f353f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a45f32fdb8429fbef49d8d91be495a', 'request_id': 'req-74d15e65-a9f5-488e-986a-828318f353f5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:53.681857 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-74d15e65-a9f5-488e-986a-828318f353f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a45f32fdb8429fbef49d8d91be495a', 'request_id': 'req-74d15e65-a9f5-488e-986a-828318f353f5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:53.707660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-74d15e65-a9f5-488e-986a-828318f353f5 admin admin] The token cache is being invalidate because project c0a45f32fdb8429fbef49d8d91be495a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:33:53.708061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-74d15e65-a9f5-488e-986a-828318f353f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:53.708806 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-74d15e65-a9f5-488e-986a-828318f353f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:33:53.710883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 994/2003] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:33:53 2022] DELETE /identity/v3/projects/c0a45f32fdb8429fbef49d8d91be495a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:53.716175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472c6d-f5a5-48ed-aafc-c3cd72ba65e7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:53.716459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472c6d-f5a5-48ed-aafc-c3cd72ba65e7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:53.716739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472c6d-f5a5-48ed-aafc-c3cd72ba65e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:53.763446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-19472c6d-f5a5-48ed-aafc-c3cd72ba65e7 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:53.769627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-19472c6d-f5a5-48ed-aafc-c3cd72ba65e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:53.863123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1010/2004] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:53.872477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9c95b-a280-492d-9aac-29f20d7c57b2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:53.872950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9c95b-a280-492d-9aac-29f20d7c57b2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:53.873072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9c95b-a280-492d-9aac-29f20d7c57b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:53.944261 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7bf9c95b-a280-492d-9aac-29f20d7c57b2 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:53.946230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7bf9c95b-a280-492d-9aac-29f20d7c57b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:53.956382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 995/2005] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:53.960432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19472c6d-f5a5-48ed-aafc-c3cd72ba65e7 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:53.973112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19472c6d-f5a5-48ed-aafc-c3cd72ba65e7 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:53.979525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5346b51-17da-4e95-9a0d-e12a4242093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:53.980276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5346b51-17da-4e95-9a0d-e12a4242093e admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:53.980672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5346b51-17da-4e95-9a0d-e12a4242093e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:53.981227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5346b51-17da-4e95-9a0d-e12a4242093e admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:53.981955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5346b51-17da-4e95-9a0d-e12a4242093e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:33:53.982329 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5346b51-17da-4e95-9a0d-e12a4242093e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:53.984675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5346b51-17da-4e95-9a0d-e12a4242093e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:54.002263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1011/2006] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:33:54.002965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9c95b-a280-492d-9aac-29f20d7c57b2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:54.027845 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9c95b-a280-492d-9aac-29f20d7c57b2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:54.032990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e79668-a49d-4f09-9b25-a8e968fa1c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:54.033790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e79668-a49d-4f09-9b25-a8e968fa1c71 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:54.034065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e79668-a49d-4f09-9b25-a8e968fa1c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:54.034339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e79668-a49d-4f09-9b25-a8e968fa1c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:54.034970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e79668-a49d-4f09-9b25-a8e968fa1c71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:54.037076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e79668-a49d-4f09-9b25-a8e968fa1c71 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:54.071655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 996/2007] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:33:54 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:33:54.073752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5346b51-17da-4e95-9a0d-e12a4242093e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:54.092353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5346b51-17da-4e95-9a0d-e12a4242093e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:54.171337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593244e-111e-416f-98fd-4338728f1678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:54.172055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593244e-111e-416f-98fd-4338728f1678 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:54.172397 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593244e-111e-416f-98fd-4338728f1678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:54.172729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593244e-111e-416f-98fd-4338728f1678 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:54.173410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593244e-111e-416f-98fd-4338728f1678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:54.175473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593244e-111e-416f-98fd-4338728f1678 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:54.209589 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1012/2008] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:33:54 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:33:54.211802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e79668-a49d-4f09-9b25-a8e968fa1c71 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:54.226285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e79668-a49d-4f09-9b25-a8e968fa1c71 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:54.233072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75adbf8-8d0c-42f0-9afb-ef5a53c56820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:54.234386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75adbf8-8d0c-42f0-9afb-ef5a53c56820 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:54.234872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75adbf8-8d0c-42f0-9afb-ef5a53c56820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:54.235416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75adbf8-8d0c-42f0-9afb-ef5a53c56820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:54.236987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75adbf8-8d0c-42f0-9afb-ef5a53c56820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:54.239513 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75adbf8-8d0c-42f0-9afb-ef5a53c56820 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:54.257273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 997/2009] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:54.262301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593244e-111e-416f-98fd-4338728f1678 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:54.283350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593244e-111e-416f-98fd-4338728f1678 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:54.288890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04991cb8-fa27-4f09-8da5-a329fc764f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:54.289835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04991cb8-fa27-4f09-8da5-a329fc764f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:54.290150 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04991cb8-fa27-4f09-8da5-a329fc764f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:54.290440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04991cb8-fa27-4f09-8da5-a329fc764f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:54.291193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04991cb8-fa27-4f09-8da5-a329fc764f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:54.292949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04991cb8-fa27-4f09-8da5-a329fc764f9a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:54.317258 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75adbf8-8d0c-42f0-9afb-ef5a53c56820 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:54.329653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1013/2010] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:33:54.333259 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75adbf8-8d0c-42f0-9afb-ef5a53c56820 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:54.340093 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ca4b-b817-490f-afac-a67cffe5fafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:54.340768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ca4b-b817-490f-afac-a67cffe5fafc admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:54.341045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ca4b-b817-490f-afac-a67cffe5fafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:54.342054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ca4b-b817-490f-afac-a67cffe5fafc admin admin] PATH_INFO: `/v3/projects/5961c22b86c049f79ada128981795303/users/66a89103cd2e44e7b34c6c7ba11bfbb0/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:54.360462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7ca4b-b817-490f-afac-a67cffe5fafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5961c22b86c049f79ada128981795303, user_id=66a89103cd2e44e7b34c6c7ba11bfbb0, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:54.363132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7ca4b-b817-490f-afac-a67cffe5fafc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:54.377232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 998/2011] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:33:54 2022] PUT /identity/v3/projects/5961c22b86c049f79ada128981795303/users/66a89103cd2e44e7b34c6c7ba11bfbb0/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:33:54.388354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f7ef-32b1-4236-bcb4-193ee0dfd7f1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:54.388648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f7ef-32b1-4236-bcb4-193ee0dfd7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:54.388900 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f7ef-32b1-4236-bcb4-193ee0dfd7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:54.416044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-db73f7ef-32b1-4236-bcb4-193ee0dfd7f1 None None] MFA Rules not processed for user `66a89103cd2e44e7b34c6c7ba11bfbb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:33:54.417265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-db73f7ef-32b1-4236-bcb4-193ee0dfd7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:54.465350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:33:54.487897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1014/2012] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:33:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:33:54.499943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ca4b-b817-490f-afac-a67cffe5fafc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:33:54.501663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-37f7ca4b-b817-490f-afac-a67cffe5fafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:33:54.584635 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ca4b-b817-490f-afac-a67cffe5fafc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:33:54.589262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a836c-9720-4295-abc0-233caae0d7f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6639f15880c4c718f41cd84cb79c750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:33:54.590363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a836c-9720-4295-abc0-233caae0d7f1 service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:33:54.590656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a836c-9720-4295-abc0-233caae0d7f1 service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:33:54.590919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a836c-9720-4295-abc0-233caae0d7f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:33:54.604459 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a836c-9720-4295-abc0-233caae0d7f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:33:54.608094 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a836c-9720-4295-abc0-233caae0d7f1 service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:33:54.620337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 999/2013] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:33:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:02.646639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73f7ef-32b1-4236-bcb4-193ee0dfd7f1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:02.648173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-db73f7ef-32b1-4236-bcb4-193ee0dfd7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:02.719444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73f7ef-32b1-4236-bcb4-193ee0dfd7f1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:02.725196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:02.726247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:02.726603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:02.726894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] PATH_INFO: `/v3/users/6800c08c5767432e8e1975cf76b89929` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:02.728777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6800c08c5767432e8e1975cf76b89929)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:02.731301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:02.784218 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6800c08c5767432e8e1975cf76b89929'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:02.791171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6800c08c5767432e8e1975cf76b89929'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:02.799254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6800c08c5767432e8e1975cf76b89929'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:02.799876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6800c08c5767432e8e1975cf76b89929'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:02.813644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6800c08c5767432e8e1975cf76b89929'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:02.820078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1015/2014] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:02 2022] DELETE /identity/v3/users/6800c08c5767432e8e1975cf76b89929 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:02.824880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad2a9f-2ee7-4924-b93f-65d8227b2b79 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:02.825529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad2a9f-2ee7-4924-b93f-65d8227b2b79 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:02.825529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad2a9f-2ee7-4924-b93f-65d8227b2b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:02.845304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9dad2a9f-2ee7-4924-b93f-65d8227b2b79 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:02.846596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9dad2a9f-2ee7-4924-b93f-65d8227b2b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:02.851716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:02.914239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1000/2015] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:02.924527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:02.925922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:02.990436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3a7ce-5ab9-4d0e-a1fc-ff91d2ecdee8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:02.994163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5395cdc-b919-4eb5-8a59-8dd0feea62d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:02.994774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5395cdc-b919-4eb5-8a59-8dd0feea62d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:02.995052 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5395cdc-b919-4eb5-8a59-8dd0feea62d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:02.995354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5395cdc-b919-4eb5-8a59-8dd0feea62d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:03.007056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5395cdc-b919-4eb5-8a59-8dd0feea62d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:03.008514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5395cdc-b919-4eb5-8a59-8dd0feea62d6 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:03.018879 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1016/2016] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:03.332598 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad2a9f-2ee7-4924-b93f-65d8227b2b79 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:03.337282 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9dad2a9f-2ee7-4924-b93f-65d8227b2b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:03.350090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad2a9f-2ee7-4924-b93f-65d8227b2b79 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:03.356316 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e859144-12d9-4aa2-81d7-15d1fe29b94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:03.357879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e859144-12d9-4aa2-81d7-15d1fe29b94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:03.358157 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e859144-12d9-4aa2-81d7-15d1fe29b94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:03.358425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e859144-12d9-4aa2-81d7-15d1fe29b94f admin admin] PATH_INFO: `/v3/projects/7c6c7a6a9fcd48e3acc658aff62ca1b4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:03.359728 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e859144-12d9-4aa2-81d7-15d1fe29b94f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6c7a6a9fcd48e3acc658aff62ca1b4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:03.361539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e859144-12d9-4aa2-81d7-15d1fe29b94f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:03.418391 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2e859144-12d9-4aa2-81d7-15d1fe29b94f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6c7a6a9fcd48e3acc658aff62ca1b4', 'request_id': 'req-2e859144-12d9-4aa2-81d7-15d1fe29b94f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:03.423830 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2e859144-12d9-4aa2-81d7-15d1fe29b94f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6c7a6a9fcd48e3acc658aff62ca1b4', 'request_id': 'req-2e859144-12d9-4aa2-81d7-15d1fe29b94f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:03.430584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2e859144-12d9-4aa2-81d7-15d1fe29b94f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6c7a6a9fcd48e3acc658aff62ca1b4', 'request_id': 'req-2e859144-12d9-4aa2-81d7-15d1fe29b94f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:03.445815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2e859144-12d9-4aa2-81d7-15d1fe29b94f admin admin] The token cache is being invalidate because project 7c6c7a6a9fcd48e3acc658aff62ca1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:03.446184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2e859144-12d9-4aa2-81d7-15d1fe29b94f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:03.446957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2e859144-12d9-4aa2-81d7-15d1fe29b94f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:03.448730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1001/2017] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:03 2022] DELETE /identity/v3/projects/7c6c7a6a9fcd48e3acc658aff62ca1b4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:03.455123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c0bcf-3897-4ca2-8921-c9c43f9fec75 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:03.455123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c0bcf-3897-4ca2-8921-c9c43f9fec75 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:03.455123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c0bcf-3897-4ca2-8921-c9c43f9fec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:03.475495 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e37c0bcf-3897-4ca2-8921-c9c43f9fec75 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:03.476532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e37c0bcf-3897-4ca2-8921-c9c43f9fec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:03.481081 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:03.547055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1017/2018] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:03.555750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebb6cd-3b30-40c6-8a3d-16c8fd1ce56d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:03.556034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebb6cd-3b30-40c6-8a3d-16c8fd1ce56d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:03.556306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebb6cd-3b30-40c6-8a3d-16c8fd1ce56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:03.579930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-15ebb6cd-3b30-40c6-8a3d-16c8fd1ce56d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:03.581201 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-15ebb6cd-3b30-40c6-8a3d-16c8fd1ce56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:03.589152 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1002/2019] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:03.593428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c0bcf-3897-4ca2-8921-c9c43f9fec75 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:03.606754 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c0bcf-3897-4ca2-8921-c9c43f9fec75 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:03.611584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1451a-0ede-403a-b023-98267d2b577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:03.612201 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1451a-0ede-403a-b023-98267d2b577f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:03.612479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1451a-0ede-403a-b023-98267d2b577f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:03.612746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1451a-0ede-403a-b023-98267d2b577f admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:03.613396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1451a-0ede-403a-b023-98267d2b577f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:34:03.613696 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1451a-0ede-403a-b023-98267d2b577f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:03.615305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1451a-0ede-403a-b023-98267d2b577f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:03.630917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1018/2020] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:34:03.632170 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebb6cd-3b30-40c6-8a3d-16c8fd1ce56d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:03.642800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebb6cd-3b30-40c6-8a3d-16c8fd1ce56d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:03.648518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e316cc9-41e2-4158-bbd3-7e505dac8183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:03.648691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e316cc9-41e2-4158-bbd3-7e505dac8183 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:03.648964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e316cc9-41e2-4158-bbd3-7e505dac8183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:03.649236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e316cc9-41e2-4158-bbd3-7e505dac8183 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:03.656292 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e316cc9-41e2-4158-bbd3-7e505dac8183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:03.660180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e316cc9-41e2-4158-bbd3-7e505dac8183 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:03.743018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1003/2021] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:34:03 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:03.744402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1451a-0ede-403a-b023-98267d2b577f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:03.755525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1451a-0ede-403a-b023-98267d2b577f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:03.818362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d838-f257-47a6-b366-eee601fd595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:03.819064 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d838-f257-47a6-b366-eee601fd595b admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:03.819418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d838-f257-47a6-b366-eee601fd595b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:03.819694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d838-f257-47a6-b366-eee601fd595b admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:03.820302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20d838-f257-47a6-b366-eee601fd595b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:03.822304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20d838-f257-47a6-b366-eee601fd595b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:03.843496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1019/2022] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:34:03 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:03.847729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e316cc9-41e2-4158-bbd3-7e505dac8183 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:03.858474 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e316cc9-41e2-4158-bbd3-7e505dac8183 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:03.863824 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64af98b-79f7-4fde-ab1f-c30ade66cf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:03.864523 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64af98b-79f7-4fde-ab1f-c30ade66cf9b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:03.864863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64af98b-79f7-4fde-ab1f-c30ade66cf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:03.865199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64af98b-79f7-4fde-ab1f-c30ade66cf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:03.865918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64af98b-79f7-4fde-ab1f-c30ade66cf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:03.867773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64af98b-79f7-4fde-ab1f-c30ade66cf9b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:03.879077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1004/2023] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:34:03.883253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d838-f257-47a6-b366-eee601fd595b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:03.894130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d838-f257-47a6-b366-eee601fd595b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:03.899708 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68077f37-b5a5-4d90-9afe-170daed19120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:03.900357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68077f37-b5a5-4d90-9afe-170daed19120 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:03.900689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68077f37-b5a5-4d90-9afe-170daed19120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:03.901006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68077f37-b5a5-4d90-9afe-170daed19120 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:03.901640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68077f37-b5a5-4d90-9afe-170daed19120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:03.903293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68077f37-b5a5-4d90-9afe-170daed19120 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:03.914400 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1020/2024] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:03.918831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64af98b-79f7-4fde-ab1f-c30ade66cf9b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:03.930418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64af98b-79f7-4fde-ab1f-c30ade66cf9b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:03.936113 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7336e-eb01-4a57-9481-f56e0a57e7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:03.936771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7336e-eb01-4a57-9481-f56e0a57e7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:03.937051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7336e-eb01-4a57-9481-f56e0a57e7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:03.937325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7336e-eb01-4a57-9481-f56e0a57e7cf admin admin] PATH_INFO: `/v3/projects/36349e9ca891406faf92fa0f037be360/users/295ea0f5900f4b8abd4e4a2a66a98000/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:03.963858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7336e-eb01-4a57-9481-f56e0a57e7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=36349e9ca891406faf92fa0f037be360, user_id=295ea0f5900f4b8abd4e4a2a66a98000, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:03.966752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7336e-eb01-4a57-9481-f56e0a57e7cf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:03.981933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1005/2025] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:03 2022] PUT /identity/v3/projects/36349e9ca891406faf92fa0f037be360/users/295ea0f5900f4b8abd4e4a2a66a98000/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:34:03.992727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc60fc3-c0ed-4d15-bb37-4578a93d70ec None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:03.993021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc60fc3-c0ed-4d15-bb37-4578a93d70ec None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:03.993279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc60fc3-c0ed-4d15-bb37-4578a93d70ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:04.022438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0fc60fc3-c0ed-4d15-bb37-4578a93d70ec None None] MFA Rules not processed for user `295ea0f5900f4b8abd4e4a2a66a98000`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:04.023679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0fc60fc3-c0ed-4d15-bb37-4578a93d70ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:04.111967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7336e-eb01-4a57-9481-f56e0a57e7cf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:04.112980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1021/2026] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:04.152971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:04.191206 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7336e-eb01-4a57-9481-f56e0a57e7cf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:04.197928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1525a-8c6b-48c3-8345-dc91c901edfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:04.198571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1525a-8c6b-48c3-8345-dc91c901edfe admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:04.198850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1525a-8c6b-48c3-8345-dc91c901edfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:04.199153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1525a-8c6b-48c3-8345-dc91c901edfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:04.199822 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1525a-8c6b-48c3-8345-dc91c901edfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:04.201749 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1525a-8c6b-48c3-8345-dc91c901edfe admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:04.233580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1006/2027] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:34:04 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:34:04.237420 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc60fc3-c0ed-4d15-bb37-4578a93d70ec None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:04.244096 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:04.249936 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc60fc3-c0ed-4d15-bb37-4578a93d70ec None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:04.309392 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e4d03-2775-443c-918c-b563ea8aaf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:04.310020 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e4d03-2775-443c-918c-b563ea8aaf8f admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:04.310294 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e4d03-2775-443c-918c-b563ea8aaf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:04.310555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e4d03-2775-443c-918c-b563ea8aaf8f admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:04.311208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e4d03-2775-443c-918c-b563ea8aaf8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:04.313102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e4d03-2775-443c-918c-b563ea8aaf8f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:04.333135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1022/2028] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:34:04 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:04.337399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1525a-8c6b-48c3-8345-dc91c901edfe admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:04.349142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1525a-8c6b-48c3-8345-dc91c901edfe admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:04.353923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d77dbc-7c8f-4bc8-9802-af6a0857d57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:04.354533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d77dbc-7c8f-4bc8-9802-af6a0857d57d admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:04.354806 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d77dbc-7c8f-4bc8-9802-af6a0857d57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:04.355254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d77dbc-7c8f-4bc8-9802-af6a0857d57d admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:04.356522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d77dbc-7c8f-4bc8-9802-af6a0857d57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:04.358162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d77dbc-7c8f-4bc8-9802-af6a0857d57d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:04.368682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1007/2029] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:04.372926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e4d03-2775-443c-918c-b563ea8aaf8f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:04.382685 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e4d03-2775-443c-918c-b563ea8aaf8f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:04.387657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b481e-03a4-4592-bffe-6dcc6b1ef702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:04.388197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b481e-03a4-4592-bffe-6dcc6b1ef702 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:04.388742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b481e-03a4-4592-bffe-6dcc6b1ef702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:04.389061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b481e-03a4-4592-bffe-6dcc6b1ef702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:04.389716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b481e-03a4-4592-bffe-6dcc6b1ef702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:04.391347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b481e-03a4-4592-bffe-6dcc6b1ef702 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:04.401462 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1023/2030] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:04.406214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d77dbc-7c8f-4bc8-9802-af6a0857d57d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:04.416280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d77dbc-7c8f-4bc8-9802-af6a0857d57d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:04.421488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efbf87-171c-4e59-a9f6-b6088265d864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:04.422130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efbf87-171c-4e59-a9f6-b6088265d864 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:04.422409 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efbf87-171c-4e59-a9f6-b6088265d864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:04.422682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efbf87-171c-4e59-a9f6-b6088265d864 admin admin] PATH_INFO: `/v3/projects/42563a70374d4278ae11a0d41a9c1451/users/2b48b6d4deda4bc89c149cee5bd4e130/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:04.436727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efbf87-171c-4e59-a9f6-b6088265d864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42563a70374d4278ae11a0d41a9c1451, user_id=2b48b6d4deda4bc89c149cee5bd4e130, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:04.439473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efbf87-171c-4e59-a9f6-b6088265d864 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:04.453101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1008/2031] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:04 2022] PUT /identity/v3/projects/42563a70374d4278ae11a0d41a9c1451/users/2b48b6d4deda4bc89c149cee5bd4e130/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:04.463325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b13c7-df41-4707-bb4a-eb3b2459220b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:04.463617 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b13c7-df41-4707-bb4a-eb3b2459220b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:04.463894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b13c7-df41-4707-bb4a-eb3b2459220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:04.491671 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ad8b13c7-df41-4707-bb4a-eb3b2459220b None None] MFA Rules not processed for user `2b48b6d4deda4bc89c149cee5bd4e130`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:04.492912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ad8b13c7-df41-4707-bb4a-eb3b2459220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:04.561332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1024/2032] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:04.565814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efbf87-171c-4e59-a9f6-b6088265d864 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:04.629566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efbf87-171c-4e59-a9f6-b6088265d864 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:04.634290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf5202-a2f2-4782-81e1-01b802e9b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:04.634893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5202-a2f2-4782-81e1-01b802e9b2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:04.635191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5202-a2f2-4782-81e1-01b802e9b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:04.635460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5202-a2f2-4782-81e1-01b802e9b2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:04.636083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf5202-a2f2-4782-81e1-01b802e9b2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:04.638098 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf5202-a2f2-4782-81e1-01b802e9b2c8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:04.672536 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1009/2033] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:34:04 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:04.683002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b13c7-df41-4707-bb4a-eb3b2459220b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:04.700407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b13c7-df41-4707-bb4a-eb3b2459220b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:04.787805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2820b-be93-44c8-85bc-9537efcf9017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:04.788412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2820b-be93-44c8-85bc-9537efcf9017 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:04.788686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2820b-be93-44c8-85bc-9537efcf9017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:04.788954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2820b-be93-44c8-85bc-9537efcf9017 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:04.790046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2820b-be93-44c8-85bc-9537efcf9017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:04.791695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2820b-be93-44c8-85bc-9537efcf9017 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:04.827804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1025/2034] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:34:04 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:04.832888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf5202-a2f2-4782-81e1-01b802e9b2c8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:04.844131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf5202-a2f2-4782-81e1-01b802e9b2c8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:04.849148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7bb06-d8f8-44e7-a98f-8d8af120aa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:04.849831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7bb06-d8f8-44e7-a98f-8d8af120aa4f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:04.850171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7bb06-d8f8-44e7-a98f-8d8af120aa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:04.850531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7bb06-d8f8-44e7-a98f-8d8af120aa4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:04.851307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7bb06-d8f8-44e7-a98f-8d8af120aa4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:04.852955 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7bb06-d8f8-44e7-a98f-8d8af120aa4f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:04.863668 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1010/2035] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:04.867922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2820b-be93-44c8-85bc-9537efcf9017 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:04.873116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:04.879772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2820b-be93-44c8-85bc-9537efcf9017 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:04.887367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fbe9b-fb43-4944-b439-27127a5c8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:04.888082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fbe9b-fb43-4944-b439-27127a5c8f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:04.888745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fbe9b-fb43-4944-b439-27127a5c8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:04.889445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fbe9b-fb43-4944-b439-27127a5c8f32 admin admin] PATH_INFO: `/v3/projects/60f9dbd240d5470b893bb39e44f1d485/users/4a03132aeb184f5ab37f073652fa011a/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:04.908757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fbe9b-fb43-4944-b439-27127a5c8f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f9dbd240d5470b893bb39e44f1d485, user_id=4a03132aeb184f5ab37f073652fa011a, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:04.911254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fbe9b-fb43-4944-b439-27127a5c8f32 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:04.936927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1026/2036] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:04 2022] PUT /identity/v3/projects/60f9dbd240d5470b893bb39e44f1d485/users/4a03132aeb184f5ab37f073652fa011a/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:04.941105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7bb06-d8f8-44e7-a98f-8d8af120aa4f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:04.952890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7bb06-d8f8-44e7-a98f-8d8af120aa4f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:05.018552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:05.028075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982738c-80db-4eff-8b38-c156247570e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:05.028777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982738c-80db-4eff-8b38-c156247570e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:05.029147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982738c-80db-4eff-8b38-c156247570e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:05.029485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982738c-80db-4eff-8b38-c156247570e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:05.030195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982738c-80db-4eff-8b38-c156247570e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:05.032076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982738c-80db-4eff-8b38-c156247570e9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:05.047156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1011/2037] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:34:05.049567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fbe9b-fb43-4944-b439-27127a5c8f32 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:05.061955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fbe9b-fb43-4944-b439-27127a5c8f32 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:05.066815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b18be-70a6-4472-a501-633c284b97a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:05.067544 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b18be-70a6-4472-a501-633c284b97a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:05.067818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b18be-70a6-4472-a501-633c284b97a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:05.068091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b18be-70a6-4472-a501-633c284b97a7 admin admin] PATH_INFO: `/v3/projects/60f9dbd240d5470b893bb39e44f1d485/users/4a03132aeb184f5ab37f073652fa011a/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:05.070062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b18be-70a6-4472-a501-633c284b97a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f9dbd240d5470b893bb39e44f1d485, user_id=4a03132aeb184f5ab37f073652fa011a, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:05.072724 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b18be-70a6-4472-a501-633c284b97a7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:05.084528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1027/2038] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:05 2022] PUT /identity/v3/projects/60f9dbd240d5470b893bb39e44f1d485/users/4a03132aeb184f5ab37f073652fa011a/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:05.096131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9160c-0270-42af-acd8-6291b3cd1401 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:05.096414 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9160c-0270-42af-acd8-6291b3cd1401 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:05.096683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9160c-0270-42af-acd8-6291b3cd1401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:05.131050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a2f9160c-0270-42af-acd8-6291b3cd1401 None None] MFA Rules not processed for user `4a03132aeb184f5ab37f073652fa011a`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:05.132732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a2f9160c-0270-42af-acd8-6291b3cd1401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:05.208136 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1012/2039] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:05.219761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b18be-70a6-4472-a501-633c284b97a7 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:05.221423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-909b18be-70a6-4472-a501-633c284b97a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:05.278356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b18be-70a6-4472-a501-633c284b97a7 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:05.282006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977253a-4372-4812-ad02-f85bbccfb56f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:05.282598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977253a-4372-4812-ad02-f85bbccfb56f service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:05.282870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977253a-4372-4812-ad02-f85bbccfb56f service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:05.283170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977253a-4372-4812-ad02-f85bbccfb56f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:05.342816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977253a-4372-4812-ad02-f85bbccfb56f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:05.344286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977253a-4372-4812-ad02-f85bbccfb56f service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:05.354005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1028/2040] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:07.039224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9160c-0270-42af-acd8-6291b3cd1401 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:07.041270 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a2f9160c-0270-42af-acd8-6291b3cd1401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:07.055280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9160c-0270-42af-acd8-6291b3cd1401 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:07.059859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8fba9-f807-4568-bb9f-d0dba11fa583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:07.060736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8fba9-f807-4568-bb9f-d0dba11fa583 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:07.061085 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8fba9-f807-4568-bb9f-d0dba11fa583 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:07.061360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8fba9-f807-4568-bb9f-d0dba11fa583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:07.161263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8fba9-f807-4568-bb9f-d0dba11fa583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:07.165148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8fba9-f807-4568-bb9f-d0dba11fa583 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:07.177108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1013/2041] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:07.891334 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977253a-4372-4812-ad02-f85bbccfb56f service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:07.900412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977253a-4372-4812-ad02-f85bbccfb56f service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:07.904956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899eb8a-2d29-471a-bbfa-a2faf7b6ddda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:07.905666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899eb8a-2d29-471a-bbfa-a2faf7b6ddda service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:07.906039 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899eb8a-2d29-471a-bbfa-a2faf7b6ddda service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:07.906581 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899eb8a-2d29-471a-bbfa-a2faf7b6ddda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:07.937023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899eb8a-2d29-471a-bbfa-a2faf7b6ddda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:07.938974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899eb8a-2d29-471a-bbfa-a2faf7b6ddda service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:07.963380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1029/2042] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:11.962868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8fba9-f807-4568-bb9f-d0dba11fa583 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:11.963767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-44e8fba9-f807-4568-bb9f-d0dba11fa583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:11.981041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899eb8a-2d29-471a-bbfa-a2faf7b6ddda service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:12.083269 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899eb8a-2d29-471a-bbfa-a2faf7b6ddda service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:12.087815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7cc18-f1cf-405e-945d-3780cbebfb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:12.088435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7cc18-f1cf-405e-945d-3780cbebfb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.088710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7cc18-f1cf-405e-945d-3780cbebfb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.088976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7cc18-f1cf-405e-945d-3780cbebfb9b admin admin] PATH_INFO: `/v3/users/295ea0f5900f4b8abd4e4a2a66a98000` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.090214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7cc18-f1cf-405e-945d-3780cbebfb9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=295ea0f5900f4b8abd4e4a2a66a98000)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:12.092186 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7cc18-f1cf-405e-945d-3780cbebfb9b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:12.095400 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8fba9-f807-4568-bb9f-d0dba11fa583 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:12.100291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:12.100930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.101209 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.101482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] PATH_INFO: `/v3/users/e2dabc4754c54de1ac66ba4c19b63919` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.102699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2dabc4754c54de1ac66ba4c19b63919)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:12.103518 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:12.104676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:12.124848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:12.169343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f4e7cc18-f1cf-405e-945d-3780cbebfb9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295ea0f5900f4b8abd4e4a2a66a98000'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.179492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f4e7cc18-f1cf-405e-945d-3780cbebfb9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295ea0f5900f4b8abd4e4a2a66a98000'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.184072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2dabc4754c54de1ac66ba4c19b63919'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.190444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f4e7cc18-f1cf-405e-945d-3780cbebfb9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295ea0f5900f4b8abd4e4a2a66a98000'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.191385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f4e7cc18-f1cf-405e-945d-3780cbebfb9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295ea0f5900f4b8abd4e4a2a66a98000'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.192399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2dabc4754c54de1ac66ba4c19b63919'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.193366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2dabc4754c54de1ac66ba4c19b63919'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.193793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2dabc4754c54de1ac66ba4c19b63919'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.209514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f4e7cc18-f1cf-405e-945d-3780cbebfb9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295ea0f5900f4b8abd4e4a2a66a98000'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.210280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2dabc4754c54de1ac66ba4c19b63919'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.218725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1030/2043] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:11 2022] DELETE /identity/v3/users/295ea0f5900f4b8abd4e4a2a66a98000 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:34:12.220000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d553c67-7d1e-439e-84d1-d9a6d1945b7f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.220283 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d553c67-7d1e-439e-84d1-d9a6d1945b7f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.220560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d553c67-7d1e-439e-84d1-d9a6d1945b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.226345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1014/2044] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:11 2022] DELETE /identity/v3/users/e2dabc4754c54de1ac66ba4c19b63919 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:12.239798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2d553c67-7d1e-439e-84d1-d9a6d1945b7f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:12.240985 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2d553c67-7d1e-439e-84d1-d9a6d1945b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:12.301970 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1031/2045] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:12.312236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:12.314015 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:12.370587 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419ef12-233d-4f0a-8b3a-39a26629c8d6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:12.374851 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78e4a4-ef4e-46c3-888b-c7fb9b7ff003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:12.375500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78e4a4-ef4e-46c3-888b-c7fb9b7ff003 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.375779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78e4a4-ef4e-46c3-888b-c7fb9b7ff003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.376050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78e4a4-ef4e-46c3-888b-c7fb9b7ff003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.385649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78e4a4-ef4e-46c3-888b-c7fb9b7ff003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:12.387132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78e4a4-ef4e-46c3-888b-c7fb9b7ff003 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:12.399632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1015/2046] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:12.401092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d553c67-7d1e-439e-84d1-d9a6d1945b7f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:12.402642 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2d553c67-7d1e-439e-84d1-d9a6d1945b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:12.425465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d553c67-7d1e-439e-84d1-d9a6d1945b7f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:12.431446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f23593-8b24-4417-81f8-b732ee04bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:12.432048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f23593-8b24-4417-81f8-b732ee04bb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.432327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f23593-8b24-4417-81f8-b732ee04bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.432594 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f23593-8b24-4417-81f8-b732ee04bb83 admin admin] PATH_INFO: `/v3/projects/611a6c918a44414db285b1a4f478ccb7` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.434415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f23593-8b24-4417-81f8-b732ee04bb83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=611a6c918a44414db285b1a4f478ccb7)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:12.436853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f23593-8b24-4417-81f8-b732ee04bb83 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:12.485881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c0f23593-8b24-4417-81f8-b732ee04bb83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611a6c918a44414db285b1a4f478ccb7', 'request_id': 'req-c0f23593-8b24-4417-81f8-b732ee04bb83'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.491308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c0f23593-8b24-4417-81f8-b732ee04bb83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611a6c918a44414db285b1a4f478ccb7', 'request_id': 'req-c0f23593-8b24-4417-81f8-b732ee04bb83'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.498174 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c0f23593-8b24-4417-81f8-b732ee04bb83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611a6c918a44414db285b1a4f478ccb7', 'request_id': 'req-c0f23593-8b24-4417-81f8-b732ee04bb83'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.510548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c0f23593-8b24-4417-81f8-b732ee04bb83 admin admin] The token cache is being invalidate because project 611a6c918a44414db285b1a4f478ccb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:12.510840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c0f23593-8b24-4417-81f8-b732ee04bb83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.511551 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c0f23593-8b24-4417-81f8-b732ee04bb83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.516607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1032/2047] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:12 2022] DELETE /identity/v3/projects/611a6c918a44414db285b1a4f478ccb7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:12.518370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec5a75-82f2-4156-924d-8d2156b98724 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.518745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec5a75-82f2-4156-924d-8d2156b98724 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.519111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec5a75-82f2-4156-924d-8d2156b98724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.538268 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-63ec5a75-82f2-4156-924d-8d2156b98724 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:12.539483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-63ec5a75-82f2-4156-924d-8d2156b98724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:12.606920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1016/2048] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:12.616355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d30aa2-586c-4eab-a79a-be2b04a2075f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.616775 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d30aa2-586c-4eab-a79a-be2b04a2075f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.617126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d30aa2-586c-4eab-a79a-be2b04a2075f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.645162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-05d30aa2-586c-4eab-a79a-be2b04a2075f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:12.646494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-05d30aa2-586c-4eab-a79a-be2b04a2075f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:12.655048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1033/2049] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:12.659406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec5a75-82f2-4156-924d-8d2156b98724 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:12.669767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec5a75-82f2-4156-924d-8d2156b98724 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:12.674631 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e718d2-eb6b-4c38-aa74-412662d01c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:12.675274 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e718d2-eb6b-4c38-aa74-412662d01c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.675555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e718d2-eb6b-4c38-aa74-412662d01c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.675832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e718d2-eb6b-4c38-aa74-412662d01c70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.676483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e718d2-eb6b-4c38-aa74-412662d01c70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:34:12.676790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e718d2-eb6b-4c38-aa74-412662d01c70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:12.678384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e718d2-eb6b-4c38-aa74-412662d01c70 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:12.682420 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d30aa2-586c-4eab-a79a-be2b04a2075f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:12.683932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-05d30aa2-586c-4eab-a79a-be2b04a2075f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:12.691771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:12.696608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1017/2050] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:34:12.700090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d30aa2-586c-4eab-a79a-be2b04a2075f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:12.701677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e718d2-eb6b-4c38-aa74-412662d01c70 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:12.710327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:12.711118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.711493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.711800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] PATH_INFO: `/v3/projects/36349e9ca891406faf92fa0f037be360` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.713166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36349e9ca891406faf92fa0f037be360)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:12.714320 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e718d2-eb6b-4c38-aa74-412662d01c70 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:12.716234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:12.720203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280944-ed21-4ec2-bbbf-bac477717642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:12.720807 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280944-ed21-4ec2-bbbf-bac477717642 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.721086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280944-ed21-4ec2-bbbf-bac477717642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.721362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280944-ed21-4ec2-bbbf-bac477717642 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.721991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68280944-ed21-4ec2-bbbf-bac477717642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:12.724055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68280944-ed21-4ec2-bbbf-bac477717642 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:12.752842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1018/2051] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:34:12 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:12.758794 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280944-ed21-4ec2-bbbf-bac477717642 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:12.765117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:12.772152 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36349e9ca891406faf92fa0f037be360', 'request_id': 'req-8ed27616-89ff-490c-a7f1-28070d0bc331'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.781487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36349e9ca891406faf92fa0f037be360', 'request_id': 'req-8ed27616-89ff-490c-a7f1-28070d0bc331'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.788049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36349e9ca891406faf92fa0f037be360', 'request_id': 'req-8ed27616-89ff-490c-a7f1-28070d0bc331'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.801554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] The token cache is being invalidate because project 36349e9ca891406faf92fa0f037be360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:12.801854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.802503 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.804036 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1034/2052] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:12 2022] DELETE /identity/v3/projects/36349e9ca891406faf92fa0f037be360 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:34:12.807880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:12.809362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:12.840530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280944-ed21-4ec2-bbbf-bac477717642 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:12.872769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed27616-89ff-490c-a7f1-28070d0bc331 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:12.877576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:12.878227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.878578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.878929 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] PATH_INFO: `/v3/users/2b48b6d4deda4bc89c149cee5bd4e130` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.880082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b48b6d4deda4bc89c149cee5bd4e130)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:12.882026 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:12.897416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb14788-a3e7-4692-bf38-3d34391bf748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:12.898015 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb14788-a3e7-4692-bf38-3d34391bf748 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.898286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb14788-a3e7-4692-bf38-3d34391bf748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.898551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb14788-a3e7-4692-bf38-3d34391bf748 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.899218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb14788-a3e7-4692-bf38-3d34391bf748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:12.901312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb14788-a3e7-4692-bf38-3d34391bf748 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:12.928578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1019/2053] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:34:12 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:34:12.929908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb14788-a3e7-4692-bf38-3d34391bf748 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:12.931559 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4fb14788-a3e7-4692-bf38-3d34391bf748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:12.932860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b48b6d4deda4bc89c149cee5bd4e130'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.940096 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b48b6d4deda4bc89c149cee5bd4e130'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.943207 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb14788-a3e7-4692-bf38-3d34391bf748 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:12.947582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b48b6d4deda4bc89c149cee5bd4e130'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.948289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b48b6d4deda4bc89c149cee5bd4e130'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.948886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032b9b1-eb30-44ca-bdb1-3ec0b5840f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:12.949987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032b9b1-eb30-44ca-bdb1-3ec0b5840f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:12.950263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032b9b1-eb30-44ca-bdb1-3ec0b5840f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:12.950534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032b9b1-eb30-44ca-bdb1-3ec0b5840f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:12.951247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032b9b1-eb30-44ca-bdb1-3ec0b5840f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:12.952829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032b9b1-eb30-44ca-bdb1-3ec0b5840f34 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:12.960601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b48b6d4deda4bc89c149cee5bd4e130'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:12.962975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1020/2054] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:34:12.967039 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1035/2055] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:12 2022] DELETE /identity/v3/users/2b48b6d4deda4bc89c149cee5bd4e130 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:12.967604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032b9b1-eb30-44ca-bdb1-3ec0b5840f34 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:12.969232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1032b9b1-eb30-44ca-bdb1-3ec0b5840f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:12.981928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032b9b1-eb30-44ca-bdb1-3ec0b5840f34 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:13.057113 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a837bf0-8c23-452d-92af-b477e9b7c4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:13.057726 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a837bf0-8c23-452d-92af-b477e9b7c4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:13.058005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a837bf0-8c23-452d-92af-b477e9b7c4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:13.058280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a837bf0-8c23-452d-92af-b477e9b7c4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:13.058927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a837bf0-8c23-452d-92af-b477e9b7c4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:13.060548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a837bf0-8c23-452d-92af-b477e9b7c4d5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:13.071722 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1021/2056] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:34:13.076333 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:13.082828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:13.087373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc45c50-96ff-4d68-a9d4-391f316511cc admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:13.094326 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6133b-8540-449a-b67e-92cbc3cc2290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:13.095188 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6133b-8540-449a-b67e-92cbc3cc2290 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:13.095793 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6133b-8540-449a-b67e-92cbc3cc2290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:13.095969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6133b-8540-449a-b67e-92cbc3cc2290 admin admin] PATH_INFO: `/v3/projects/e73ae21299844104a0451e75ee71effd/users/41796a7b7d864c8d89743f3d96be7b70/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:13.112129 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6133b-8540-449a-b67e-92cbc3cc2290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73ae21299844104a0451e75ee71effd, user_id=41796a7b7d864c8d89743f3d96be7b70, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:13.115700 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6133b-8540-449a-b67e-92cbc3cc2290 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:13.132466 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1036/2057] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:13 2022] PUT /identity/v3/projects/e73ae21299844104a0451e75ee71effd/users/41796a7b7d864c8d89743f3d96be7b70/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:13.143921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2d56a-f89d-4426-890c-47eec2b7358c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:13.144203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2d56a-f89d-4426-890c-47eec2b7358c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:13.144474 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2d56a-f89d-4426-890c-47eec2b7358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:13.174794 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8ec2d56a-f89d-4426-890c-47eec2b7358c None None] MFA Rules not processed for user `41796a7b7d864c8d89743f3d96be7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:13.176070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8ec2d56a-f89d-4426-890c-47eec2b7358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:13.188170 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:13.260201 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1022/2058] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:13.261037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6133b-8540-449a-b67e-92cbc3cc2290 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:13.290773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2d56a-f89d-4426-890c-47eec2b7358c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:13.292561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8ec2d56a-f89d-4426-890c-47eec2b7358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:13.365731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6133b-8540-449a-b67e-92cbc3cc2290 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:13.370421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee261698-6360-4345-a00d-0cd2524748a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:13.371060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee261698-6360-4345-a00d-0cd2524748a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:13.371912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee261698-6360-4345-a00d-0cd2524748a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:13.372185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee261698-6360-4345-a00d-0cd2524748a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:13.372967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee261698-6360-4345-a00d-0cd2524748a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:13.374750 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee261698-6360-4345-a00d-0cd2524748a1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:13.376982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2d56a-f89d-4426-890c-47eec2b7358c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:13.381719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:13.382404 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:13.382628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:13.382899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] PATH_INFO: `/v3/projects/42563a70374d4278ae11a0d41a9c1451` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:13.384107 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42563a70374d4278ae11a0d41a9c1451)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:13.385995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:13.406460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1037/2059] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:34:13 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:34:13.407330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee261698-6360-4345-a00d-0cd2524748a1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:13.435251 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42563a70374d4278ae11a0d41a9c1451', 'request_id': 'req-37a5ee5c-86b4-42eb-9285-00b6f82fc392'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:13.441082 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42563a70374d4278ae11a0d41a9c1451', 'request_id': 'req-37a5ee5c-86b4-42eb-9285-00b6f82fc392'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:13.448346 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42563a70374d4278ae11a0d41a9c1451', 'request_id': 'req-37a5ee5c-86b4-42eb-9285-00b6f82fc392'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:13.463252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] The token cache is being invalidate because project 42563a70374d4278ae11a0d41a9c1451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:13.463545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:13.464179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:13.465779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1023/2060] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:13 2022] DELETE /identity/v3/projects/42563a70374d4278ae11a0d41a9c1451 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:13.469683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:13.471003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:13.473717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee261698-6360-4345-a00d-0cd2524748a1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:13.518406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:13.530247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f808b-930d-4d9c-9d57-0c500c227c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:13.530834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f808b-930d-4d9c-9d57-0c500c227c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:13.531126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f808b-930d-4d9c-9d57-0c500c227c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:13.531395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f808b-930d-4d9c-9d57-0c500c227c02 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:13.531999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f808b-930d-4d9c-9d57-0c500c227c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:13.533881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f808b-930d-4d9c-9d57-0c500c227c02 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:13.538496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5ee5c-86b4-42eb-9285-00b6f82fc392 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:13.543349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:13.543972 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:13.544246 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:13.544513 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] PATH_INFO: `/v3/users/4a03132aeb184f5ab37f073652fa011a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:13.545651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a03132aeb184f5ab37f073652fa011a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:13.547584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:13.555073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1038/2061] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:34:13 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:13.560093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f808b-930d-4d9c-9d57-0c500c227c02 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:13.561817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f57f808b-930d-4d9c-9d57-0c500c227c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:13.569414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:13.575370 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f808b-930d-4d9c-9d57-0c500c227c02 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:13.581287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ca69-9053-4dcf-ba5f-80656cf96fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:13.581891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ca69-9053-4dcf-ba5f-80656cf96fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:13.582397 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ca69-9053-4dcf-ba5f-80656cf96fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:13.582720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ca69-9053-4dcf-ba5f-80656cf96fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:13.583464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32ca69-9053-4dcf-ba5f-80656cf96fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:13.585044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32ca69-9053-4dcf-ba5f-80656cf96fbc admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:13.594934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1039/2062] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:13.599217 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ca69-9053-4dcf-ba5f-80656cf96fbc admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:13.599977 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a03132aeb184f5ab37f073652fa011a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:13.608128 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a03132aeb184f5ab37f073652fa011a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:13.608817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a03132aeb184f5ab37f073652fa011a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:13.609345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ca69-9053-4dcf-ba5f-80656cf96fbc admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:13.609751 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a03132aeb184f5ab37f073652fa011a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:13.614178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15206a3-91fb-4b76-a2d2-2288e8c8ac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:13.614824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15206a3-91fb-4b76-a2d2-2288e8c8ac38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:13.615115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15206a3-91fb-4b76-a2d2-2288e8c8ac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:13.615390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15206a3-91fb-4b76-a2d2-2288e8c8ac38 admin admin] PATH_INFO: `/v3/projects/1ff3e2f78b77419d95f9a71a069ec8f4/users/ba17c0316d61427fb4b273d8fdb2e2b4/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:13.622770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a03132aeb184f5ab37f073652fa011a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:13.630178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15206a3-91fb-4b76-a2d2-2288e8c8ac38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff3e2f78b77419d95f9a71a069ec8f4, user_id=ba17c0316d61427fb4b273d8fdb2e2b4, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:13.632823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15206a3-91fb-4b76-a2d2-2288e8c8ac38 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:13.635043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1024/2063] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:13 2022] DELETE /identity/v3/users/4a03132aeb184f5ab37f073652fa011a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:34:13.646729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1040/2064] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:13 2022] PUT /identity/v3/projects/1ff3e2f78b77419d95f9a71a069ec8f4/users/ba17c0316d61427fb4b273d8fdb2e2b4/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:34:13.650688 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:13.652271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:13.724500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21237420-34f2-4a89-9549-98c3b29cb539 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:13.791662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028eb2ea-220f-44cc-be02-dd44c0e43912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:13.792294 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eb2ea-220f-44cc-be02-dd44c0e43912 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:13.792585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eb2ea-220f-44cc-be02-dd44c0e43912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:13.792868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eb2ea-220f-44cc-be02-dd44c0e43912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:13.794027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028eb2ea-220f-44cc-be02-dd44c0e43912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:13.795772 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028eb2ea-220f-44cc-be02-dd44c0e43912 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:13.810439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1025/2065] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:13.811624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15206a3-91fb-4b76-a2d2-2288e8c8ac38 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:13.823190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15206a3-91fb-4b76-a2d2-2288e8c8ac38 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:13.828478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8c7bc-e6e8-4fbd-8f0e-10984260be2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:13.829285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8c7bc-e6e8-4fbd-8f0e-10984260be2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:13.829544 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8c7bc-e6e8-4fbd-8f0e-10984260be2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:13.829813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8c7bc-e6e8-4fbd-8f0e-10984260be2b admin admin] PATH_INFO: `/v3/projects/1ff3e2f78b77419d95f9a71a069ec8f4/users/ba17c0316d61427fb4b273d8fdb2e2b4/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:13.831742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8c7bc-e6e8-4fbd-8f0e-10984260be2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff3e2f78b77419d95f9a71a069ec8f4, user_id=ba17c0316d61427fb4b273d8fdb2e2b4, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:13.834341 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8c7bc-e6e8-4fbd-8f0e-10984260be2b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:13.845305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1041/2066] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:13 2022] PUT /identity/v3/projects/1ff3e2f78b77419d95f9a71a069ec8f4/users/ba17c0316d61427fb4b273d8fdb2e2b4/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:13.856277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa7c5-8926-4a1f-9ead-82574a1964c6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:13.856538 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa7c5-8926-4a1f-9ead-82574a1964c6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:13.856802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa7c5-8926-4a1f-9ead-82574a1964c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:13.870484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:13.886630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ff4aa7c5-8926-4a1f-9ead-82574a1964c6 None None] MFA Rules not processed for user `ba17c0316d61427fb4b273d8fdb2e2b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:13.887834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ff4aa7c5-8926-4a1f-9ead-82574a1964c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:13.925997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8c7bc-e6e8-4fbd-8f0e-10984260be2b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:13.928068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-68a8c7bc-e6e8-4fbd-8f0e-10984260be2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:13.966183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1026/2067] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:13.978800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aa7c5-8926-4a1f-9ead-82574a1964c6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:13.980221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ff4aa7c5-8926-4a1f-9ead-82574a1964c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:14.005548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8c7bc-e6e8-4fbd-8f0e-10984260be2b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:14.010619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:14.011369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.011648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.012020 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] PATH_INFO: `/v3/projects/60f9dbd240d5470b893bb39e44f1d485` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.013668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f9dbd240d5470b893bb39e44f1d485)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:14.015876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:14.039285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aa7c5-8926-4a1f-9ead-82574a1964c6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:14.044054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad814c00-3ca5-4cfb-a999-218b320ecb50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:14.044934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad814c00-3ca5-4cfb-a999-218b320ecb50 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.045212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad814c00-3ca5-4cfb-a999-218b320ecb50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.045603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad814c00-3ca5-4cfb-a999-218b320ecb50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.055271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad814c00-3ca5-4cfb-a999-218b320ecb50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:14.056696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad814c00-3ca5-4cfb-a999-218b320ecb50 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:14.065149 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f9dbd240d5470b893bb39e44f1d485', 'request_id': 'req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:14.067299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1027/2068] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:34:14.070754 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f9dbd240d5470b893bb39e44f1d485', 'request_id': 'req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:14.077260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f9dbd240d5470b893bb39e44f1d485', 'request_id': 'req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:14.091573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] The token cache is being invalidate because project 60f9dbd240d5470b893bb39e44f1d485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:14.091858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:14.092513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:14.093991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1042/2069] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:13 2022] DELETE /identity/v3/projects/60f9dbd240d5470b893bb39e44f1d485 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:34:14.098962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739e59a-15e2-4c04-ad7e-fa131c3b7d54 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.099415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739e59a-15e2-4c04-ad7e-fa131c3b7d54 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.099601 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739e59a-15e2-4c04-ad7e-fa131c3b7d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.124639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0739e59a-15e2-4c04-ad7e-fa131c3b7d54 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:14.126058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0739e59a-15e2-4c04-ad7e-fa131c3b7d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:14.144877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:14.146288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:14.192900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1028/2070] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:34:14.198492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:14.200422 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a603912-8348-4607-bf93-0c8743da1108 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.200701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a603912-8348-4607-bf93-0c8743da1108 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.201078 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a603912-8348-4607-bf93-0c8743da1108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.212469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5f0b-8c05-4a05-b3d2-06c9d4a50003 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:14.216991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2da62d-1767-488e-8d5e-e900a4ce5960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:14.217572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2da62d-1767-488e-8d5e-e900a4ce5960 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.217847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2da62d-1767-488e-8d5e-e900a4ce5960 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.218132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2da62d-1767-488e-8d5e-e900a4ce5960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.219823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2c2da62d-1767-488e-8d5e-e900a4ce5960 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:14.220581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7a603912-8348-4607-bf93-0c8743da1108 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:14.221741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7a603912-8348-4607-bf93-0c8743da1108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:14.229815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1029/2071] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:34:14.234872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a603912-8348-4607-bf93-0c8743da1108 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:14.244785 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a603912-8348-4607-bf93-0c8743da1108 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:14.250310 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e70ef-f996-402e-a03f-30ff9a425fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:14.250962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e70ef-f996-402e-a03f-30ff9a425fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.251334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e70ef-f996-402e-a03f-30ff9a425fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.251669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e70ef-f996-402e-a03f-30ff9a425fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.252401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e70ef-f996-402e-a03f-30ff9a425fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:34:14.252769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e70ef-f996-402e-a03f-30ff9a425fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:14.254471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e70ef-f996-402e-a03f-30ff9a425fbf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:14.266337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1030/2072] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:34:14.270698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e70ef-f996-402e-a03f-30ff9a425fbf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:14.280186 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2da62d-1767-488e-8d5e-e900a4ce5960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:14.280894 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e70ef-f996-402e-a03f-30ff9a425fbf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:14.281599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2da62d-1767-488e-8d5e-e900a4ce5960 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:14.285483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb6988-65bb-4013-bc88-6979ee55d251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:14.286044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb6988-65bb-4013-bc88-6979ee55d251 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.286314 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb6988-65bb-4013-bc88-6979ee55d251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.286582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb6988-65bb-4013-bc88-6979ee55d251 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.287216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb6988-65bb-4013-bc88-6979ee55d251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:14.289054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb6988-65bb-4013-bc88-6979ee55d251 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:14.290523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1043/2073] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:34:14.305172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:14.320061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1031/2074] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:34:14 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:14.324224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2da62d-1767-488e-8d5e-e900a4ce5960 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:14.334832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2da62d-1767-488e-8d5e-e900a4ce5960 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:14.405117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf5976-e8f6-45c9-8ac5-adae893dc727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:14.406153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf5976-e8f6-45c9-8ac5-adae893dc727 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.406772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf5976-e8f6-45c9-8ac5-adae893dc727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.407444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf5976-e8f6-45c9-8ac5-adae893dc727 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.408324 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf5976-e8f6-45c9-8ac5-adae893dc727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:14.410419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf5976-e8f6-45c9-8ac5-adae893dc727 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:14.438233 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1044/2075] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:34:14 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:14.442528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb6988-65bb-4013-bc88-6979ee55d251 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:14.456928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb6988-65bb-4013-bc88-6979ee55d251 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:14.458783 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ef2d8-4824-4bf2-ae8a-309ff4aa5aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:14.459434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef2d8-4824-4bf2-ae8a-309ff4aa5aaf admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.459718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef2d8-4824-4bf2-ae8a-309ff4aa5aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.459990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef2d8-4824-4bf2-ae8a-309ff4aa5aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.460647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ef2d8-4824-4bf2-ae8a-309ff4aa5aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:14.462237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ef2d8-4824-4bf2-ae8a-309ff4aa5aaf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:14.473236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1032/2076] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:14.477198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf5976-e8f6-45c9-8ac5-adae893dc727 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:14.488162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf5976-e8f6-45c9-8ac5-adae893dc727 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:14.493056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd33a8-f06c-4e5c-b35d-744d32cfd09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:14.493652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd33a8-f06c-4e5c-b35d-744d32cfd09b admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.493928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd33a8-f06c-4e5c-b35d-744d32cfd09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.494199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd33a8-f06c-4e5c-b35d-744d32cfd09b admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.494839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd33a8-f06c-4e5c-b35d-744d32cfd09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:14.496567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd33a8-f06c-4e5c-b35d-744d32cfd09b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:14.511126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1045/2077] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:14.512900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ef2d8-4824-4bf2-ae8a-309ff4aa5aaf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:14.524165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ef2d8-4824-4bf2-ae8a-309ff4aa5aaf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:14.529289 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a25e60-f3e9-454b-a603-cc72662e22a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:14.530056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a25e60-f3e9-454b-a603-cc72662e22a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.530408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a25e60-f3e9-454b-a603-cc72662e22a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.530883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a25e60-f3e9-454b-a603-cc72662e22a9 admin admin] PATH_INFO: `/v3/projects/f40bd8bcdd2545629d4ffb502d59612c/users/ca40884ebd374bcfa5732cc51da6f3cf/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.546738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a25e60-f3e9-454b-a603-cc72662e22a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40bd8bcdd2545629d4ffb502d59612c, user_id=ca40884ebd374bcfa5732cc51da6f3cf, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:14.549485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a25e60-f3e9-454b-a603-cc72662e22a9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:14.565777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1033/2078] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:14 2022] PUT /identity/v3/projects/f40bd8bcdd2545629d4ffb502d59612c/users/ca40884ebd374bcfa5732cc51da6f3cf/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:14.577365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aad0e-a165-4c0f-94e0-09aeddfe2f3a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.577672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aad0e-a165-4c0f-94e0-09aeddfe2f3a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.577966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aad0e-a165-4c0f-94e0-09aeddfe2f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.605260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e81aad0e-a165-4c0f-94e0-09aeddfe2f3a None None] MFA Rules not processed for user `ca40884ebd374bcfa5732cc51da6f3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:14.606434 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e81aad0e-a165-4c0f-94e0-09aeddfe2f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:14.671937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1046/2079] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:14.683315 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a25e60-f3e9-454b-a603-cc72662e22a9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:14.685011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a6a25e60-f3e9-454b-a603-cc72662e22a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:14.741076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a25e60-f3e9-454b-a603-cc72662e22a9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:14.744736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd99291-04a2-438a-b4ec-d489d799365c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6639f15880c4c718f41cd84cb79c750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:14.745327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd99291-04a2-438a-b4ec-d489d799365c service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:14.745599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd99291-04a2-438a-b4ec-d489d799365c service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:14.745864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd99291-04a2-438a-b4ec-d489d799365c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:14.753888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd99291-04a2-438a-b4ec-d489d799365c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:14.755328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd99291-04a2-438a-b4ec-d489d799365c service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:14.764636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1034/2080] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:21.000344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aad0e-a165-4c0f-94e0-09aeddfe2f3a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:21.001803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e81aad0e-a165-4c0f-94e0-09aeddfe2f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:21.011189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:21.067901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aad0e-a165-4c0f-94e0-09aeddfe2f3a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:21.072529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:21.073143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:21.073418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:21.073687 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] PATH_INFO: `/v3/users/66a89103cd2e44e7b34c6c7ba11bfbb0` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:21.074805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a89103cd2e44e7b34c6c7ba11bfbb0)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:21.076738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:21.122120 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a89103cd2e44e7b34c6c7ba11bfbb0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:21.128751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a89103cd2e44e7b34c6c7ba11bfbb0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:21.135951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a89103cd2e44e7b34c6c7ba11bfbb0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:21.136750 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a89103cd2e44e7b34c6c7ba11bfbb0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:21.149238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a89103cd2e44e7b34c6c7ba11bfbb0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:21.155536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1047/2081] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:20 2022] DELETE /identity/v3/users/66a89103cd2e44e7b34c6c7ba11bfbb0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:21.159943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec183a50-41bc-42aa-bb7a-84c560c2adfb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:21.160390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec183a50-41bc-42aa-bb7a-84c560c2adfb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:21.160620 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec183a50-41bc-42aa-bb7a-84c560c2adfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:21.179700 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ec183a50-41bc-42aa-bb7a-84c560c2adfb None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:21.180876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ec183a50-41bc-42aa-bb7a-84c560c2adfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:21.237965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1035/2082] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:21.247824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:21.249388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:21.311062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85177980-d561-4bf8-b626-5352a9be65dc admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:21.314790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfac23-82af-480f-9d9d-a0be338f9ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:21.315508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfac23-82af-480f-9d9d-a0be338f9ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:21.315781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfac23-82af-480f-9d9d-a0be338f9ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:21.316051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfac23-82af-480f-9d9d-a0be338f9ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:21.331996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfac23-82af-480f-9d9d-a0be338f9ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:21.336230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfac23-82af-480f-9d9d-a0be338f9ff5 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:21.344984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1048/2083] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:21.642905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec183a50-41bc-42aa-bb7a-84c560c2adfb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:21.644487 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ec183a50-41bc-42aa-bb7a-84c560c2adfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:21.658488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec183a50-41bc-42aa-bb7a-84c560c2adfb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:21.663370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:21.664005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:21.664278 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:21.664551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] PATH_INFO: `/v3/projects/5961c22b86c049f79ada128981795303` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:21.665676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5961c22b86c049f79ada128981795303)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:21.667619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:21.716462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5961c22b86c049f79ada128981795303', 'request_id': 'req-59570918-8e7a-4e7b-a635-b9a419420a23'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:21.721585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:21.723265 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5961c22b86c049f79ada128981795303', 'request_id': 'req-59570918-8e7a-4e7b-a635-b9a419420a23'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:21.731887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5961c22b86c049f79ada128981795303', 'request_id': 'req-59570918-8e7a-4e7b-a635-b9a419420a23'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:21.744971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] The token cache is being invalidate because project 5961c22b86c049f79ada128981795303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:21.745255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:21.745859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:21.747874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1036/2084] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:21 2022] DELETE /identity/v3/projects/5961c22b86c049f79ada128981795303 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:31.339708 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=76,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:31.741916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=5,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:46.580991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ea202-c5af-4a65-a347-622ffdcef6b3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:46.581463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ea202-c5af-4a65-a347-622ffdcef6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:46.581572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ea202-c5af-4a65-a347-622ffdcef6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:46.600219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-219ea202-c5af-4a65-a347-622ffdcef6b3 None None] MFA Rules not processed for user `ccb8ac5aaec44417bd6aaa4a2b1aca11`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:46.601382 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-219ea202-c5af-4a65-a347-622ffdcef6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:46.654083 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1049/2085] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:47.636057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:47.637578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:47.705324 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59570918-8e7a-4e7b-a635-b9a419420a23 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:47.709944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:47.710567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:47.710840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:47.711132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] PATH_INFO: `/v3/users/41796a7b7d864c8d89743f3d96be7b70` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:47.712259 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] RBAC: Authorizing `identity:delete_user(user_id=41796a7b7d864c8d89743f3d96be7b70)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:47.714206 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:47.761328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41796a7b7d864c8d89743f3d96be7b70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:47.769046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41796a7b7d864c8d89743f3d96be7b70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:47.769652 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41796a7b7d864c8d89743f3d96be7b70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:47.770391 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41796a7b7d864c8d89743f3d96be7b70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:47.785182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41796a7b7d864c8d89743f3d96be7b70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:47.797219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1037/2086] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:47 2022] DELETE /identity/v3/users/41796a7b7d864c8d89743f3d96be7b70 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:47.801548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a856b-8298-4646-ad91-d558ea42decc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:47.802002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a856b-8298-4646-ad91-d558ea42decc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:47.802093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a856b-8298-4646-ad91-d558ea42decc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:47.820935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5d4a856b-8298-4646-ad91-d558ea42decc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:47.822127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5d4a856b-8298-4646-ad91-d558ea42decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:47.885087 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1050/2087] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:47.895825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:47.897476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:47.960699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6463f3-6c8d-43f6-b902-de6440f6137e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:47.964402 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b5cfb-cf56-49bf-a9f0-84eb2cec3cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:47.965006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b5cfb-cf56-49bf-a9f0-84eb2cec3cfb service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:47.965284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b5cfb-cf56-49bf-a9f0-84eb2cec3cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:47.965555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b5cfb-cf56-49bf-a9f0-84eb2cec3cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:47.974785 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b5cfb-cf56-49bf-a9f0-84eb2cec3cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:47.976430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b5cfb-cf56-49bf-a9f0-84eb2cec3cfb service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:47.986288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1038/2088] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:48.272761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a856b-8298-4646-ad91-d558ea42decc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:48.274478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5d4a856b-8298-4646-ad91-d558ea42decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:48.290359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a856b-8298-4646-ad91-d558ea42decc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:48.295820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:48.296455 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:48.296733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:48.297000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] PATH_INFO: `/v3/projects/e73ae21299844104a0451e75ee71effd` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:48.298251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73ae21299844104a0451e75ee71effd)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:48.300123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:48.354999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73ae21299844104a0451e75ee71effd', 'request_id': 'req-17c0efae-24b1-477c-aee7-1e6352d7293d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:48.360647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73ae21299844104a0451e75ee71effd', 'request_id': 'req-17c0efae-24b1-477c-aee7-1e6352d7293d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:48.367171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73ae21299844104a0451e75ee71effd', 'request_id': 'req-17c0efae-24b1-477c-aee7-1e6352d7293d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:48.383613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] The token cache is being invalidate because project e73ae21299844104a0451e75ee71effd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:48.383935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:48.384578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:48.386062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1051/2089] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:48 2022] DELETE /identity/v3/projects/e73ae21299844104a0451e75ee71effd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:34:48.390979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b5cfb-cf56-49bf-a9f0-84eb2cec3cfb service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:48.402068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b5cfb-cf56-49bf-a9f0-84eb2cec3cfb service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:48.422759 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:48.492998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765cb99-a5f0-4fa9-b3c5-05ef03ed2f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:48.493623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765cb99-a5f0-4fa9-b3c5-05ef03ed2f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:48.493896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765cb99-a5f0-4fa9-b3c5-05ef03ed2f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:48.494164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765cb99-a5f0-4fa9-b3c5-05ef03ed2f73 admin admin] PATH_INFO: `/v3/users/ba17c0316d61427fb4b273d8fdb2e2b4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:48.495973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765cb99-a5f0-4fa9-b3c5-05ef03ed2f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba17c0316d61427fb4b273d8fdb2e2b4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:48.498712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765cb99-a5f0-4fa9-b3c5-05ef03ed2f73 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:48.550453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7765cb99-a5f0-4fa9-b3c5-05ef03ed2f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba17c0316d61427fb4b273d8fdb2e2b4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:48.561032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7765cb99-a5f0-4fa9-b3c5-05ef03ed2f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba17c0316d61427fb4b273d8fdb2e2b4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:48.562038 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7765cb99-a5f0-4fa9-b3c5-05ef03ed2f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba17c0316d61427fb4b273d8fdb2e2b4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:48.562961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7765cb99-a5f0-4fa9-b3c5-05ef03ed2f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba17c0316d61427fb4b273d8fdb2e2b4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:48.579907 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7765cb99-a5f0-4fa9-b3c5-05ef03ed2f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba17c0316d61427fb4b273d8fdb2e2b4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:48.594802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1039/2090] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:48 2022] DELETE /identity/v3/users/ba17c0316d61427fb4b273d8fdb2e2b4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:34:48.884052 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:48.885628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:48.901048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0efae-24b1-477c-aee7-1e6352d7293d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:48.929699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:48.964953 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e9e7d-8f69-458e-b517-af8ef400f309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:48.965667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9e7d-8f69-458e-b517-af8ef400f309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:48.965973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9e7d-8f69-458e-b517-af8ef400f309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:48.966252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9e7d-8f69-458e-b517-af8ef400f309 admin admin] PATH_INFO: `/v3/projects/1ff3e2f78b77419d95f9a71a069ec8f4` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:48.967422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e9e7d-8f69-458e-b517-af8ef400f309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff3e2f78b77419d95f9a71a069ec8f4)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:48.969346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e9e7d-8f69-458e-b517-af8ef400f309 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:49.021675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-813e9e7d-8f69-458e-b517-af8ef400f309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff3e2f78b77419d95f9a71a069ec8f4', 'request_id': 'req-813e9e7d-8f69-458e-b517-af8ef400f309'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:49.028095 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-813e9e7d-8f69-458e-b517-af8ef400f309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff3e2f78b77419d95f9a71a069ec8f4', 'request_id': 'req-813e9e7d-8f69-458e-b517-af8ef400f309'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:49.034577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-813e9e7d-8f69-458e-b517-af8ef400f309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff3e2f78b77419d95f9a71a069ec8f4', 'request_id': 'req-813e9e7d-8f69-458e-b517-af8ef400f309'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:49.050486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-813e9e7d-8f69-458e-b517-af8ef400f309 admin admin] The token cache is being invalidate because project 1ff3e2f78b77419d95f9a71a069ec8f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:49.050897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-813e9e7d-8f69-458e-b517-af8ef400f309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:49.051825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-813e9e7d-8f69-458e-b517-af8ef400f309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:49.053515 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1052/2091] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:48 2022] DELETE /identity/v3/projects/1ff3e2f78b77419d95f9a71a069ec8f4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:49.058637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d762f-7d14-4603-ab54-fb85e1f9c212 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:49.059436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d762f-7d14-4603-ab54-fb85e1f9c212 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:49.059699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d762f-7d14-4603-ab54-fb85e1f9c212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:49.080870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e69d762f-7d14-4603-ab54-fb85e1f9c212 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:49.082400 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e69d762f-7d14-4603-ab54-fb85e1f9c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:49.150951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1040/2092] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:49.159073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fba80-bcd6-4cd8-b39a-6a02994847db None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:49.159296 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fba80-bcd6-4cd8-b39a-6a02994847db None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:49.159642 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fba80-bcd6-4cd8-b39a-6a02994847db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:49.181011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a11fba80-bcd6-4cd8-b39a-6a02994847db None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:49.182342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a11fba80-bcd6-4cd8-b39a-6a02994847db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:49.201395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1053/2093] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:49.203963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d762f-7d14-4603-ab54-fb85e1f9c212 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:49.215243 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d762f-7d14-4603-ab54-fb85e1f9c212 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:49.221240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972846-57af-4efc-b8f7-c15174eef9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:49.221847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972846-57af-4efc-b8f7-c15174eef9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:49.222121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972846-57af-4efc-b8f7-c15174eef9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:49.222387 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972846-57af-4efc-b8f7-c15174eef9fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:49.223034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c972846-57af-4efc-b8f7-c15174eef9fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:34:49.223364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c972846-57af-4efc-b8f7-c15174eef9fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:49.224964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c972846-57af-4efc-b8f7-c15174eef9fb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:49.240866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1041/2094] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:34:49.241994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fba80-bcd6-4cd8-b39a-6a02994847db None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:49.252533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fba80-bcd6-4cd8-b39a-6a02994847db None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:49.258566 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f486bc-f96c-45ae-ad65-993c152b0978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:49.259225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f486bc-f96c-45ae-ad65-993c152b0978 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:49.259489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f486bc-f96c-45ae-ad65-993c152b0978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:49.259763 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f486bc-f96c-45ae-ad65-993c152b0978 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:49.260434 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f486bc-f96c-45ae-ad65-993c152b0978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:49.262596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f486bc-f96c-45ae-ad65-993c152b0978 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:49.304118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1054/2095] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:34:49 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:49.305404 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972846-57af-4efc-b8f7-c15174eef9fb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:49.316726 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972846-57af-4efc-b8f7-c15174eef9fb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:49.348991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:49.390344 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e85897-ccfc-456a-a7ed-c568662ea586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:49.390968 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e85897-ccfc-456a-a7ed-c568662ea586 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:49.391903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e85897-ccfc-456a-a7ed-c568662ea586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:49.391903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e85897-ccfc-456a-a7ed-c568662ea586 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:49.392215 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e85897-ccfc-456a-a7ed-c568662ea586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:49.394166 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e85897-ccfc-456a-a7ed-c568662ea586 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:49.423688 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1042/2096] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:34:49 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:49.428678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f486bc-f96c-45ae-ad65-993c152b0978 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:49.439531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f486bc-f96c-45ae-ad65-993c152b0978 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:49.445027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc0237-bc6a-4095-919b-a89ef4dd51fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:49.445777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc0237-bc6a-4095-919b-a89ef4dd51fd admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:49.446151 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc0237-bc6a-4095-919b-a89ef4dd51fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:49.446514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc0237-bc6a-4095-919b-a89ef4dd51fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:49.447310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc0237-bc6a-4095-919b-a89ef4dd51fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:49.449092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc0237-bc6a-4095-919b-a89ef4dd51fd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:49.482274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1055/2097] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:49.483984 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e85897-ccfc-456a-a7ed-c568662ea586 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:49.499345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e85897-ccfc-456a-a7ed-c568662ea586 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:49.504535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957ed2e-6c9c-4d75-a790-aa54083626bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:49.505137 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957ed2e-6c9c-4d75-a790-aa54083626bb admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:49.505409 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957ed2e-6c9c-4d75-a790-aa54083626bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:49.505678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957ed2e-6c9c-4d75-a790-aa54083626bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:49.506316 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957ed2e-6c9c-4d75-a790-aa54083626bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:49.508201 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957ed2e-6c9c-4d75-a790-aa54083626bb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:49.520034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1043/2098] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:49.524061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc0237-bc6a-4095-919b-a89ef4dd51fd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:49.534432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc0237-bc6a-4095-919b-a89ef4dd51fd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:49.538981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d0f7c-5869-4b98-9f29-8e367ec17044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:49.539652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d0f7c-5869-4b98-9f29-8e367ec17044 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:49.542901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d0f7c-5869-4b98-9f29-8e367ec17044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:49.546591 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d0f7c-5869-4b98-9f29-8e367ec17044 admin admin] PATH_INFO: `/v3/projects/a55d368a04974d16b1719f631e3ed704/users/aad970c4925c444a8c6e26173a8f8b88/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:49.563978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d0f7c-5869-4b98-9f29-8e367ec17044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55d368a04974d16b1719f631e3ed704, user_id=aad970c4925c444a8c6e26173a8f8b88, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:49.566595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d0f7c-5869-4b98-9f29-8e367ec17044 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:49.581304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1056/2099] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:49 2022] PUT /identity/v3/projects/a55d368a04974d16b1719f631e3ed704/users/aad970c4925c444a8c6e26173a8f8b88/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:49.593738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225fada-de9b-490e-942d-754b9f98dad1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:49.594092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225fada-de9b-490e-942d-754b9f98dad1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:49.594278 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225fada-de9b-490e-942d-754b9f98dad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:49.641170 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7225fada-de9b-490e-942d-754b9f98dad1 None None] MFA Rules not processed for user `aad970c4925c444a8c6e26173a8f8b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:49.642318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7225fada-de9b-490e-942d-754b9f98dad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:49.717029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1044/2100] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:49.726323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d0f7c-5869-4b98-9f29-8e367ec17044 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:49.790413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:49.796669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d0f7c-5869-4b98-9f29-8e367ec17044 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:49.802713 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ef9b2-1438-476e-8ae1-e2191fa39faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:49.803463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ef9b2-1438-476e-8ae1-e2191fa39faf admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:49.803797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ef9b2-1438-476e-8ae1-e2191fa39faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:49.804075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ef9b2-1438-476e-8ae1-e2191fa39faf admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:49.804716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ef9b2-1438-476e-8ae1-e2191fa39faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:49.806613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ef9b2-1438-476e-8ae1-e2191fa39faf admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:49.835534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1057/2101] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:34:49 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:49.840091 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225fada-de9b-490e-942d-754b9f98dad1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:49.852531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225fada-de9b-490e-942d-754b9f98dad1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:49.910106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff152d83-83cf-4714-aeed-6cc964dd5dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:49.910628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff152d83-83cf-4714-aeed-6cc964dd5dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:49.910934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff152d83-83cf-4714-aeed-6cc964dd5dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:49.911253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff152d83-83cf-4714-aeed-6cc964dd5dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:49.912070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff152d83-83cf-4714-aeed-6cc964dd5dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:49.913777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff152d83-83cf-4714-aeed-6cc964dd5dd3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:49.938992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1045/2102] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:34:49 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:49.940489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ef9b2-1438-476e-8ae1-e2191fa39faf admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:49.953074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ef9b2-1438-476e-8ae1-e2191fa39faf admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:49.958670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d052382-9a5b-4222-aaf5-4ad1f5838405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:49.959522 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d052382-9a5b-4222-aaf5-4ad1f5838405 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:49.960057 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d052382-9a5b-4222-aaf5-4ad1f5838405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:49.960434 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d052382-9a5b-4222-aaf5-4ad1f5838405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:49.961330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d052382-9a5b-4222-aaf5-4ad1f5838405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:49.962836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d052382-9a5b-4222-aaf5-4ad1f5838405 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:49.978443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1058/2103] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:49.980254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff152d83-83cf-4714-aeed-6cc964dd5dd3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:50.002378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff152d83-83cf-4714-aeed-6cc964dd5dd3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:50.007529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df57e6-31f9-474d-8956-d74bea7af618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:50.008310 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df57e6-31f9-474d-8956-d74bea7af618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:50.008642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df57e6-31f9-474d-8956-d74bea7af618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:50.008910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df57e6-31f9-474d-8956-d74bea7af618 admin admin] PATH_INFO: `/v3/projects/4890c6e49dc846dd99d3124747bba042/users/31f60c24c5844095a3d72f813d9ac998/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:50.025068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df57e6-31f9-474d-8956-d74bea7af618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4890c6e49dc846dd99d3124747bba042, user_id=31f60c24c5844095a3d72f813d9ac998, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:50.027744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df57e6-31f9-474d-8956-d74bea7af618 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:50.046436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1046/2104] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:49 2022] PUT /identity/v3/projects/4890c6e49dc846dd99d3124747bba042/users/31f60c24c5844095a3d72f813d9ac998/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:50.050414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d052382-9a5b-4222-aaf5-4ad1f5838405 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:50.061650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d052382-9a5b-4222-aaf5-4ad1f5838405 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:50.118208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746424a8-2944-40e8-83f4-f22691496c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:50.118818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746424a8-2944-40e8-83f4-f22691496c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:50.119104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746424a8-2944-40e8-83f4-f22691496c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:50.119410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746424a8-2944-40e8-83f4-f22691496c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:50.120050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746424a8-2944-40e8-83f4-f22691496c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:50.121645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746424a8-2944-40e8-83f4-f22691496c6f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:50.132709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1059/2105] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:34:50.136923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df57e6-31f9-474d-8956-d74bea7af618 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:50.143306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:50.149176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df57e6-31f9-474d-8956-d74bea7af618 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:50.155647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc6568-3ada-481b-91d7-2f072860adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:50.156321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc6568-3ada-481b-91d7-2f072860adbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:50.156598 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc6568-3ada-481b-91d7-2f072860adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:50.156869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc6568-3ada-481b-91d7-2f072860adbf admin admin] PATH_INFO: `/v3/projects/4890c6e49dc846dd99d3124747bba042/users/31f60c24c5844095a3d72f813d9ac998/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:50.158820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc6568-3ada-481b-91d7-2f072860adbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4890c6e49dc846dd99d3124747bba042, user_id=31f60c24c5844095a3d72f813d9ac998, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:50.161755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc6568-3ada-481b-91d7-2f072860adbf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:50.172755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1047/2106] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:50 2022] PUT /identity/v3/projects/4890c6e49dc846dd99d3124747bba042/users/31f60c24c5844095a3d72f813d9ac998/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:50.183485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c585b1f-9c84-415a-bf0a-4e224b6bd94f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:50.183788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c585b1f-9c84-415a-bf0a-4e224b6bd94f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:50.184039 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c585b1f-9c84-415a-bf0a-4e224b6bd94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:50.214291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0c585b1f-9c84-415a-bf0a-4e224b6bd94f None None] MFA Rules not processed for user `31f60c24c5844095a3d72f813d9ac998`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:50.215558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0c585b1f-9c84-415a-bf0a-4e224b6bd94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:50.242498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc6568-3ada-481b-91d7-2f072860adbf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:50.244319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-95fc6568-3ada-481b-91d7-2f072860adbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:50.295716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1060/2107] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:50.306951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c585b1f-9c84-415a-bf0a-4e224b6bd94f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:50.308482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0c585b1f-9c84-415a-bf0a-4e224b6bd94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:50.326742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc6568-3ada-481b-91d7-2f072860adbf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:50.331616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:50.332253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:50.332532 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:50.332804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] PATH_INFO: `/v3/users/ca40884ebd374bcfa5732cc51da6f3cf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:50.333953 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca40884ebd374bcfa5732cc51da6f3cf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:50.335940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:50.377615 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c585b1f-9c84-415a-bf0a-4e224b6bd94f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:50.384736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d7e55-4d6c-4be9-b3ec-1904ca8a4020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:50.385561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7e55-4d6c-4be9-b3ec-1904ca8a4020 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:50.385831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7e55-4d6c-4be9-b3ec-1904ca8a4020 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:50.386097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7e55-4d6c-4be9-b3ec-1904ca8a4020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:50.391025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca40884ebd374bcfa5732cc51da6f3cf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:50.393214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:50.398518 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d7e55-4d6c-4be9-b3ec-1904ca8a4020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:50.399446 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca40884ebd374bcfa5732cc51da6f3cf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:50.400151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca40884ebd374bcfa5732cc51da6f3cf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:50.400577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d7e55-4d6c-4be9-b3ec-1904ca8a4020 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:50.401060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca40884ebd374bcfa5732cc51da6f3cf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:50.410622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1061/2108] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:34:50.418145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca40884ebd374bcfa5732cc51da6f3cf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:50.431549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1048/2109] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:50 2022] DELETE /identity/v3/users/ca40884ebd374bcfa5732cc51da6f3cf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:50.437478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c3e1b-bed0-4444-9222-947694bfe3ab None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:50.437942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c3e1b-bed0-4444-9222-947694bfe3ab None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:50.438422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c3e1b-bed0-4444-9222-947694bfe3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:50.462898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d01c3e1b-bed0-4444-9222-947694bfe3ab None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:50.464232 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d01c3e1b-bed0-4444-9222-947694bfe3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:50.532071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1062/2110] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:34:50.544027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:50.546079 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:50.612108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019463-8995-4c8f-b7da-68b616a40c4c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:50.618362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64471c7-41ac-4978-b328-341ce09b2347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:50.618362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64471c7-41ac-4978-b328-341ce09b2347 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:50.618362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64471c7-41ac-4978-b328-341ce09b2347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:50.618362 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64471c7-41ac-4978-b328-341ce09b2347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:50.628826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64471c7-41ac-4978-b328-341ce09b2347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:50.630242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64471c7-41ac-4978-b328-341ce09b2347 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:50.640358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1049/2111] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:50.974746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c3e1b-bed0-4444-9222-947694bfe3ab None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:50.976379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d01c3e1b-bed0-4444-9222-947694bfe3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:51.011343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c3e1b-bed0-4444-9222-947694bfe3ab None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:51.023383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f23f2b-8d24-4909-86e5-b297218cbfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:51.024046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23f2b-8d24-4909-86e5-b297218cbfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:51.024326 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23f2b-8d24-4909-86e5-b297218cbfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:51.024598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23f2b-8d24-4909-86e5-b297218cbfaa admin admin] PATH_INFO: `/v3/projects/f40bd8bcdd2545629d4ffb502d59612c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:51.025752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f23f2b-8d24-4909-86e5-b297218cbfaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40bd8bcdd2545629d4ffb502d59612c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:51.027871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f23f2b-8d24-4909-86e5-b297218cbfaa admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:51.086541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e3f23f2b-8d24-4909-86e5-b297218cbfaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40bd8bcdd2545629d4ffb502d59612c', 'request_id': 'req-e3f23f2b-8d24-4909-86e5-b297218cbfaa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:51.098104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e3f23f2b-8d24-4909-86e5-b297218cbfaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40bd8bcdd2545629d4ffb502d59612c', 'request_id': 'req-e3f23f2b-8d24-4909-86e5-b297218cbfaa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:51.108715 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e3f23f2b-8d24-4909-86e5-b297218cbfaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40bd8bcdd2545629d4ffb502d59612c', 'request_id': 'req-e3f23f2b-8d24-4909-86e5-b297218cbfaa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:51.125221 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e3f23f2b-8d24-4909-86e5-b297218cbfaa admin admin] The token cache is being invalidate because project f40bd8bcdd2545629d4ffb502d59612c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:51.125579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e3f23f2b-8d24-4909-86e5-b297218cbfaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:51.126269 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e3f23f2b-8d24-4909-86e5-b297218cbfaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:51.128181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1063/2112] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:50 2022] DELETE /identity/v3/projects/f40bd8bcdd2545629d4ffb502d59612c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:51.133245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e802f31-d595-444c-9c3a-4b2553c56e74 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:51.133544 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e802f31-d595-444c-9c3a-4b2553c56e74 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:51.133797 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e802f31-d595-444c-9c3a-4b2553c56e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:51.155325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5e802f31-d595-444c-9c3a-4b2553c56e74 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:51.166096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5e802f31-d595-444c-9c3a-4b2553c56e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:51.172511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:51.232625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1050/2113] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:34:51.240335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e3375-63f7-4c3a-981f-a3f5f34ab5bd None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:51.240622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e3375-63f7-4c3a-981f-a3f5f34ab5bd None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:51.240901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e3375-63f7-4c3a-981f-a3f5f34ab5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:51.260593 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-394e3375-63f7-4c3a-981f-a3f5f34ab5bd None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:51.261918 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-394e3375-63f7-4c3a-981f-a3f5f34ab5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:51.274298 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1064/2114] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:34:51.278356 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e802f31-d595-444c-9c3a-4b2553c56e74 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:51.289711 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e802f31-d595-444c-9c3a-4b2553c56e74 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:51.294279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37d2cd-8403-4755-a16e-efa409cd5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:51.294917 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37d2cd-8403-4755-a16e-efa409cd5e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:51.295211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37d2cd-8403-4755-a16e-efa409cd5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:51.295485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37d2cd-8403-4755-a16e-efa409cd5e77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:51.296119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37d2cd-8403-4755-a16e-efa409cd5e77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:34:51.296416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37d2cd-8403-4755-a16e-efa409cd5e77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:51.297993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37d2cd-8403-4755-a16e-efa409cd5e77 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:51.312571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1051/2115] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:34:51.316660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e3375-63f7-4c3a-981f-a3f5f34ab5bd None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:51.326754 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e3375-63f7-4c3a-981f-a3f5f34ab5bd None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:51.336641 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ba054-7bfb-4e57-a068-38bb764c3a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:51.337278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ba054-7bfb-4e57-a068-38bb764c3a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:51.337555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ba054-7bfb-4e57-a068-38bb764c3a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:51.337825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ba054-7bfb-4e57-a068-38bb764c3a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:51.338459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ba054-7bfb-4e57-a068-38bb764c3a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:51.340509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ba054-7bfb-4e57-a068-38bb764c3a0a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:51.369438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1065/2116] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:34:51 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:34:51.373685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37d2cd-8403-4755-a16e-efa409cd5e77 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:51.383946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37d2cd-8403-4755-a16e-efa409cd5e77 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:51.453794 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d79eb-860a-4429-bee7-c06dc82cf479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:51.454284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d79eb-860a-4429-bee7-c06dc82cf479 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:51.454561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d79eb-860a-4429-bee7-c06dc82cf479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:51.454831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d79eb-860a-4429-bee7-c06dc82cf479 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:51.455530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d79eb-860a-4429-bee7-c06dc82cf479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:51.457488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d79eb-860a-4429-bee7-c06dc82cf479 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:51.479448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1052/2117] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:34:51 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:51.484048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ba054-7bfb-4e57-a068-38bb764c3a0a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:51.494262 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ba054-7bfb-4e57-a068-38bb764c3a0a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:51.499029 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcf410-6b98-48e4-a9c2-3e44ebbd4a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:51.499712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcf410-6b98-48e4-a9c2-3e44ebbd4a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:51.499995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcf410-6b98-48e4-a9c2-3e44ebbd4a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:51.500264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcf410-6b98-48e4-a9c2-3e44ebbd4a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:51.500902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcf410-6b98-48e4-a9c2-3e44ebbd4a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:51.502482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcf410-6b98-48e4-a9c2-3e44ebbd4a0c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:51.515370 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1066/2118] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:51.518514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d79eb-860a-4429-bee7-c06dc82cf479 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:51.529908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d79eb-860a-4429-bee7-c06dc82cf479 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:51.534675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4dd52-968c-4fc6-bb80-6ff3390637f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:51.535307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4dd52-968c-4fc6-bb80-6ff3390637f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:51.535585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4dd52-968c-4fc6-bb80-6ff3390637f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:51.535853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4dd52-968c-4fc6-bb80-6ff3390637f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:51.536492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4dd52-968c-4fc6-bb80-6ff3390637f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:51.538094 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4dd52-968c-4fc6-bb80-6ff3390637f5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:51.552095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1053/2119] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:51.552990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcf410-6b98-48e4-a9c2-3e44ebbd4a0c admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:51.563720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcf410-6b98-48e4-a9c2-3e44ebbd4a0c admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:51.568631 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242d4b5-d30b-42fb-9dcb-281d863b431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:51.569433 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242d4b5-d30b-42fb-9dcb-281d863b431a admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:51.569624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242d4b5-d30b-42fb-9dcb-281d863b431a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:51.569862 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242d4b5-d30b-42fb-9dcb-281d863b431a admin admin] PATH_INFO: `/v3/projects/91311b9408a44d32a4a88622e911ee08/users/633624663c31477ab7da365a4ed512e7/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:51.586143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242d4b5-d30b-42fb-9dcb-281d863b431a admin admin] RBAC: Authorizing `identity:create_grant(project_id=91311b9408a44d32a4a88622e911ee08, user_id=633624663c31477ab7da365a4ed512e7, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:51.589862 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242d4b5-d30b-42fb-9dcb-281d863b431a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:51.603004 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1067/2120] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:51 2022] PUT /identity/v3/projects/91311b9408a44d32a4a88622e911ee08/users/633624663c31477ab7da365a4ed512e7/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:51.615467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e20347-ef0f-4137-8065-07345ef90d63 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:51.615467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e20347-ef0f-4137-8065-07345ef90d63 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:51.615467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e20347-ef0f-4137-8065-07345ef90d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:51.643802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-03e20347-ef0f-4137-8065-07345ef90d63 None None] MFA Rules not processed for user `633624663c31477ab7da365a4ed512e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:51.644995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-03e20347-ef0f-4137-8065-07345ef90d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:51.715465 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1054/2121] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:51.726187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242d4b5-d30b-42fb-9dcb-281d863b431a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:51.727934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b242d4b5-d30b-42fb-9dcb-281d863b431a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:51.744882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:51.793185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242d4b5-d30b-42fb-9dcb-281d863b431a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:51.796821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e6a75-a6a6-47bf-b79b-cde921143f38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:51.797413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e6a75-a6a6-47bf-b79b-cde921143f38 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:51.797683 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e6a75-a6a6-47bf-b79b-cde921143f38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:51.797950 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e6a75-a6a6-47bf-b79b-cde921143f38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:51.807404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e6a75-a6a6-47bf-b79b-cde921143f38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:51.808761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e6a75-a6a6-47bf-b79b-cde921143f38 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:51.818413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1068/2122] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:51.886940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e20347-ef0f-4137-8065-07345ef90d63 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:51.888996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-03e20347-ef0f-4137-8065-07345ef90d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:51.898950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:51.961693 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e20347-ef0f-4137-8065-07345ef90d63 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:51.966873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:51.967544 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:51.967820 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:51.968092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] PATH_INFO: `/v3/users/aad970c4925c444a8c6e26173a8f8b88` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:51.969375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad970c4925c444a8c6e26173a8f8b88)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:51.971600 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:52.031939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad970c4925c444a8c6e26173a8f8b88'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.045070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad970c4925c444a8c6e26173a8f8b88'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.046027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad970c4925c444a8c6e26173a8f8b88'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.047019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad970c4925c444a8c6e26173a8f8b88'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.064937 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad970c4925c444a8c6e26173a8f8b88'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.098633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1055/2123] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:51 2022] DELETE /identity/v3/users/aad970c4925c444a8c6e26173a8f8b88 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:52.103027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7741629-76ab-4c47-a452-8b7f6e2f5a2b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:52.103472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7741629-76ab-4c47-a452-8b7f6e2f5a2b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:52.103662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7741629-76ab-4c47-a452-8b7f6e2f5a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:52.126791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a7741629-76ab-4c47-a452-8b7f6e2f5a2b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:52.135541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a7741629-76ab-4c47-a452-8b7f6e2f5a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:52.203357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1069/2124] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:52.213400 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:52.215610 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:52.273257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307b11-47cd-4980-9618-63057f3a6721 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:52.276984 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea71ec-6188-4892-be23-b7fa0e7161e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:52.277579 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea71ec-6188-4892-be23-b7fa0e7161e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:52.277853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea71ec-6188-4892-be23-b7fa0e7161e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:52.278141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea71ec-6188-4892-be23-b7fa0e7161e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:52.287737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea71ec-6188-4892-be23-b7fa0e7161e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:52.289188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea71ec-6188-4892-be23-b7fa0e7161e7 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:52.299133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1056/2125] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:52.555337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7741629-76ab-4c47-a452-8b7f6e2f5a2b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:52.556736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a7741629-76ab-4c47-a452-8b7f6e2f5a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:52.569721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7741629-76ab-4c47-a452-8b7f6e2f5a2b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:52.574504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:52.575470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:52.575751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:52.576112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] PATH_INFO: `/v3/projects/a55d368a04974d16b1719f631e3ed704` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:52.577139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55d368a04974d16b1719f631e3ed704)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:52.579117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:52.625451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55d368a04974d16b1719f631e3ed704', 'request_id': 'req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.630954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55d368a04974d16b1719f631e3ed704', 'request_id': 'req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.637154 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55d368a04974d16b1719f631e3ed704', 'request_id': 'req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.649912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] The token cache is being invalidate because project a55d368a04974d16b1719f631e3ed704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:52.650195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.650813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.652314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1070/2126] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:52 2022] DELETE /identity/v3/projects/a55d368a04974d16b1719f631e3ed704 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:52.656793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea71ec-6188-4892-be23-b7fa0e7161e7 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:52.666588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea71ec-6188-4892-be23-b7fa0e7161e7 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:52.692293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:52.724064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324cdb8-6aa5-412d-b989-889a83637ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:52.724676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324cdb8-6aa5-412d-b989-889a83637ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:52.724950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324cdb8-6aa5-412d-b989-889a83637ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:52.725218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324cdb8-6aa5-412d-b989-889a83637ea4 admin admin] PATH_INFO: `/v3/users/31f60c24c5844095a3d72f813d9ac998` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:52.726317 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324cdb8-6aa5-412d-b989-889a83637ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f60c24c5844095a3d72f813d9ac998)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:52.728254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324cdb8-6aa5-412d-b989-889a83637ea4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:52.773995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4324cdb8-6aa5-412d-b989-889a83637ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f60c24c5844095a3d72f813d9ac998'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.781125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4324cdb8-6aa5-412d-b989-889a83637ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f60c24c5844095a3d72f813d9ac998'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.781724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4324cdb8-6aa5-412d-b989-889a83637ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f60c24c5844095a3d72f813d9ac998'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.782315 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4324cdb8-6aa5-412d-b989-889a83637ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f60c24c5844095a3d72f813d9ac998'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.794043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4324cdb8-6aa5-412d-b989-889a83637ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f60c24c5844095a3d72f813d9ac998'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:52.805763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1057/2127] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:52 2022] DELETE /identity/v3/users/31f60c24c5844095a3d72f813d9ac998 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:53.086310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:53.087835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:53.105895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa8edb-7c85-49d9-a921-7e05b6e6088a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:53.145398 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:53.165433 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61210c2a-dbab-450a-a871-be5bdfa367aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:53.166056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61210c2a-dbab-450a-a871-be5bdfa367aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:53.166330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61210c2a-dbab-450a-a871-be5bdfa367aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:53.166592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61210c2a-dbab-450a-a871-be5bdfa367aa admin admin] PATH_INFO: `/v3/projects/4890c6e49dc846dd99d3124747bba042` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:53.167740 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61210c2a-dbab-450a-a871-be5bdfa367aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4890c6e49dc846dd99d3124747bba042)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:53.170062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61210c2a-dbab-450a-a871-be5bdfa367aa admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:53.226547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-61210c2a-dbab-450a-a871-be5bdfa367aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4890c6e49dc846dd99d3124747bba042', 'request_id': 'req-61210c2a-dbab-450a-a871-be5bdfa367aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:53.233685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38ea9c-19bf-46a2-986d-b34f55245dd0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:53.234189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38ea9c-19bf-46a2-986d-b34f55245dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:53.234284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-61210c2a-dbab-450a-a871-be5bdfa367aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4890c6e49dc846dd99d3124747bba042', 'request_id': 'req-61210c2a-dbab-450a-a871-be5bdfa367aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:53.234420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38ea9c-19bf-46a2-986d-b34f55245dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:53.241490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-61210c2a-dbab-450a-a871-be5bdfa367aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4890c6e49dc846dd99d3124747bba042', 'request_id': 'req-61210c2a-dbab-450a-a871-be5bdfa367aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:53.254366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2e38ea9c-19bf-46a2-986d-b34f55245dd0 None None] MFA Rules not processed for user `633624663c31477ab7da365a4ed512e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:53.255708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2e38ea9c-19bf-46a2-986d-b34f55245dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:53.256892 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-61210c2a-dbab-450a-a871-be5bdfa367aa admin admin] The token cache is being invalidate because project 4890c6e49dc846dd99d3124747bba042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:53.257283 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-61210c2a-dbab-450a-a871-be5bdfa367aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:53.258006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-61210c2a-dbab-450a-a871-be5bdfa367aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:53.263657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1071/2128] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:53 2022] DELETE /identity/v3/projects/4890c6e49dc846dd99d3124747bba042 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:53.265505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657df760-1baa-4586-a35f-1d5dedde8fbc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:53.265859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657df760-1baa-4586-a35f-1d5dedde8fbc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:53.266241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657df760-1baa-4586-a35f-1d5dedde8fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:53.286594 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-657df760-1baa-4586-a35f-1d5dedde8fbc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:53.287797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-657df760-1baa-4586-a35f-1d5dedde8fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:53.328729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1058/2129] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:53.353868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1072/2130] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:34:53.361905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e958797-52ea-4841-82d3-d7f1c1b9a577 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:53.362179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e958797-52ea-4841-82d3-d7f1c1b9a577 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:53.362454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e958797-52ea-4841-82d3-d7f1c1b9a577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:53.383078 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3e958797-52ea-4841-82d3-d7f1c1b9a577 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:53.384296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3e958797-52ea-4841-82d3-d7f1c1b9a577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:53.396694 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1059/2131] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:53.400991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657df760-1baa-4586-a35f-1d5dedde8fbc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:53.410677 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657df760-1baa-4586-a35f-1d5dedde8fbc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:53.415241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d66291-c509-4254-b1b4-67efa58f5978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:53.415899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d66291-c509-4254-b1b4-67efa58f5978 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:53.416169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d66291-c509-4254-b1b4-67efa58f5978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:53.416431 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d66291-c509-4254-b1b4-67efa58f5978 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:53.417069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d66291-c509-4254-b1b4-67efa58f5978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:34:53.417362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d66291-c509-4254-b1b4-67efa58f5978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:53.419657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d66291-c509-4254-b1b4-67efa58f5978 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:53.431250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1073/2132] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:34:53.436311 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e958797-52ea-4841-82d3-d7f1c1b9a577 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:53.445625 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e958797-52ea-4841-82d3-d7f1c1b9a577 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:53.450296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4030e-ba7f-455f-8231-ff3412b0d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:53.450911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4030e-ba7f-455f-8231-ff3412b0d01e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:53.451217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4030e-ba7f-455f-8231-ff3412b0d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:53.451482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4030e-ba7f-455f-8231-ff3412b0d01e admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:53.452100 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4030e-ba7f-455f-8231-ff3412b0d01e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:53.453975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4030e-ba7f-455f-8231-ff3412b0d01e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:53.483531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1060/2133] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:34:53 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:53.487720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d66291-c509-4254-b1b4-67efa58f5978 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:53.499488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d66291-c509-4254-b1b4-67efa58f5978 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:53.553339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:53.561591 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe124bb0-96e3-4810-9d4e-cb28d5db412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:53.562558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe124bb0-96e3-4810-9d4e-cb28d5db412d admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:53.562949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe124bb0-96e3-4810-9d4e-cb28d5db412d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:53.563536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe124bb0-96e3-4810-9d4e-cb28d5db412d admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:53.564208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe124bb0-96e3-4810-9d4e-cb28d5db412d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:53.566678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe124bb0-96e3-4810-9d4e-cb28d5db412d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:53.595473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1074/2134] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:34:53 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:34:53.597683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4030e-ba7f-455f-8231-ff3412b0d01e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:53.609462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4030e-ba7f-455f-8231-ff3412b0d01e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:53.614485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f352f-bc55-4355-b7da-40e7f960a683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:53.615125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f352f-bc55-4355-b7da-40e7f960a683 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:53.615458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f352f-bc55-4355-b7da-40e7f960a683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:53.615733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f352f-bc55-4355-b7da-40e7f960a683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:53.616450 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f352f-bc55-4355-b7da-40e7f960a683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:53.618021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f352f-bc55-4355-b7da-40e7f960a683 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:53.631139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1061/2135] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:34:53.635010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe124bb0-96e3-4810-9d4e-cb28d5db412d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:53.646831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe124bb0-96e3-4810-9d4e-cb28d5db412d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:53.652738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e1536-cae7-49e4-9783-6bf79bae6052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:53.653335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e1536-cae7-49e4-9783-6bf79bae6052 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:53.654181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e1536-cae7-49e4-9783-6bf79bae6052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:53.655185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e1536-cae7-49e4-9783-6bf79bae6052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:53.656438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e1536-cae7-49e4-9783-6bf79bae6052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:53.658228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e1536-cae7-49e4-9783-6bf79bae6052 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:53.668926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1075/2136] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:34:53.672973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f352f-bc55-4355-b7da-40e7f960a683 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:53.683517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f352f-bc55-4355-b7da-40e7f960a683 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:53.688161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a412a3-3bef-461f-91e2-ccd0f0ca8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:53.688803 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a412a3-3bef-461f-91e2-ccd0f0ca8ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:53.689076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a412a3-3bef-461f-91e2-ccd0f0ca8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:53.689348 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a412a3-3bef-461f-91e2-ccd0f0ca8ad5 admin admin] PATH_INFO: `/v3/projects/c416e95a9bcd444d9d754f68d29b7a93/users/b5600ef6cc8b491cb45b46e273094005/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:53.700890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:53.706671 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a412a3-3bef-461f-91e2-ccd0f0ca8ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c416e95a9bcd444d9d754f68d29b7a93, user_id=b5600ef6cc8b491cb45b46e273094005, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:53.711448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a412a3-3bef-461f-91e2-ccd0f0ca8ad5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:53.732796 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1062/2137] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:53 2022] PUT /identity/v3/projects/c416e95a9bcd444d9d754f68d29b7a93/users/b5600ef6cc8b491cb45b46e273094005/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:53.744192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0d9fc-6de6-4ff5-b644-0b80fa62c55e None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:53.744354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0d9fc-6de6-4ff5-b644-0b80fa62c55e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:53.744590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0d9fc-6de6-4ff5-b644-0b80fa62c55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:53.773861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5ba0d9fc-6de6-4ff5-b644-0b80fa62c55e None None] MFA Rules not processed for user `b5600ef6cc8b491cb45b46e273094005`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:53.775446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5ba0d9fc-6de6-4ff5-b644-0b80fa62c55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:53.846068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1076/2138] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:34:53.850671 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a412a3-3bef-461f-91e2-ccd0f0ca8ad5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:53.920633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a412a3-3bef-461f-91e2-ccd0f0ca8ad5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:53.926530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90740d-b2e4-44cf-a9f8-7ce841a32982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:53.927273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90740d-b2e4-44cf-a9f8-7ce841a32982 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:53.927624 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90740d-b2e4-44cf-a9f8-7ce841a32982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:53.928116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90740d-b2e4-44cf-a9f8-7ce841a32982 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:53.928931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90740d-b2e4-44cf-a9f8-7ce841a32982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:53.930975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90740d-b2e4-44cf-a9f8-7ce841a32982 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:53.979735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1063/2139] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:34:53 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:53.981063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0d9fc-6de6-4ff5-b644-0b80fa62c55e None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:53.998272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0d9fc-6de6-4ff5-b644-0b80fa62c55e None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:54.074599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cb8b7-4ba5-486f-b65a-5082980c6429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:54.075249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cb8b7-4ba5-486f-b65a-5082980c6429 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:54.076209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cb8b7-4ba5-486f-b65a-5082980c6429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:54.076483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cb8b7-4ba5-486f-b65a-5082980c6429 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:54.077122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cb8b7-4ba5-486f-b65a-5082980c6429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:54.079077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cb8b7-4ba5-486f-b65a-5082980c6429 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:54.107664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1077/2140] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:34:53 2022] POST /identity/v3/users => generated 303 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:34:54.109307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90740d-b2e4-44cf-a9f8-7ce841a32982 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:54.120391 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90740d-b2e4-44cf-a9f8-7ce841a32982 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:54.126218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd7ae2-dd33-4d83-bf4b-37b0fa305ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:54.126415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd7ae2-dd33-4d83-bf4b-37b0fa305ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:54.126669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd7ae2-dd33-4d83-bf4b-37b0fa305ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:54.126938 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd7ae2-dd33-4d83-bf4b-37b0fa305ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:54.127713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd7ae2-dd33-4d83-bf4b-37b0fa305ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:54.129286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd7ae2-dd33-4d83-bf4b-37b0fa305ac2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:54.141435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1064/2141] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:34:54.145595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cb8b7-4ba5-486f-b65a-5082980c6429 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:54.156437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cb8b7-4ba5-486f-b65a-5082980c6429 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:54.162180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e42e0-1820-4399-9b7f-e4ca8c781b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:54.163301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e42e0-1820-4399-9b7f-e4ca8c781b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:54.163590 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e42e0-1820-4399-9b7f-e4ca8c781b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:54.163866 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e42e0-1820-4399-9b7f-e4ca8c781b18 admin admin] PATH_INFO: `/v3/projects/c0ce34b03043448da9e8f5f948a19b72/users/c5d0da9cef49417eb859bbb9a935177a/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:54.183369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e42e0-1820-4399-9b7f-e4ca8c781b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ce34b03043448da9e8f5f948a19b72, user_id=c5d0da9cef49417eb859bbb9a935177a, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:54.186831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e42e0-1820-4399-9b7f-e4ca8c781b18 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:54.204686 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1078/2142] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:54 2022] PUT /identity/v3/projects/c0ce34b03043448da9e8f5f948a19b72/users/c5d0da9cef49417eb859bbb9a935177a/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:54.208902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd7ae2-dd33-4d83-bf4b-37b0fa305ac2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:54.219933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd7ae2-dd33-4d83-bf4b-37b0fa305ac2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:54.286695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b0f89-325a-4192-844b-fcf445fb1289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:54.287511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b0f89-325a-4192-844b-fcf445fb1289 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:54.287834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b0f89-325a-4192-844b-fcf445fb1289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:54.288167 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b0f89-325a-4192-844b-fcf445fb1289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:54.289114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b0f89-325a-4192-844b-fcf445fb1289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:54.290419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b0f89-325a-4192-844b-fcf445fb1289 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:54.302624 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1065/2143] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:34:54.307377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e42e0-1820-4399-9b7f-e4ca8c781b18 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:54.320711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e42e0-1820-4399-9b7f-e4ca8c781b18 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:54.326877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deacee5-9c84-4297-9619-e1e40ecb2e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:54.328006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deacee5-9c84-4297-9619-e1e40ecb2e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:54.328006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deacee5-9c84-4297-9619-e1e40ecb2e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:54.328455 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deacee5-9c84-4297-9619-e1e40ecb2e82 admin admin] PATH_INFO: `/v3/projects/c0ce34b03043448da9e8f5f948a19b72/users/c5d0da9cef49417eb859bbb9a935177a/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:54.331016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deacee5-9c84-4297-9619-e1e40ecb2e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ce34b03043448da9e8f5f948a19b72, user_id=c5d0da9cef49417eb859bbb9a935177a, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:54.334505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deacee5-9c84-4297-9619-e1e40ecb2e82 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:54.355169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1079/2144] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:34:54 2022] PUT /identity/v3/projects/c0ce34b03043448da9e8f5f948a19b72/users/c5d0da9cef49417eb859bbb9a935177a/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:54.364392 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26731a-5486-4714-8c87-f5aaa2ec3e4a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:54.364729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26731a-5486-4714-8c87-f5aaa2ec3e4a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:54.364960 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26731a-5486-4714-8c87-f5aaa2ec3e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:54.414884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bb26731a-5486-4714-8c87-f5aaa2ec3e4a None None] MFA Rules not processed for user `c5d0da9cef49417eb859bbb9a935177a`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:54.417082 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bb26731a-5486-4714-8c87-f5aaa2ec3e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:54.491546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:54.524807 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1066/2145] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:34:54.534361 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deacee5-9c84-4297-9619-e1e40ecb2e82 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:54.536475 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0deacee5-9c84-4297-9619-e1e40ecb2e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:54.560436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:54.617051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deacee5-9c84-4297-9619-e1e40ecb2e82 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:54.621238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12dcd6-a418-422f-8f93-022b6ec9397c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:54.621856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12dcd6-a418-422f-8f93-022b6ec9397c service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:54.622129 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12dcd6-a418-422f-8f93-022b6ec9397c service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:54.622592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12dcd6-a418-422f-8f93-022b6ec9397c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:54.634098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12dcd6-a418-422f-8f93-022b6ec9397c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:54.635603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12dcd6-a418-422f-8f93-022b6ec9397c service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:54.646174 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1080/2146] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:54 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:54.706298 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26731a-5486-4714-8c87-f5aaa2ec3e4a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:54.707949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bb26731a-5486-4714-8c87-f5aaa2ec3e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:54.724525 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26731a-5486-4714-8c87-f5aaa2ec3e4a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:54.728606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c6bcc-2374-4cee-b122-58452a4ff60e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:54.729776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c6bcc-2374-4cee-b122-58452a4ff60e service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:54.730058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c6bcc-2374-4cee-b122-58452a4ff60e service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:54.730329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c6bcc-2374-4cee-b122-58452a4ff60e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:54.798159 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c6bcc-2374-4cee-b122-58452a4ff60e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:54.799695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c6bcc-2374-4cee-b122-58452a4ff60e service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:54.809199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1067/2147] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:58.326939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12dcd6-a418-422f-8f93-022b6ec9397c service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:58.391465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12dcd6-a418-422f-8f93-022b6ec9397c service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:58.396108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:58.396757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:58.397059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:58.397332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] PATH_INFO: `/v3/users/b5600ef6cc8b491cb45b46e273094005` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:58.398457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5600ef6cc8b491cb45b46e273094005)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:58.400415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:58.452145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5600ef6cc8b491cb45b46e273094005'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:58.458828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5600ef6cc8b491cb45b46e273094005'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:58.466647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5600ef6cc8b491cb45b46e273094005'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:58.467321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5600ef6cc8b491cb45b46e273094005'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:58.480834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5600ef6cc8b491cb45b46e273094005'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:58.486730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1081/2148] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:58 2022] DELETE /identity/v3/users/b5600ef6cc8b491cb45b46e273094005 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:58.491408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bffdd-a61e-41e5-a987-edb2b268ea4f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:58.491869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bffdd-a61e-41e5-a987-edb2b268ea4f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:58.491985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bffdd-a61e-41e5-a987-edb2b268ea4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:58.512577 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ff6bffdd-a61e-41e5-a987-edb2b268ea4f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:58.514720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ff6bffdd-a61e-41e5-a987-edb2b268ea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:58.572989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1068/2149] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:58.583440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:58.584995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:58.630078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:58.645982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297455e-e524-43be-bb6d-faefb9853c38 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:58.649604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea21e7-865e-4158-9bb7-26c05924e49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:58.650198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea21e7-865e-4158-9bb7-26c05924e49e service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:58.650469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea21e7-865e-4158-9bb7-26c05924e49e service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:58.650753 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea21e7-865e-4158-9bb7-26c05924e49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:58.659854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea21e7-865e-4158-9bb7-26c05924e49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:58.661264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea21e7-865e-4158-9bb7-26c05924e49e service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:58.671457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1082/2150] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:34:58.995023 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bffdd-a61e-41e5-a987-edb2b268ea4f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:58.996468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ff6bffdd-a61e-41e5-a987-edb2b268ea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:59.009842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bffdd-a61e-41e5-a987-edb2b268ea4f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:59.014575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:59.015232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:59.015770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:59.016030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] PATH_INFO: `/v3/projects/c416e95a9bcd444d9d754f68d29b7a93` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:59.017174 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c416e95a9bcd444d9d754f68d29b7a93)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:59.019075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:59.065336 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c416e95a9bcd444d9d754f68d29b7a93', 'request_id': 'req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.070721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c416e95a9bcd444d9d754f68d29b7a93', 'request_id': 'req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.076900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c416e95a9bcd444d9d754f68d29b7a93', 'request_id': 'req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.087924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] The token cache is being invalidate because project c416e95a9bcd444d9d754f68d29b7a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:59.088207 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.088818 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.090281 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1069/2151] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:58 2022] DELETE /identity/v3/projects/c416e95a9bcd444d9d754f68d29b7a93 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:59.094827 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea21e7-865e-4158-9bb7-26c05924e49e service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:59.104365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea21e7-865e-4158-9bb7-26c05924e49e service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:59.160574 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b6ea6-9812-428f-af08-59527dbcc663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:59.161187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b6ea6-9812-428f-af08-59527dbcc663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:59.161476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b6ea6-9812-428f-af08-59527dbcc663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:59.161726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b6ea6-9812-428f-af08-59527dbcc663 admin admin] PATH_INFO: `/v3/users/c5d0da9cef49417eb859bbb9a935177a` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:59.162812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b6ea6-9812-428f-af08-59527dbcc663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d0da9cef49417eb859bbb9a935177a)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:59.164727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b6ea6-9812-428f-af08-59527dbcc663 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:59.210210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9d9b6ea6-9812-428f-af08-59527dbcc663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d0da9cef49417eb859bbb9a935177a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.217552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9d9b6ea6-9812-428f-af08-59527dbcc663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d0da9cef49417eb859bbb9a935177a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.224980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9d9b6ea6-9812-428f-af08-59527dbcc663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d0da9cef49417eb859bbb9a935177a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.225605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9d9b6ea6-9812-428f-af08-59527dbcc663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d0da9cef49417eb859bbb9a935177a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.238957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9d9b6ea6-9812-428f-af08-59527dbcc663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d0da9cef49417eb859bbb9a935177a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.244942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1083/2152] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:34:59 2022] DELETE /identity/v3/users/c5d0da9cef49417eb859bbb9a935177a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:59.616447 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:59.618060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:59.647575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc617e0-a3c8-41d9-a180-ca0bb0fdd12b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:59.651800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:59.720302 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fe8be-cef5-4caa-a13d-2e525cf64f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:59.720606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fe8be-cef5-4caa-a13d-2e525cf64f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:59.721724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fe8be-cef5-4caa-a13d-2e525cf64f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:59.721724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fe8be-cef5-4caa-a13d-2e525cf64f01 admin admin] PATH_INFO: `/v3/projects/c0ce34b03043448da9e8f5f948a19b72` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:59.722459 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fe8be-cef5-4caa-a13d-2e525cf64f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ce34b03043448da9e8f5f948a19b72)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:59.724516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fe8be-cef5-4caa-a13d-2e525cf64f01 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:59.773814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d56fe8be-cef5-4caa-a13d-2e525cf64f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ce34b03043448da9e8f5f948a19b72', 'request_id': 'req-d56fe8be-cef5-4caa-a13d-2e525cf64f01'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.780838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d56fe8be-cef5-4caa-a13d-2e525cf64f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ce34b03043448da9e8f5f948a19b72', 'request_id': 'req-d56fe8be-cef5-4caa-a13d-2e525cf64f01'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.787104 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d56fe8be-cef5-4caa-a13d-2e525cf64f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ce34b03043448da9e8f5f948a19b72', 'request_id': 'req-d56fe8be-cef5-4caa-a13d-2e525cf64f01'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.803985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d56fe8be-cef5-4caa-a13d-2e525cf64f01 admin admin] The token cache is being invalidate because project c0ce34b03043448da9e8f5f948a19b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:34:59.803985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d56fe8be-cef5-4caa-a13d-2e525cf64f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.803985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d56fe8be-cef5-4caa-a13d-2e525cf64f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:34:59.803985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1070/2153] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:34:59 2022] DELETE /identity/v3/projects/c0ce34b03043448da9e8f5f948a19b72 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:34:59.808915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a0e44-9ef4-4a74-b34c-6aed7dfddd86 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:59.809373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a0e44-9ef4-4a74-b34c-6aed7dfddd86 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:59.809373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a0e44-9ef4-4a74-b34c-6aed7dfddd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:59.830969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-637a0e44-9ef4-4a74-b34c-6aed7dfddd86 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:59.832530 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-637a0e44-9ef4-4a74-b34c-6aed7dfddd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:59.896038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1084/2154] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:59.905095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208ca69-77cb-407a-b243-0084904a7788 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:59.905373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208ca69-77cb-407a-b243-0084904a7788 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:59.905648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208ca69-77cb-407a-b243-0084904a7788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:59.925531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2208ca69-77cb-407a-b243-0084904a7788 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:34:59.926734 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2208ca69-77cb-407a-b243-0084904a7788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:34:59.935935 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1071/2155] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:34:59.940716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a0e44-9ef4-4a74-b34c-6aed7dfddd86 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:34:59.947507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:34:59.954048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a0e44-9ef4-4a74-b34c-6aed7dfddd86 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:34:59.960792 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9430ef9-f21b-4f75-b06f-8d97b7746a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:34:59.961507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9430ef9-f21b-4f75-b06f-8d97b7746a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:34:59.962269 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9430ef9-f21b-4f75-b06f-8d97b7746a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:34:59.962718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9430ef9-f21b-4f75-b06f-8d97b7746a06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:34:59.964349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9430ef9-f21b-4f75-b06f-8d97b7746a06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:34:59.964651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9430ef9-f21b-4f75-b06f-8d97b7746a06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:34:59.968212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9430ef9-f21b-4f75-b06f-8d97b7746a06 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:34:59.980788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1085/2156] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:34:59.989646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208ca69-77cb-407a-b243-0084904a7788 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:00.000329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208ca69-77cb-407a-b243-0084904a7788 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:00.005180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01f50b-24a9-44f1-b4e7-e6a0986059b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:00.005769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01f50b-24a9-44f1-b4e7-e6a0986059b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.006040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01f50b-24a9-44f1-b4e7-e6a0986059b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.006301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01f50b-24a9-44f1-b4e7-e6a0986059b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.006918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01f50b-24a9-44f1-b4e7-e6a0986059b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:00.008859 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01f50b-24a9-44f1-b4e7-e6a0986059b3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:00.036767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1072/2157] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:34:59 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:35:00.041663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9430ef9-f21b-4f75-b06f-8d97b7746a06 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:00.051640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9430ef9-f21b-4f75-b06f-8d97b7746a06 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:00.108768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5ab6c-73cb-42b4-a5c1-f1e6dd28b5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:00.109362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5ab6c-73cb-42b4-a5c1-f1e6dd28b5cd admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.109635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5ab6c-73cb-42b4-a5c1-f1e6dd28b5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.109898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5ab6c-73cb-42b4-a5c1-f1e6dd28b5cd admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.110516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5ab6c-73cb-42b4-a5c1-f1e6dd28b5cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:00.112437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5ab6c-73cb-42b4-a5c1-f1e6dd28b5cd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:00.134081 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1086/2158] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:35:00 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:35:00.138927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01f50b-24a9-44f1-b4e7-e6a0986059b3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:00.149671 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01f50b-24a9-44f1-b4e7-e6a0986059b3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:00.154490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79347121-673f-44b5-9b2b-744b664b1253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:00.155174 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79347121-673f-44b5-9b2b-744b664b1253 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.155451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79347121-673f-44b5-9b2b-744b664b1253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.155716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79347121-673f-44b5-9b2b-744b664b1253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.156380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79347121-673f-44b5-9b2b-744b664b1253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:00.157981 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79347121-673f-44b5-9b2b-744b664b1253 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:00.168336 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1073/2159] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:35:00.172636 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5ab6c-73cb-42b4-a5c1-f1e6dd28b5cd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:00.182921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5ab6c-73cb-42b4-a5c1-f1e6dd28b5cd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:00.188119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73b07b-ed32-4ca5-9bd7-a9ca2bfb1557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:00.188704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73b07b-ed32-4ca5-9bd7-a9ca2bfb1557 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.188979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73b07b-ed32-4ca5-9bd7-a9ca2bfb1557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.189249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73b07b-ed32-4ca5-9bd7-a9ca2bfb1557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.189880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73b07b-ed32-4ca5-9bd7-a9ca2bfb1557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:00.191512 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73b07b-ed32-4ca5-9bd7-a9ca2bfb1557 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:00.201941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1087/2160] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:35:00.206271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79347121-673f-44b5-9b2b-744b664b1253 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:00.216140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79347121-673f-44b5-9b2b-744b664b1253 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:00.220758 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c99202-d0c2-409a-b8c3-f33348d52c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:00.221397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99202-d0c2-409a-b8c3-f33348d52c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.221671 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99202-d0c2-409a-b8c3-f33348d52c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.221940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99202-d0c2-409a-b8c3-f33348d52c96 admin admin] PATH_INFO: `/v3/projects/635ad727065e483380c98df83dcac455/users/62696c7ce9234ae2b679ce830893b675/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.237754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c99202-d0c2-409a-b8c3-f33348d52c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635ad727065e483380c98df83dcac455, user_id=62696c7ce9234ae2b679ce830893b675, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:00.240467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c99202-d0c2-409a-b8c3-f33348d52c96 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:00.253627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1074/2161] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:35:00 2022] PUT /identity/v3/projects/635ad727065e483380c98df83dcac455/users/62696c7ce9234ae2b679ce830893b675/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:00.263900 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54183c-c00e-4662-b440-d103522e12b4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.264187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54183c-c00e-4662-b440-d103522e12b4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.264457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54183c-c00e-4662-b440-d103522e12b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.291805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4b54183c-c00e-4662-b440-d103522e12b4 None None] MFA Rules not processed for user `62696c7ce9234ae2b679ce830893b675`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:00.293011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4b54183c-c00e-4662-b440-d103522e12b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:00.357631 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1088/2162] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:00.362073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c99202-d0c2-409a-b8c3-f33348d52c96 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:00.397738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:00.428476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c99202-d0c2-409a-b8c3-f33348d52c96 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:00.433201 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3eba24-9ffe-4524-9ea9-92530ebda2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:00.433799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eba24-9ffe-4524-9ea9-92530ebda2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.434071 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eba24-9ffe-4524-9ea9-92530ebda2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.434336 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eba24-9ffe-4524-9ea9-92530ebda2e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.435568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3eba24-9ffe-4524-9ea9-92530ebda2e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:00.437518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3eba24-9ffe-4524-9ea9-92530ebda2e8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:00.465551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1075/2163] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:35:00 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:35:00.469694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54183c-c00e-4662-b440-d103522e12b4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:00.480735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54183c-c00e-4662-b440-d103522e12b4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:00.535510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:00.543189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2064cb8-989b-4829-a5b7-adaaee6c9fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:00.543807 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2064cb8-989b-4829-a5b7-adaaee6c9fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.544103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2064cb8-989b-4829-a5b7-adaaee6c9fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.544974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2064cb8-989b-4829-a5b7-adaaee6c9fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.545613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2064cb8-989b-4829-a5b7-adaaee6c9fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:00.547614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2064cb8-989b-4829-a5b7-adaaee6c9fa8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:00.572974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1089/2164] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:35:00 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:35:00.574167 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3eba24-9ffe-4524-9ea9-92530ebda2e8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:00.584967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3eba24-9ffe-4524-9ea9-92530ebda2e8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:00.589741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727f90a-ac56-4e1a-b33f-9ab0a08c18fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:00.590350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727f90a-ac56-4e1a-b33f-9ab0a08c18fe admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.590623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727f90a-ac56-4e1a-b33f-9ab0a08c18fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.590889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727f90a-ac56-4e1a-b33f-9ab0a08c18fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.592089 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727f90a-ac56-4e1a-b33f-9ab0a08c18fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:00.593691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727f90a-ac56-4e1a-b33f-9ab0a08c18fe admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:00.609528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1076/2165] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:35:00.610799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2064cb8-989b-4829-a5b7-adaaee6c9fa8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:00.621358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2064cb8-989b-4829-a5b7-adaaee6c9fa8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:00.626061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8f807-9c20-43c0-973c-56e9f4b90370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:00.626728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8f807-9c20-43c0-973c-56e9f4b90370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.627003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8f807-9c20-43c0-973c-56e9f4b90370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.627371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8f807-9c20-43c0-973c-56e9f4b90370 admin admin] PATH_INFO: `/v3/projects/4171f5eb181144cfbfec5ba9da27ae9c/users/6be5cc628d0a4f289565311c661743d7/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.643525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8f807-9c20-43c0-973c-56e9f4b90370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4171f5eb181144cfbfec5ba9da27ae9c, user_id=6be5cc628d0a4f289565311c661743d7, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:00.646240 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8f807-9c20-43c0-973c-56e9f4b90370 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:00.662120 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1090/2166] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:35:00 2022] PUT /identity/v3/projects/4171f5eb181144cfbfec5ba9da27ae9c/users/6be5cc628d0a4f289565311c661743d7/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:00.666181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727f90a-ac56-4e1a-b33f-9ab0a08c18fe admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:00.677539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727f90a-ac56-4e1a-b33f-9ab0a08c18fe admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:00.734752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe3661-1ee6-4a32-8169-401d806c6137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:00.735390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe3661-1ee6-4a32-8169-401d806c6137 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.735667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe3661-1ee6-4a32-8169-401d806c6137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.735937 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe3661-1ee6-4a32-8169-401d806c6137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.736575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe3661-1ee6-4a32-8169-401d806c6137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:00.738164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe3661-1ee6-4a32-8169-401d806c6137 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:00.748138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1077/2167] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:35:00.752222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8f807-9c20-43c0-973c-56e9f4b90370 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:00.762563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8f807-9c20-43c0-973c-56e9f4b90370 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:00.767550 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64722186-436f-479f-a517-91be7e4e9828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:00.768263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64722186-436f-479f-a517-91be7e4e9828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.768543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64722186-436f-479f-a517-91be7e4e9828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.768816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64722186-436f-479f-a517-91be7e4e9828 admin admin] PATH_INFO: `/v3/projects/4171f5eb181144cfbfec5ba9da27ae9c/users/6be5cc628d0a4f289565311c661743d7/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.770890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64722186-436f-479f-a517-91be7e4e9828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4171f5eb181144cfbfec5ba9da27ae9c, user_id=6be5cc628d0a4f289565311c661743d7, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:00.773932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64722186-436f-479f-a517-91be7e4e9828 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:00.787499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1091/2168] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:35:00 2022] PUT /identity/v3/projects/4171f5eb181144cfbfec5ba9da27ae9c/users/6be5cc628d0a4f289565311c661743d7/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:00.798316 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ce965-6ced-483d-9cae-63e0e8e5335d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.798628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ce965-6ced-483d-9cae-63e0e8e5335d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.798895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ce965-6ced-483d-9cae-63e0e8e5335d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:00.825690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c33ce965-6ced-483d-9cae-63e0e8e5335d None None] MFA Rules not processed for user `6be5cc628d0a4f289565311c661743d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:00.826882 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c33ce965-6ced-483d-9cae-63e0e8e5335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:00.905591 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1078/2169] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:00.916346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64722186-436f-479f-a517-91be7e4e9828 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:00.917998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-64722186-436f-479f-a517-91be7e4e9828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:00.988197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64722186-436f-479f-a517-91be7e4e9828 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:00.992257 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7397c-591f-412f-8a37-dae7521d043b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:00.993427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7397c-591f-412f-8a37-dae7521d043b service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:00.993775 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7397c-591f-412f-8a37-dae7521d043b service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:00.994116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7397c-591f-412f-8a37-dae7521d043b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:01.005501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7397c-591f-412f-8a37-dae7521d043b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:01.006925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7397c-591f-412f-8a37-dae7521d043b service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:01.019467 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1092/2170] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:35:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:35:01.177850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ce965-6ced-483d-9cae-63e0e8e5335d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:01.222022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:01.258425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ce965-6ced-483d-9cae-63e0e8e5335d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:01.263796 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:01.265124 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:01.265124 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:01.265325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] PATH_INFO: `/v3/users/62696c7ce9234ae2b679ce830893b675` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:01.267363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62696c7ce9234ae2b679ce830893b675)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:01.269811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:01.327378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62696c7ce9234ae2b679ce830893b675'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:01.335573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62696c7ce9234ae2b679ce830893b675'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:01.336526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62696c7ce9234ae2b679ce830893b675'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:01.337146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62696c7ce9234ae2b679ce830893b675'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:01.349245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62696c7ce9234ae2b679ce830893b675'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:01.361266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1079/2171] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:35:01 2022] DELETE /identity/v3/users/62696c7ce9234ae2b679ce830893b675 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:01.365644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0665f-c281-41a4-a7f4-e7ef777c223a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:01.365933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0665f-c281-41a4-a7f4-e7ef777c223a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:01.366213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0665f-c281-41a4-a7f4-e7ef777c223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:01.386333 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-68d0665f-c281-41a4-a7f4-e7ef777c223a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:01.387593 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-68d0665f-c281-41a4-a7f4-e7ef777c223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:01.447742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1093/2172] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:35:01.458182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:01.459755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:01.519250 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b877e2-ccdd-4bf0-86cc-8a07b6e90f0d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:01.522793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37fbc0-4b32-4d71-8a3c-5a779c818cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:01.523485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37fbc0-4b32-4d71-8a3c-5a779c818cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:01.523757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37fbc0-4b32-4d71-8a3c-5a779c818cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:01.524019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37fbc0-4b32-4d71-8a3c-5a779c818cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:01.532927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37fbc0-4b32-4d71-8a3c-5a779c818cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:01.534343 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37fbc0-4b32-4d71-8a3c-5a779c818cc8 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:01.543899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1080/2173] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:35:01.821623 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0665f-c281-41a4-a7f4-e7ef777c223a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:01.822929 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-68d0665f-c281-41a4-a7f4-e7ef777c223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:01.838141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0665f-c281-41a4-a7f4-e7ef777c223a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:01.843417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:01.844068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:01.844347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:01.844611 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] PATH_INFO: `/v3/projects/635ad727065e483380c98df83dcac455` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:01.845818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=635ad727065e483380c98df83dcac455)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:01.847780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:01.903335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:01.904766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635ad727065e483380c98df83dcac455', 'request_id': 'req-24f435d3-67b9-4689-bd11-03aa88358edc'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:01.912358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635ad727065e483380c98df83dcac455', 'request_id': 'req-24f435d3-67b9-4689-bd11-03aa88358edc'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:01.918945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635ad727065e483380c98df83dcac455', 'request_id': 'req-24f435d3-67b9-4689-bd11-03aa88358edc'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:01.932718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] The token cache is being invalidate because project 635ad727065e483380c98df83dcac455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:35:01.933006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:01.933650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:01.935767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1094/2174] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:35:01 2022] DELETE /identity/v3/projects/635ad727065e483380c98df83dcac455 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:01.939872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37fbc0-4b32-4d71-8a3c-5a779c818cc8 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:01.949557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37fbc0-4b32-4d71-8a3c-5a779c818cc8 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:02.002409 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:02.013132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdef987-c0dd-4eab-be2b-83564cdcdd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:02.014133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdef987-c0dd-4eab-be2b-83564cdcdd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:02.014542 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdef987-c0dd-4eab-be2b-83564cdcdd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:02.014802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdef987-c0dd-4eab-be2b-83564cdcdd69 admin admin] PATH_INFO: `/v3/users/6be5cc628d0a4f289565311c661743d7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:02.016313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdef987-c0dd-4eab-be2b-83564cdcdd69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be5cc628d0a4f289565311c661743d7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:02.018971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdef987-c0dd-4eab-be2b-83564cdcdd69 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:02.066301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9fdef987-c0dd-4eab-be2b-83564cdcdd69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be5cc628d0a4f289565311c661743d7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:02.074175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9fdef987-c0dd-4eab-be2b-83564cdcdd69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be5cc628d0a4f289565311c661743d7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:02.074778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9fdef987-c0dd-4eab-be2b-83564cdcdd69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be5cc628d0a4f289565311c661743d7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:02.075499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9fdef987-c0dd-4eab-be2b-83564cdcdd69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be5cc628d0a4f289565311c661743d7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:02.089236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9fdef987-c0dd-4eab-be2b-83564cdcdd69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be5cc628d0a4f289565311c661743d7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:02.102519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1081/2175] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:35:01 2022] DELETE /identity/v3/users/6be5cc628d0a4f289565311c661743d7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:02.417460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:02.418893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:02.440841 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f435d3-67b9-4689-bd11-03aa88358edc admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:02.553293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fa907-654b-484c-bdea-0ca834f69854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:02.553991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fa907-654b-484c-bdea-0ca834f69854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:02.554212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fa907-654b-484c-bdea-0ca834f69854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:02.554481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fa907-654b-484c-bdea-0ca834f69854 admin admin] PATH_INFO: `/v3/projects/4171f5eb181144cfbfec5ba9da27ae9c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:02.555848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fa907-654b-484c-bdea-0ca834f69854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4171f5eb181144cfbfec5ba9da27ae9c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:02.557712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fa907-654b-484c-bdea-0ca834f69854 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:02.628066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-382fa907-654b-484c-bdea-0ca834f69854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4171f5eb181144cfbfec5ba9da27ae9c', 'request_id': 'req-382fa907-654b-484c-bdea-0ca834f69854'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:02.635844 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-382fa907-654b-484c-bdea-0ca834f69854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4171f5eb181144cfbfec5ba9da27ae9c', 'request_id': 'req-382fa907-654b-484c-bdea-0ca834f69854'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:02.644128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-382fa907-654b-484c-bdea-0ca834f69854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4171f5eb181144cfbfec5ba9da27ae9c', 'request_id': 'req-382fa907-654b-484c-bdea-0ca834f69854'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:02.660431 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-382fa907-654b-484c-bdea-0ca834f69854 admin admin] The token cache is being invalidate because project 4171f5eb181144cfbfec5ba9da27ae9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:35:02.660691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-382fa907-654b-484c-bdea-0ca834f69854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:02.661262 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-382fa907-654b-484c-bdea-0ca834f69854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:02.663131 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1095/2176] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:35:02 2022] DELETE /identity/v3/projects/4171f5eb181144cfbfec5ba9da27ae9c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:02.667943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb636781-b9e2-4816-a37f-cfb3f4cbbd55 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:02.668295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb636781-b9e2-4816-a37f-cfb3f4cbbd55 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:02.668946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb636781-b9e2-4816-a37f-cfb3f4cbbd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:02.698039 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fb636781-b9e2-4816-a37f-cfb3f4cbbd55 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:02.699299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fb636781-b9e2-4816-a37f-cfb3f4cbbd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:02.760407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1082/2177] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:02.770570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa144d-6fce-4707-af79-78d188964e30 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:02.770867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa144d-6fce-4707-af79-78d188964e30 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:02.771169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa144d-6fce-4707-af79-78d188964e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:02.793799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1dfa144d-6fce-4707-af79-78d188964e30 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:02.795131 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1dfa144d-6fce-4707-af79-78d188964e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:02.803002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1096/2178] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:02.807386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb636781-b9e2-4816-a37f-cfb3f4cbbd55 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:02.817591 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb636781-b9e2-4816-a37f-cfb3f4cbbd55 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:02.822359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7507f-e369-42e2-845b-aa0f63f28628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:02.822962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7507f-e369-42e2-845b-aa0f63f28628 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:02.823286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7507f-e369-42e2-845b-aa0f63f28628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:02.823558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7507f-e369-42e2-845b-aa0f63f28628 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:02.824193 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7507f-e369-42e2-845b-aa0f63f28628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:35:02.824490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7507f-e369-42e2-845b-aa0f63f28628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:02.826755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7507f-e369-42e2-845b-aa0f63f28628 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:02.838707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1083/2179] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:35:02.843444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa144d-6fce-4707-af79-78d188964e30 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:02.853111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa144d-6fce-4707-af79-78d188964e30 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:02.857828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263efa7-3c20-4a33-8319-be33945561eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:02.858424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263efa7-3c20-4a33-8319-be33945561eb admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:02.858697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263efa7-3c20-4a33-8319-be33945561eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:02.859057 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263efa7-3c20-4a33-8319-be33945561eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:02.859698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263efa7-3c20-4a33-8319-be33945561eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:02.861653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263efa7-3c20-4a33-8319-be33945561eb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:02.891865 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1097/2180] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:35:02 2022] POST /identity/v3/projects => generated 357 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:35:02.896004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7507f-e369-42e2-845b-aa0f63f28628 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:02.906174 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7507f-e369-42e2-845b-aa0f63f28628 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:02.960379 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:02.968507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d6c95-ec37-4127-aeb0-ced2a03d03fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:02.969599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d6c95-ec37-4127-aeb0-ced2a03d03fe admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:02.969886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d6c95-ec37-4127-aeb0-ced2a03d03fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:02.970165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d6c95-ec37-4127-aeb0-ced2a03d03fe admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:02.970786 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d6c95-ec37-4127-aeb0-ced2a03d03fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:02.973202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d6c95-ec37-4127-aeb0-ced2a03d03fe admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:03.002042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1084/2181] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:35:02 2022] POST /identity/v3/users => generated 279 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:35:03.003326 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263efa7-3c20-4a33-8319-be33945561eb admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:03.013935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263efa7-3c20-4a33-8319-be33945561eb admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:03.018842 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292f079-ced7-40a1-b2fa-87f6f6c071ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:03.019469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292f079-ced7-40a1-b2fa-87f6f6c071ab admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:03.019744 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292f079-ced7-40a1-b2fa-87f6f6c071ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:03.020014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292f079-ced7-40a1-b2fa-87f6f6c071ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:03.020655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292f079-ced7-40a1-b2fa-87f6f6c071ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:03.022259 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292f079-ced7-40a1-b2fa-87f6f6c071ab admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:03.034247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1098/2182] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:35:03.038397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d6c95-ec37-4127-aeb0-ced2a03d03fe admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:03.048784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d6c95-ec37-4127-aeb0-ced2a03d03fe admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:03.053480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c196-7142-4bc8-9e99-cda71d321e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:03.054074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c196-7142-4bc8-9e99-cda71d321e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:03.054347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c196-7142-4bc8-9e99-cda71d321e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:03.054611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c196-7142-4bc8-9e99-cda71d321e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:03.055285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5c196-7142-4bc8-9e99-cda71d321e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:03.056938 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5c196-7142-4bc8-9e99-cda71d321e01 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:03.068458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1085/2183] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:35:03.072627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292f079-ced7-40a1-b2fa-87f6f6c071ab admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:03.083584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292f079-ced7-40a1-b2fa-87f6f6c071ab admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:03.088623 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a1d2f-102f-4aec-9674-694b6cb2bb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:03.089301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a1d2f-102f-4aec-9674-694b6cb2bb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:03.089576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a1d2f-102f-4aec-9674-694b6cb2bb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:03.089846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a1d2f-102f-4aec-9674-694b6cb2bb2f admin admin] PATH_INFO: `/v3/projects/f3f3e25d8da84e4c8db46d0ba01e8fa1/users/ee0718ccdc0544718d629b295e0ca107/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:03.105116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a1d2f-102f-4aec-9674-694b6cb2bb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f3e25d8da84e4c8db46d0ba01e8fa1, user_id=ee0718ccdc0544718d629b295e0ca107, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:03.108121 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a1d2f-102f-4aec-9674-694b6cb2bb2f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:03.121130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1099/2184] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:35:03 2022] PUT /identity/v3/projects/f3f3e25d8da84e4c8db46d0ba01e8fa1/users/ee0718ccdc0544718d629b295e0ca107/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:03.132167 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec7c32-7948-45cf-8e12-c522cd133256 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:03.132520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec7c32-7948-45cf-8e12-c522cd133256 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:03.132876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec7c32-7948-45cf-8e12-c522cd133256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:03.162888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ebec7c32-7948-45cf-8e12-c522cd133256 None None] MFA Rules not processed for user `ee0718ccdc0544718d629b295e0ca107`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:03.164247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ebec7c32-7948-45cf-8e12-c522cd133256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:03.230671 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1086/2185] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:03.267887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a1d2f-102f-4aec-9674-694b6cb2bb2f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:03.269667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-603a1d2f-102f-4aec-9674-694b6cb2bb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:03.275465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:03.333244 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a1d2f-102f-4aec-9674-694b6cb2bb2f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:03.337415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69bae3-d3ff-45b3-a80b-9f4b9cac2f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:03.338016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69bae3-d3ff-45b3-a80b-9f4b9cac2f90 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:03.338290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69bae3-d3ff-45b3-a80b-9f4b9cac2f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:03.338554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69bae3-d3ff-45b3-a80b-9f4b9cac2f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:03.347054 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69bae3-d3ff-45b3-a80b-9f4b9cac2f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:03.348561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69bae3-d3ff-45b3-a80b-9f4b9cac2f90 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:03.357820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1100/2186] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:35:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:35:03.373280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec7c32-7948-45cf-8e12-c522cd133256 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:03.436232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec7c32-7948-45cf-8e12-c522cd133256 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:03.440727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:03.441339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:03.441609 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:03.441871 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] PATH_INFO: `/v3/users/ee0718ccdc0544718d629b295e0ca107` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:03.442985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0718ccdc0544718d629b295e0ca107)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:03.444925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:03.490186 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0718ccdc0544718d629b295e0ca107'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:03.498321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0718ccdc0544718d629b295e0ca107'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:03.498920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0718ccdc0544718d629b295e0ca107'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:03.499561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0718ccdc0544718d629b295e0ca107'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:03.509437 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:03.511863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0718ccdc0544718d629b295e0ca107'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:03.525798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1087/2187] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:35:03 2022] DELETE /identity/v3/users/ee0718ccdc0544718d629b295e0ca107 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:03.530619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58831ddc-0832-49e7-ac6e-ecfa7b3d2545 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:03.530944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58831ddc-0832-49e7-ac6e-ecfa7b3d2545 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:03.531249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58831ddc-0832-49e7-ac6e-ecfa7b3d2545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:03.550070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-58831ddc-0832-49e7-ac6e-ecfa7b3d2545 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:03.551278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-58831ddc-0832-49e7-ac6e-ecfa7b3d2545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:03.608504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1101/2188] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:03.618178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:03.619646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:03.676396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745aa6-3064-400f-8860-a624c13ce7da admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:03.680074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208583ab-e7b2-4593-8ab4-070a4367b2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:03.680668 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208583ab-e7b2-4593-8ab4-070a4367b2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:03.680946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208583ab-e7b2-4593-8ab4-070a4367b2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:03.681221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208583ab-e7b2-4593-8ab4-070a4367b2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:03.690135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208583ab-e7b2-4593-8ab4-070a4367b2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:03.691591 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208583ab-e7b2-4593-8ab4-070a4367b2d5 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:03.701055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1088/2189] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:35:04.037257 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58831ddc-0832-49e7-ac6e-ecfa7b3d2545 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:04.038692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-58831ddc-0832-49e7-ac6e-ecfa7b3d2545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:04.052678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58831ddc-0832-49e7-ac6e-ecfa7b3d2545 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:04.058087 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035582d-0af6-48f9-91da-e093b373b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:04.058873 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035582d-0af6-48f9-91da-e093b373b87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:04.059385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035582d-0af6-48f9-91da-e093b373b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:04.059726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035582d-0af6-48f9-91da-e093b373b87f admin admin] PATH_INFO: `/v3/projects/f3f3e25d8da84e4c8db46d0ba01e8fa1` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:04.061103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035582d-0af6-48f9-91da-e093b373b87f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f3e25d8da84e4c8db46d0ba01e8fa1)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:04.063195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035582d-0af6-48f9-91da-e093b373b87f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:04.109780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1035582d-0af6-48f9-91da-e093b373b87f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f3e25d8da84e4c8db46d0ba01e8fa1', 'request_id': 'req-1035582d-0af6-48f9-91da-e093b373b87f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:04.115022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1035582d-0af6-48f9-91da-e093b373b87f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f3e25d8da84e4c8db46d0ba01e8fa1', 'request_id': 'req-1035582d-0af6-48f9-91da-e093b373b87f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:04.120943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1035582d-0af6-48f9-91da-e093b373b87f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f3e25d8da84e4c8db46d0ba01e8fa1', 'request_id': 'req-1035582d-0af6-48f9-91da-e093b373b87f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:04.132647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1035582d-0af6-48f9-91da-e093b373b87f admin admin] The token cache is being invalidate because project f3f3e25d8da84e4c8db46d0ba01e8fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:35:04.132921 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1035582d-0af6-48f9-91da-e093b373b87f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:04.134086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1035582d-0af6-48f9-91da-e093b373b87f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:04.135585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1102/2190] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:35:04 2022] DELETE /identity/v3/projects/f3f3e25d8da84e4c8db46d0ba01e8fa1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:04.141209 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36aa15-893f-4688-a1a0-285d30791c03 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:04.141703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36aa15-893f-4688-a1a0-285d30791c03 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:04.141812 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36aa15-893f-4688-a1a0-285d30791c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:04.161163 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9c36aa15-893f-4688-a1a0-285d30791c03 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:04.162339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9c36aa15-893f-4688-a1a0-285d30791c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:04.221895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1089/2191] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:04.229706 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fbec4-201d-4d09-930c-daa63f0e24f1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:04.229992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fbec4-201d-4d09-930c-daa63f0e24f1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:04.230261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fbec4-201d-4d09-930c-daa63f0e24f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:04.249889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f04fbec4-201d-4d09-930c-daa63f0e24f1 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:04.251076 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f04fbec4-201d-4d09-930c-daa63f0e24f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:04.258927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1103/2192] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:04.262956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36aa15-893f-4688-a1a0-285d30791c03 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:04.273453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36aa15-893f-4688-a1a0-285d30791c03 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:04.278011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dca10-c914-466c-b0ae-e6abf87dec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:04.278598 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dca10-c914-466c-b0ae-e6abf87dec46 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:04.278870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dca10-c914-466c-b0ae-e6abf87dec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:04.279173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dca10-c914-466c-b0ae-e6abf87dec46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:04.279812 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9dca10-c914-466c-b0ae-e6abf87dec46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:35:04.280110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9dca10-c914-466c-b0ae-e6abf87dec46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:04.281875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9dca10-c914-466c-b0ae-e6abf87dec46 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:04.293013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1090/2193] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:35:04.297401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fbec4-201d-4d09-930c-daa63f0e24f1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:04.306568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fbec4-201d-4d09-930c-daa63f0e24f1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:04.311825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e87eb-7bb5-48d5-b3ab-a7610824f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:04.312411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e87eb-7bb5-48d5-b3ab-a7610824f674 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:04.312690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e87eb-7bb5-48d5-b3ab-a7610824f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:04.312957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e87eb-7bb5-48d5-b3ab-a7610824f674 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:04.313575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e87eb-7bb5-48d5-b3ab-a7610824f674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:04.315479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e87eb-7bb5-48d5-b3ab-a7610824f674 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:04.337594 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:04.345034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1104/2194] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:35:04 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:35:04.349250 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dca10-c914-466c-b0ae-e6abf87dec46 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:04.359191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dca10-c914-466c-b0ae-e6abf87dec46 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:04.415421 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb6900-2bea-4031-8c8a-dacdafda1a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:04.416015 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb6900-2bea-4031-8c8a-dacdafda1a8c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:04.416291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb6900-2bea-4031-8c8a-dacdafda1a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:04.416561 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb6900-2bea-4031-8c8a-dacdafda1a8c admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:04.417183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb6900-2bea-4031-8c8a-dacdafda1a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:04.419111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb6900-2bea-4031-8c8a-dacdafda1a8c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:04.443177 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1091/2195] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:35:04 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:35:04.447300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e87eb-7bb5-48d5-b3ab-a7610824f674 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:04.459372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e87eb-7bb5-48d5-b3ab-a7610824f674 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:04.464041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f25f7-edb0-4691-9c23-2efb9918655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:04.464640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f25f7-edb0-4691-9c23-2efb9918655d admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:04.464917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f25f7-edb0-4691-9c23-2efb9918655d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:04.465187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f25f7-edb0-4691-9c23-2efb9918655d admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:04.465926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f25f7-edb0-4691-9c23-2efb9918655d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:04.467478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f25f7-edb0-4691-9c23-2efb9918655d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:04.479561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1105/2196] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:35:04.483713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb6900-2bea-4031-8c8a-dacdafda1a8c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:04.490189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:04.494457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb6900-2bea-4031-8c8a-dacdafda1a8c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:04.500999 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0b44d-c0fe-4aa7-9cb4-025c14d9182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:04.501635 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0b44d-c0fe-4aa7-9cb4-025c14d9182e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:04.501889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0b44d-c0fe-4aa7-9cb4-025c14d9182e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:04.502167 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0b44d-c0fe-4aa7-9cb4-025c14d9182e admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:04.503075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0b44d-c0fe-4aa7-9cb4-025c14d9182e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:04.505120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0b44d-c0fe-4aa7-9cb4-025c14d9182e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:04.517228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1092/2197] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:35:04.521461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f25f7-edb0-4691-9c23-2efb9918655d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:04.531566 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f25f7-edb0-4691-9c23-2efb9918655d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:04.536299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ec389-286e-4081-9574-b43bceabeb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:04.537060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ec389-286e-4081-9574-b43bceabeb43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:04.537362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ec389-286e-4081-9574-b43bceabeb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:04.537734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ec389-286e-4081-9574-b43bceabeb43 admin admin] PATH_INFO: `/v3/projects/5fcb51863cc04717b646b8baa260ba5f/users/3602d537105f49bd9e82373943021d31/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:04.552175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ec389-286e-4081-9574-b43bceabeb43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fcb51863cc04717b646b8baa260ba5f, user_id=3602d537105f49bd9e82373943021d31, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:04.554799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ec389-286e-4081-9574-b43bceabeb43 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:04.569690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1106/2198] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:35:04 2022] PUT /identity/v3/projects/5fcb51863cc04717b646b8baa260ba5f/users/3602d537105f49bd9e82373943021d31/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:04.574975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa29a6-ab0c-4bac-bd37-69c02158696e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:04.575538 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa29a6-ab0c-4bac-bd37-69c02158696e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:04.575900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa29a6-ab0c-4bac-bd37-69c02158696e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:04.597123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0ffa29a6-ab0c-4bac-bd37-69c02158696e None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:04.598700 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0ffa29a6-ab0c-4bac-bd37-69c02158696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:04.663699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1093/2199] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:04.673616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ec389-286e-4081-9574-b43bceabeb43 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:04.675463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-073ec389-286e-4081-9574-b43bceabeb43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:04.734418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ec389-286e-4081-9574-b43bceabeb43 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:04.738434 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a04c-bdee-4e69-b579-1612ba068557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:04.739027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a04c-bdee-4e69-b579-1612ba068557 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:04.739332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a04c-bdee-4e69-b579-1612ba068557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:04.739605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a04c-bdee-4e69-b579-1612ba068557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:04.749279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9a04c-bdee-4e69-b579-1612ba068557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:04.750698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9a04c-bdee-4e69-b579-1612ba068557 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:04.760865 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1107/2200] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:35:05.382875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20397a09-5bf8-4bbc-ba4b-470c49116973 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:05.383478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20397a09-5bf8-4bbc-ba4b-470c49116973 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:05.383603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20397a09-5bf8-4bbc-ba4b-470c49116973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:05.415390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-20397a09-5bf8-4bbc-ba4b-470c49116973 None None] MFA Rules not processed for user `3602d537105f49bd9e82373943021d31`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:05.416715 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-20397a09-5bf8-4bbc-ba4b-470c49116973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:05.482541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1094/2201] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:05.493241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a04c-bdee-4e69-b579-1612ba068557 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:05.494614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9bc9a04c-bdee-4e69-b579-1612ba068557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:05.552065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a04c-bdee-4e69-b579-1612ba068557 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:05.556049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf32d8-5ee6-4d06-ba33-effc510f35db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:05.556657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf32d8-5ee6-4d06-ba33-effc510f35db service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:05.556938 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf32d8-5ee6-4d06-ba33-effc510f35db service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:05.557207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf32d8-5ee6-4d06-ba33-effc510f35db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:05.565768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf32d8-5ee6-4d06-ba33-effc510f35db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:05.567205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf32d8-5ee6-4d06-ba33-effc510f35db service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:05.576054 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1108/2202] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:35:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:35:06.930489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89694d8-aff3-4a29-be84-5ed168e12c0e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:06.930943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89694d8-aff3-4a29-be84-5ed168e12c0e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:06.931045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89694d8-aff3-4a29-be84-5ed168e12c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:06.949484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c89694d8-aff3-4a29-be84-5ed168e12c0e None None] MFA Rules not processed for user `3602d537105f49bd9e82373943021d31`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:06.950659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c89694d8-aff3-4a29-be84-5ed168e12c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:06.957833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1095/2203] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:12.794178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da334dea-b498-4ff2-b2cb-ad0659300ad3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:12.794637 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da334dea-b498-4ff2-b2cb-ad0659300ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:12.794761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da334dea-b498-4ff2-b2cb-ad0659300ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:12.814096 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-da334dea-b498-4ff2-b2cb-ad0659300ad3 None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:12.815288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-da334dea-b498-4ff2-b2cb-ad0659300ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:12.866989 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1109/2204] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:35:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:12.909303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89694d8-aff3-4a29-be84-5ed168e12c0e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:12.910703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c89694d8-aff3-4a29-be84-5ed168e12c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:12.980108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89694d8-aff3-4a29-be84-5ed168e12c0e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:12.985145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae664e-8857-48b2-a2a4-dd623de00eb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:12.985876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae664e-8857-48b2-a2a4-dd623de00eb7 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:12.986149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae664e-8857-48b2-a2a4-dd623de00eb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:12.986414 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae664e-8857-48b2-a2a4-dd623de00eb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:12.994658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae664e-8857-48b2-a2a4-dd623de00eb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:12.996272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae664e-8857-48b2-a2a4-dd623de00eb7 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:13.004347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1096/2205] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:35:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:35:13.523839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b37a3-6cfd-4d28-9d2c-82f1df34209f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:13.524124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b37a3-6cfd-4d28-9d2c-82f1df34209f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:13.524392 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b37a3-6cfd-4d28-9d2c-82f1df34209f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:13.542511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-324b37a3-6cfd-4d28-9d2c-82f1df34209f None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:13.543711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-324b37a3-6cfd-4d28-9d2c-82f1df34209f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:13.550603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1110/2206] 10.222.0.15 () {58 vars in 967 bytes} [Sun Aug 7 22:35:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:13.563142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae664e-8857-48b2-a2a4-dd623de00eb7 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:13.573386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae664e-8857-48b2-a2a4-dd623de00eb7 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:13.578932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55bf53-81ec-429d-be58-1160f1486b39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:13.579550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55bf53-81ec-429d-be58-1160f1486b39 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:13.579819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55bf53-81ec-429d-be58-1160f1486b39 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:13.580084 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55bf53-81ec-429d-be58-1160f1486b39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:13.584889 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:13.589084 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55bf53-81ec-429d-be58-1160f1486b39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:13.590636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55bf53-81ec-429d-be58-1160f1486b39 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:13.598744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1097/2207] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:35:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:35:13.846110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a2697-2590-4415-8330-398405085032 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:13.846583 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a2697-2590-4415-8330-398405085032 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:13.846675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a2697-2590-4415-8330-398405085032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:13.865417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4a9a2697-2590-4415-8330-398405085032 None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:13.866578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4a9a2697-2590-4415-8330-398405085032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:13.873521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1111/2208] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:35:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:13.885676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55bf53-81ec-429d-be58-1160f1486b39 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:13.896563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55bf53-81ec-429d-be58-1160f1486b39 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:13.901585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe65a71-cbfc-42f2-92c8-8f24b1449860 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:13.902167 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe65a71-cbfc-42f2-92c8-8f24b1449860 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:13.902440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe65a71-cbfc-42f2-92c8-8f24b1449860 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:13.902706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe65a71-cbfc-42f2-92c8-8f24b1449860 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:13.910864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe65a71-cbfc-42f2-92c8-8f24b1449860 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:13.912519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe65a71-cbfc-42f2-92c8-8f24b1449860 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:13.920402 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1098/2209] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:35:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:35:14.233992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88afb9-2ec4-4da0-962e-cc8b702c41e7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:14.234279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88afb9-2ec4-4da0-962e-cc8b702c41e7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:14.234550 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88afb9-2ec4-4da0-962e-cc8b702c41e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:14.241833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:14.255153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0a88afb9-2ec4-4da0-962e-cc8b702c41e7 None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:14.256350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0a88afb9-2ec4-4da0-962e-cc8b702c41e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:14.263516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1112/2210] 10.222.0.15 () {58 vars in 967 bytes} [Sun Aug 7 22:35:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:14.275790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe65a71-cbfc-42f2-92c8-8f24b1449860 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:14.286647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe65a71-cbfc-42f2-92c8-8f24b1449860 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:14.291628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010d6fd-db20-4a45-900c-dddad99c13cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:14.292163 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d6fd-db20-4a45-900c-dddad99c13cc service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:14.292438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d6fd-db20-4a45-900c-dddad99c13cc service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:14.292708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d6fd-db20-4a45-900c-dddad99c13cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:14.301173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010d6fd-db20-4a45-900c-dddad99c13cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:14.302727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010d6fd-db20-4a45-900c-dddad99c13cc service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:14.310501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1099/2211] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:35:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:35:16.381071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88afb9-2ec4-4da0-962e-cc8b702c41e7 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:16.382563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0a88afb9-2ec4-4da0-962e-cc8b702c41e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:16.397252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88afb9-2ec4-4da0-962e-cc8b702c41e7 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:16.401706 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:16.402317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:16.402592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:16.402860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] PATH_INFO: `/v3/users/633624663c31477ab7da365a4ed512e7` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:16.404032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=633624663c31477ab7da365a4ed512e7)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:16.405954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:16.454847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633624663c31477ab7da365a4ed512e7'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:16.462647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633624663c31477ab7da365a4ed512e7'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:16.470474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633624663c31477ab7da365a4ed512e7'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:16.471049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633624663c31477ab7da365a4ed512e7'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:16.484377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633624663c31477ab7da365a4ed512e7'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:16.490240 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1113/2212] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:35:16 2022] DELETE /identity/v3/users/633624663c31477ab7da365a4ed512e7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:16.495415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ceeaf9-63aa-4849-a978-1a8c23bdb5b6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:16.495890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ceeaf9-63aa-4849-a978-1a8c23bdb5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:16.495982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ceeaf9-63aa-4849-a978-1a8c23bdb5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:16.516617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-68ceeaf9-63aa-4849-a978-1a8c23bdb5b6 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:16.517825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-68ceeaf9-63aa-4849-a978-1a8c23bdb5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:16.576094 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1100/2213] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:16.586452 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:16.587890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:16.644901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342693e-1772-40f4-8d29-62ce3fac00d5 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:16.648535 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244d238-dd39-420c-a8a7-ca5edece7061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:16.649141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244d238-dd39-420c-a8a7-ca5edece7061 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:16.649390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244d238-dd39-420c-a8a7-ca5edece7061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:16.649653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244d238-dd39-420c-a8a7-ca5edece7061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:16.659927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244d238-dd39-420c-a8a7-ca5edece7061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:16.661536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244d238-dd39-420c-a8a7-ca5edece7061 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:16.671739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1114/2214] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:35:16.844027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ceeaf9-63aa-4849-a978-1a8c23bdb5b6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:16.845896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-68ceeaf9-63aa-4849-a978-1a8c23bdb5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:16.860090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ceeaf9-63aa-4849-a978-1a8c23bdb5b6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:16.865500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27db3b1-e5ad-47b4-b173-dc58a3e61521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:16.866299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27db3b1-e5ad-47b4-b173-dc58a3e61521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:16.866627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27db3b1-e5ad-47b4-b173-dc58a3e61521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:16.867138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27db3b1-e5ad-47b4-b173-dc58a3e61521 admin admin] PATH_INFO: `/v3/projects/91311b9408a44d32a4a88622e911ee08` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:16.868477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27db3b1-e5ad-47b4-b173-dc58a3e61521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91311b9408a44d32a4a88622e911ee08)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:16.870658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27db3b1-e5ad-47b4-b173-dc58a3e61521 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:16.923077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a27db3b1-e5ad-47b4-b173-dc58a3e61521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91311b9408a44d32a4a88622e911ee08', 'request_id': 'req-a27db3b1-e5ad-47b4-b173-dc58a3e61521'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:16.929837 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a27db3b1-e5ad-47b4-b173-dc58a3e61521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91311b9408a44d32a4a88622e911ee08', 'request_id': 'req-a27db3b1-e5ad-47b4-b173-dc58a3e61521'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:16.936832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a27db3b1-e5ad-47b4-b173-dc58a3e61521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91311b9408a44d32a4a88622e911ee08', 'request_id': 'req-a27db3b1-e5ad-47b4-b173-dc58a3e61521'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:16.949912 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a27db3b1-e5ad-47b4-b173-dc58a3e61521 admin admin] The token cache is being invalidate because project 91311b9408a44d32a4a88622e911ee08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:35:16.950199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a27db3b1-e5ad-47b4-b173-dc58a3e61521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:16.950838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a27db3b1-e5ad-47b4-b173-dc58a3e61521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:35:16.952400 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1101/2215] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:35:16 2022] DELETE /identity/v3/projects/91311b9408a44d32a4a88622e911ee08 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:35:25.694238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb2453-9b78-4b00-9625-48f8990af7f3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:25.694718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb2453-9b78-4b00-9625-48f8990af7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:25.694810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb2453-9b78-4b00-9625-48f8990af7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:25.713061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6dcb2453-9b78-4b00-9625-48f8990af7f3 None None] MFA Rules not processed for user `3602d537105f49bd9e82373943021d31`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:25.714228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6dcb2453-9b78-4b00-9625-48f8990af7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:25.765951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1115/2216] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:35:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:26.946724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:35.759498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=82,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:47.098120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefa334-6f05-435c-8458-c6b7f9f3805f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:47.098793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefa334-6f05-435c-8458-c6b7f9f3805f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:47.098793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefa334-6f05-435c-8458-c6b7f9f3805f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:47.117633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-afefa334-6f05-435c-8458-c6b7f9f3805f None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:35:47.118840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-afefa334-6f05-435c-8458-c6b7f9f3805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:47.177709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1102/2217] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:35:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:35:47.189829 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb2453-9b78-4b00-9625-48f8990af7f3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:35:47.191320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6dcb2453-9b78-4b00-9625-48f8990af7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:35:47.260069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb2453-9b78-4b00-9625-48f8990af7f3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:35:47.264969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8742fb1-f4da-4be9-9f2e-33464dcc513c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:35:47.265564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8742fb1-f4da-4be9-9f2e-33464dcc513c service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:35:47.265840 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8742fb1-f4da-4be9-9f2e-33464dcc513c service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:35:47.266109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8742fb1-f4da-4be9-9f2e-33464dcc513c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:35:47.274376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8742fb1-f4da-4be9-9f2e-33464dcc513c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:35:47.275996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8742fb1-f4da-4be9-9f2e-33464dcc513c service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:35:47.284402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1116/2218] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:35:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:35:57.170712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=25 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:57.280626 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=32 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:36:00.005601 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80478c56-d79a-4090-8910-d8c6de8dd035 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:00.006188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80478c56-d79a-4090-8910-d8c6de8dd035 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:00.007051 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80478c56-d79a-4090-8910-d8c6de8dd035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:00.075509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-80478c56-d79a-4090-8910-d8c6de8dd035 None None] MFA Rules not processed for user `411b1c674ef24c2bab146208d720c0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:00.077655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-80478c56-d79a-4090-8910-d8c6de8dd035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:00.151399 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1103/2219] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:36:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:01.553819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8742fb1-f4da-4be9-9f2e-33464dcc513c service swift] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:01.555889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f8742fb1-f4da-4be9-9f2e-33464dcc513c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:01.645766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8742fb1-f4da-4be9-9f2e-33464dcc513c service swift] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:01.651413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bb1fe-b311-4201-8437-c4bbb3ba258f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db0874a2f443768a9d9842beb2523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:01.652100 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bb1fe-b311-4201-8437-c4bbb3ba258f service placement] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:01.652445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bb1fe-b311-4201-8437-c4bbb3ba258f service placement] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:01.652787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bb1fe-b311-4201-8437-c4bbb3ba258f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:01.654676 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fe3bb1fe-b311-4201-8437-c4bbb3ba258f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:01.670525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bb1fe-b311-4201-8437-c4bbb3ba258f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:01.672336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bb1fe-b311-4201-8437-c4bbb3ba258f service placement] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:01.697299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1117/2220] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:36:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:36:03.753096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a719a3-c6f8-42ab-a28b-d05027e98e26 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:03.753593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a719a3-c6f8-42ab-a28b-d05027e98e26 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:03.753755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a719a3-c6f8-42ab-a28b-d05027e98e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:03.773143 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b2a719a3-c6f8-42ab-a28b-d05027e98e26 None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:03.774264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b2a719a3-c6f8-42ab-a28b-d05027e98e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:03.781932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1104/2221] 10.222.0.15 () {58 vars in 967 bytes} [Sun Aug 7 22:36:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:03.795028 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bb1fe-b311-4201-8437-c4bbb3ba258f service placement] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:03.807417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bb1fe-b311-4201-8437-c4bbb3ba258f service placement] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:03.813243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa3741-2d09-4a33-bf28-3b49b3d7907f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:03.813914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa3741-2d09-4a33-bf28-3b49b3d7907f service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:03.814209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa3741-2d09-4a33-bf28-3b49b3d7907f service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:03.815010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa3741-2d09-4a33-bf28-3b49b3d7907f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:03.823893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa3741-2d09-4a33-bf28-3b49b3d7907f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:03.825518 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa3741-2d09-4a33-bf28-3b49b3d7907f service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:03.833933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1118/2222] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:36:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:36:05.852699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a719a3-c6f8-42ab-a28b-d05027e98e26 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:05.854106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b2a719a3-c6f8-42ab-a28b-d05027e98e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:05.919628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a719a3-c6f8-42ab-a28b-d05027e98e26 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:05.924622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee32a0-6d81-4b5f-ac21-3f6099ae9c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:05.925237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee32a0-6d81-4b5f-ac21-3f6099ae9c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:05.925511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee32a0-6d81-4b5f-ac21-3f6099ae9c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:05.925788 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee32a0-6d81-4b5f-ac21-3f6099ae9c31 admin admin] PATH_INFO: `/v3/users/3602d537105f49bd9e82373943021d31` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:05.926924 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee32a0-6d81-4b5f-ac21-3f6099ae9c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3602d537105f49bd9e82373943021d31)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:05.928870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee32a0-6d81-4b5f-ac21-3f6099ae9c31 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:05.973285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbee32a0-6d81-4b5f-ac21-3f6099ae9c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3602d537105f49bd9e82373943021d31'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:05.980854 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbee32a0-6d81-4b5f-ac21-3f6099ae9c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3602d537105f49bd9e82373943021d31'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:05.981459 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbee32a0-6d81-4b5f-ac21-3f6099ae9c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3602d537105f49bd9e82373943021d31'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:05.982099 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbee32a0-6d81-4b5f-ac21-3f6099ae9c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3602d537105f49bd9e82373943021d31'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:05.996121 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbee32a0-6d81-4b5f-ac21-3f6099ae9c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3602d537105f49bd9e82373943021d31'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:06.009021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1105/2223] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:36:05 2022] DELETE /identity/v3/users/3602d537105f49bd9e82373943021d31 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:36:06.181089 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa3741-2d09-4a33-bf28-3b49b3d7907f service swift] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:06.199249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa3741-2d09-4a33-bf28-3b49b3d7907f service swift] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:06.257079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d292e02-fd5c-4172-b5c6-967e1f7f679c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:06.257699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d292e02-fd5c-4172-b5c6-967e1f7f679c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:06.257975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d292e02-fd5c-4172-b5c6-967e1f7f679c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:06.258273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d292e02-fd5c-4172-b5c6-967e1f7f679c admin admin] PATH_INFO: `/v3/projects/5fcb51863cc04717b646b8baa260ba5f` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:06.259538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d292e02-fd5c-4172-b5c6-967e1f7f679c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fcb51863cc04717b646b8baa260ba5f)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:06.261424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d292e02-fd5c-4172-b5c6-967e1f7f679c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:06.306050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4d292e02-fd5c-4172-b5c6-967e1f7f679c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fcb51863cc04717b646b8baa260ba5f', 'request_id': 'req-4d292e02-fd5c-4172-b5c6-967e1f7f679c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:06.311459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4d292e02-fd5c-4172-b5c6-967e1f7f679c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fcb51863cc04717b646b8baa260ba5f', 'request_id': 'req-4d292e02-fd5c-4172-b5c6-967e1f7f679c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:06.317731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4d292e02-fd5c-4172-b5c6-967e1f7f679c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fcb51863cc04717b646b8baa260ba5f', 'request_id': 'req-4d292e02-fd5c-4172-b5c6-967e1f7f679c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:06.329032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4d292e02-fd5c-4172-b5c6-967e1f7f679c admin admin] The token cache is being invalidate because project 5fcb51863cc04717b646b8baa260ba5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:36:06.329320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4d292e02-fd5c-4172-b5c6-967e1f7f679c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:06.329930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4d292e02-fd5c-4172-b5c6-967e1f7f679c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:06.331454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1119/2224] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:36:06 2022] DELETE /identity/v3/projects/5fcb51863cc04717b646b8baa260ba5f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:36:06.336208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf5c4-b87c-469e-9fd8-407a41ee109b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:06.336489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf5c4-b87c-469e-9fd8-407a41ee109b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:06.336756 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf5c4-b87c-469e-9fd8-407a41ee109b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:06.356664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a6acf5c4-b87c-469e-9fd8-407a41ee109b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:06.357926 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a6acf5c4-b87c-469e-9fd8-407a41ee109b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:06.371546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:36:06.420566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1106/2225] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:06.428927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe11e3c-8aee-4fff-a064-94ef914338bd None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:06.429236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe11e3c-8aee-4fff-a064-94ef914338bd None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:06.429505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe11e3c-8aee-4fff-a064-94ef914338bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:06.443783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:36:06.449646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4fe11e3c-8aee-4fff-a064-94ef914338bd None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:06.451662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4fe11e3c-8aee-4fff-a064-94ef914338bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:06.462118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1120/2226] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:06.466553 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acf5c4-b87c-469e-9fd8-407a41ee109b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:06.478228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acf5c4-b87c-469e-9fd8-407a41ee109b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:06.482921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6424f76-f925-4a69-b7be-66efb7523ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:06.483565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424f76-f925-4a69-b7be-66efb7523ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:06.483838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424f76-f925-4a69-b7be-66efb7523ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:06.484099 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424f76-f925-4a69-b7be-66efb7523ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:06.484733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6424f76-f925-4a69-b7be-66efb7523ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:36:06.485031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6424f76-f925-4a69-b7be-66efb7523ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:06.486663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6424f76-f925-4a69-b7be-66efb7523ac1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:06.498340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1107/2227] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:36:06.502794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe11e3c-8aee-4fff-a064-94ef914338bd None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:06.511899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe11e3c-8aee-4fff-a064-94ef914338bd None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:06.516446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd5d26-1113-4e18-b263-46134b1e815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:06.517023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd5d26-1113-4e18-b263-46134b1e815d admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:06.517303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd5d26-1113-4e18-b263-46134b1e815d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:06.518317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd5d26-1113-4e18-b263-46134b1e815d admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:06.518946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd5d26-1113-4e18-b263-46134b1e815d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:06.520832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd5d26-1113-4e18-b263-46134b1e815d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:06.549319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1121/2228] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:36:06 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:36:06.553771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6424f76-f925-4a69-b7be-66efb7523ac1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:06.563527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6424f76-f925-4a69-b7be-66efb7523ac1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:06.621357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef682cf-ec32-415e-be43-de7578950eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:06.621953 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef682cf-ec32-415e-be43-de7578950eec admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:06.622224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef682cf-ec32-415e-be43-de7578950eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:06.622486 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef682cf-ec32-415e-be43-de7578950eec admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:06.623160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef682cf-ec32-415e-be43-de7578950eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:06.625056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef682cf-ec32-415e-be43-de7578950eec admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:06.646725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1108/2229] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:36:06 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:36:06.650849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd5d26-1113-4e18-b263-46134b1e815d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:06.661703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd5d26-1113-4e18-b263-46134b1e815d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:06.666198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e9e0-dfe3-4ca8-9b9e-299400906d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:06.666777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e9e0-dfe3-4ca8-9b9e-299400906d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:06.667048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e9e0-dfe3-4ca8-9b9e-299400906d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:06.667347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e9e0-dfe3-4ca8-9b9e-299400906d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:06.668030 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17e9e0-dfe3-4ca8-9b9e-299400906d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:06.669769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17e9e0-dfe3-4ca8-9b9e-299400906d96 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:06.679430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1122/2230] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:36:06.683133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef682cf-ec32-415e-be43-de7578950eec admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:06.692965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef682cf-ec32-415e-be43-de7578950eec admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:06.697485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d89801-f722-4fa2-88f4-c277570b9ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:06.698065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d89801-f722-4fa2-88f4-c277570b9ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:06.698341 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d89801-f722-4fa2-88f4-c277570b9ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:06.698609 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d89801-f722-4fa2-88f4-c277570b9ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:06.699280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d89801-f722-4fa2-88f4-c277570b9ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:06.700839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d89801-f722-4fa2-88f4-c277570b9ef0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:06.711689 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1109/2231] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:36:06.715433 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e9e0-dfe3-4ca8-9b9e-299400906d96 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:06.726038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e9e0-dfe3-4ca8-9b9e-299400906d96 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:06.731065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae421c-60d8-43d8-b2fa-9f7e4e242033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:06.731741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae421c-60d8-43d8-b2fa-9f7e4e242033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:06.732019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae421c-60d8-43d8-b2fa-9f7e4e242033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:06.732352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae421c-60d8-43d8-b2fa-9f7e4e242033 admin admin] PATH_INFO: `/v3/projects/97c2abd38b334100b592402e6c2faade/users/b8ba473e0dc54503997232c977601c22/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:06.748138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae421c-60d8-43d8-b2fa-9f7e4e242033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c2abd38b334100b592402e6c2faade, user_id=b8ba473e0dc54503997232c977601c22, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:06.750783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae421c-60d8-43d8-b2fa-9f7e4e242033 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:06.763749 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1123/2232] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:36:06 2022] PUT /identity/v3/projects/97c2abd38b334100b592402e6c2faade/users/b8ba473e0dc54503997232c977601c22/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:36:06.775293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba7167-f1b3-4af9-a9d3-8850a5ff81d8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:06.775575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba7167-f1b3-4af9-a9d3-8850a5ff81d8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:06.775844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba7167-f1b3-4af9-a9d3-8850a5ff81d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:06.804187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fbba7167-f1b3-4af9-a9d3-8850a5ff81d8 None None] MFA Rules not processed for user `b8ba473e0dc54503997232c977601c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:06.805409 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fbba7167-f1b3-4af9-a9d3-8850a5ff81d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:06.869683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1110/2233] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:36:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:06.881491 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae421c-60d8-43d8-b2fa-9f7e4e242033 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:06.883215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a1ae421c-60d8-43d8-b2fa-9f7e4e242033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:06.939059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae421c-60d8-43d8-b2fa-9f7e4e242033 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:06.943239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8adbc-0bd3-4d90-bb94-315f89c73756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:06.943836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8adbc-0bd3-4d90-bb94-315f89c73756 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:06.944112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8adbc-0bd3-4d90-bb94-315f89c73756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:06.944385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8adbc-0bd3-4d90-bb94-315f89c73756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:06.952418 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8adbc-0bd3-4d90-bb94-315f89c73756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:06.953822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8adbc-0bd3-4d90-bb94-315f89c73756 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:06.963097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1124/2234] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:36:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:36:09.134149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6297e0e-ac52-4bf9-8e9f-8355accdc164 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:09.134626 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6297e0e-ac52-4bf9-8e9f-8355accdc164 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:09.134748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6297e0e-ac52-4bf9-8e9f-8355accdc164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:09.154389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a6297e0e-ac52-4bf9-8e9f-8355accdc164 None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:09.155622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a6297e0e-ac52-4bf9-8e9f-8355accdc164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:09.164614 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:36:09.213996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1111/2235] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:36:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:09.226364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8adbc-0bd3-4d90-bb94-315f89c73756 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:09.227918 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-51d8adbc-0bd3-4d90-bb94-315f89c73756 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:09.301385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8adbc-0bd3-4d90-bb94-315f89c73756 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:09.306971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3f5e5-1022-418f-95cd-0bc673bc727a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:09.307610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3f5e5-1022-418f-95cd-0bc673bc727a service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:09.307884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3f5e5-1022-418f-95cd-0bc673bc727a service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:09.308152 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3f5e5-1022-418f-95cd-0bc673bc727a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:09.318342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3f5e5-1022-418f-95cd-0bc673bc727a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:09.320016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3f5e5-1022-418f-95cd-0bc673bc727a service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:09.329027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1125/2236] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:36:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:36:19.206951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=19 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:36:19.325221 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=82,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:36:23.329583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4b8d7-b5a4-4cfe-a59a-cbcfdb8c14bd None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:23.330161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4b8d7-b5a4-4cfe-a59a-cbcfdb8c14bd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:23.330332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4b8d7-b5a4-4cfe-a59a-cbcfdb8c14bd None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:23.331830 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1112/2237] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:36:23.337882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e85ca-ed30-4032-9aaa-1f4210c9fb9d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:23.338322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e85ca-ed30-4032-9aaa-1f4210c9fb9d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:23.338422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e85ca-ed30-4032-9aaa-1f4210c9fb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:23.359645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2a2e85ca-ed30-4032-9aaa-1f4210c9fb9d None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:23.360887 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2a2e85ca-ed30-4032-9aaa-1f4210c9fb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:23.433095 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1126/2238] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:36:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:23.444823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4b8d7-b5a4-4cfe-a59a-cbcfdb8c14bd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:23.446476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-daa4b8d7-b5a4-4cfe-a59a-cbcfdb8c14bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:23.506680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4b8d7-b5a4-4cfe-a59a-cbcfdb8c14bd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:23.510252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486cd50-05f2-4950-9ec6-1a40f8595828 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6639f15880c4c718f41cd84cb79c750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:23.510845 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486cd50-05f2-4950-9ec6-1a40f8595828 service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:23.511141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486cd50-05f2-4950-9ec6-1a40f8595828 service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:23.511411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486cd50-05f2-4950-9ec6-1a40f8595828 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:23.521997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486cd50-05f2-4950-9ec6-1a40f8595828 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:23.523474 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486cd50-05f2-4950-9ec6-1a40f8595828 service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:23.535785 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1113/2239] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:36:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:36:23.604579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74896016-1204-45ba-b005-c18d5ca39e17 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:23.604898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74896016-1204-45ba-b005-c18d5ca39e17 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:23.605155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74896016-1204-45ba-b005-c18d5ca39e17 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:23.606485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1127/2240] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:36:23.611428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c2bd7-29df-472f-a3de-0f0275c4bf5b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:23.611737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c2bd7-29df-472f-a3de-0f0275c4bf5b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:23.612008 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c2bd7-29df-472f-a3de-0f0275c4bf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:23.632166 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-226c2bd7-29df-472f-a3de-0f0275c4bf5b None None] MFA Rules not processed for user `8c68d5fdc4a946499ae86cdff0149470`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:23.633332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-226c2bd7-29df-472f-a3de-0f0275c4bf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:23.684689 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1114/2241] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:36:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:23.697453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74896016-1204-45ba-b005-c18d5ca39e17 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:23.699248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-74896016-1204-45ba-b005-c18d5ca39e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:23.712526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74896016-1204-45ba-b005-c18d5ca39e17 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:23.716052 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b32f6c-7724-4dae-875c-975a7259cba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:23.716638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b32f6c-7724-4dae-875c-975a7259cba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:23.716912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b32f6c-7724-4dae-875c-975a7259cba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:23.717178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b32f6c-7724-4dae-875c-975a7259cba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:23.724269 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b32f6c-7724-4dae-875c-975a7259cba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:23.725681 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b32f6c-7724-4dae-875c-975a7259cba6 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:23.733752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1128/2242] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:36:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:36:23.821821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912dd8f-ddb5-45d8-8c61-a1fc43810fc6 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:23.822175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912dd8f-ddb5-45d8-8c61-a1fc43810fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:23.822606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912dd8f-ddb5-45d8-8c61-a1fc43810fc6 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:23.824180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1115/2243] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:36:23.829592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399cc1b-89a4-43a1-8fc6-8a3a58ec8a5b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:23.829882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399cc1b-89a4-43a1-8fc6-8a3a58ec8a5b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:23.830161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399cc1b-89a4-43a1-8fc6-8a3a58ec8a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:23.849313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3399cc1b-89a4-43a1-8fc6-8a3a58ec8a5b None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:23.850514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3399cc1b-89a4-43a1-8fc6-8a3a58ec8a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:23.862266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1129/2244] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:36:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:23.873175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912dd8f-ddb5-45d8-8c61-a1fc43810fc6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:23.886096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912dd8f-ddb5-45d8-8c61-a1fc43810fc6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:23.890740 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b37edb-1178-414b-a111-5534a74bfb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:23.891666 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b37edb-1178-414b-a111-5534a74bfb81 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:23.892171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b37edb-1178-414b-a111-5534a74bfb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:23.892678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b37edb-1178-414b-a111-5534a74bfb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:23.905663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b37edb-1178-414b-a111-5534a74bfb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:23.907285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b37edb-1178-414b-a111-5534a74bfb81 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:23.919280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1116/2245] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:36:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:36:26.543748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73fac6-6bfd-4533-ae90-00800e70205f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:26.544224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73fac6-6bfd-4533-ae90-00800e70205f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:26.544520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73fac6-6bfd-4533-ae90-00800e70205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:26.565345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ab73fac6-6bfd-4533-ae90-00800e70205f None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:26.566615 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ab73fac6-6bfd-4533-ae90-00800e70205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:26.578784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1130/2246] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:36:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:26.592658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b37edb-1178-414b-a111-5534a74bfb81 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:26.604363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b37edb-1178-414b-a111-5534a74bfb81 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:26.609322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17c1fb-6fde-4341-99c8-655035703778 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:26.609905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17c1fb-6fde-4341-99c8-655035703778 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:26.610180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17c1fb-6fde-4341-99c8-655035703778 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:26.610448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17c1fb-6fde-4341-99c8-655035703778 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:26.618903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17c1fb-6fde-4341-99c8-655035703778 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:26.620520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17c1fb-6fde-4341-99c8-655035703778 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:26.628394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1117/2247] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:36:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:36:36.559473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=43 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:36:36.625172 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=61 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:36:49.935441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73fac6-6bfd-4533-ae90-00800e70205f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:49.998214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73fac6-6bfd-4533-ae90-00800e70205f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:50.002617 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:50.003267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:50.005051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:50.005051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] PATH_INFO: `/v3/users/b8ba473e0dc54503997232c977601c22` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:50.005696 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ba473e0dc54503997232c977601c22)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:50.007631 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:50.052640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ba473e0dc54503997232c977601c22'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:50.059467 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ba473e0dc54503997232c977601c22'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:50.066321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ba473e0dc54503997232c977601c22'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:50.066933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ba473e0dc54503997232c977601c22'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:50.078714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ba473e0dc54503997232c977601c22'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:50.084401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1131/2248] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:36:49 2022] DELETE /identity/v3/users/b8ba473e0dc54503997232c977601c22 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:36:50.089498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fc79f-0557-4f00-b219-1f4e4d20c7dc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:50.090029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fc79f-0557-4f00-b219-1f4e4d20c7dc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:50.090029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fc79f-0557-4f00-b219-1f4e4d20c7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:50.109856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d07fc79f-0557-4f00-b219-1f4e4d20c7dc None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:50.111041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d07fc79f-0557-4f00-b219-1f4e4d20c7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:50.173495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1118/2249] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:50.183489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:50.184927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:50.247528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653fa31-580f-420c-8a62-c15ac5277134 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:50.251273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541848e-dcdf-4c5b-92f2-fe6240d5a9f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:50.251876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541848e-dcdf-4c5b-92f2-fe6240d5a9f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:50.252148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541848e-dcdf-4c5b-92f2-fe6240d5a9f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:50.252420 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541848e-dcdf-4c5b-92f2-fe6240d5a9f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:50.262774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541848e-dcdf-4c5b-92f2-fe6240d5a9f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:50.264219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541848e-dcdf-4c5b-92f2-fe6240d5a9f6 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:50.275236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1132/2250] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:36:50.539524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fc79f-0557-4f00-b219-1f4e4d20c7dc None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:50.541020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d07fc79f-0557-4f00-b219-1f4e4d20c7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:50.553983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fc79f-0557-4f00-b219-1f4e4d20c7dc None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:50.559436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:50.560134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:50.560475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:50.560819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4 admin admin] PATH_INFO: `/v3/projects/97c2abd38b334100b592402e6c2faade` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:50.562042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c2abd38b334100b592402e6c2faade)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:50.563993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:50.612980 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c2abd38b334100b592402e6c2faade', 'request_id': 'req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:50.619657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c2abd38b334100b592402e6c2faade', 'request_id': 'req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:50.625985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c2abd38b334100b592402e6c2faade', 'request_id': 'req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:50.638899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4 admin admin] The token cache is being invalidate because project 97c2abd38b334100b592402e6c2faade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:36:50.639221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:50.639826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-42cc4757-4e9b-4e16-8d25-c87e8caa63e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:36:50.641296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1119/2251] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:36:50 2022] DELETE /identity/v3/projects/97c2abd38b334100b592402e6c2faade => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:36:50.646623 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0378147-1483-4aac-b6d6-26eb34b0ef45 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:50.646901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0378147-1483-4aac-b6d6-26eb34b0ef45 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:50.647251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0378147-1483-4aac-b6d6-26eb34b0ef45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:50.666528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c0378147-1483-4aac-b6d6-26eb34b0ef45 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:50.667758 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c0378147-1483-4aac-b6d6-26eb34b0ef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:50.685850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:36:50.732544 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1133/2252] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:50.740919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9526a5-2a08-407f-9fd8-e758bc1c71f4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:50.741227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9526a5-2a08-407f-9fd8-e758bc1c71f4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:50.741496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9526a5-2a08-407f-9fd8-e758bc1c71f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:50.763156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5f9526a5-2a08-407f-9fd8-e758bc1c71f4 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:50.764378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5f9526a5-2a08-407f-9fd8-e758bc1c71f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:50.776103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1120/2253] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:50.777644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0378147-1483-4aac-b6d6-26eb34b0ef45 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:50.788514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0378147-1483-4aac-b6d6-26eb34b0ef45 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:50.794145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a782a1-3a35-46d7-89ce-a751c0bd8bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:50.795177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a782a1-3a35-46d7-89ce-a751c0bd8bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:50.800090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a782a1-3a35-46d7-89ce-a751c0bd8bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:50.800090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a782a1-3a35-46d7-89ce-a751c0bd8bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:50.800090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a782a1-3a35-46d7-89ce-a751c0bd8bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:36:50.800090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a782a1-3a35-46d7-89ce-a751c0bd8bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:50.800090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a782a1-3a35-46d7-89ce-a751c0bd8bb6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:50.813905 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1134/2254] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:36:50.818169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9526a5-2a08-407f-9fd8-e758bc1c71f4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:50.828864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9526a5-2a08-407f-9fd8-e758bc1c71f4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:50.834127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03bb38-e66f-4d0a-a3f0-bfd5189afc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:50.834897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03bb38-e66f-4d0a-a3f0-bfd5189afc71 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:50.835423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03bb38-e66f-4d0a-a3f0-bfd5189afc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:50.835761 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03bb38-e66f-4d0a-a3f0-bfd5189afc71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:50.836537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03bb38-e66f-4d0a-a3f0-bfd5189afc71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:50.838543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03bb38-e66f-4d0a-a3f0-bfd5189afc71 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:50.876274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a782a1-3a35-46d7-89ce-a751c0bd8bb6 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:50.877973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1121/2255] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:36:50 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:36:50.891260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a782a1-3a35-46d7-89ce-a751c0bd8bb6 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:50.956848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2a441-4add-4783-aa51-9720699cdb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:50.957601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2a441-4add-4783-aa51-9720699cdb79 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:50.957962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2a441-4add-4783-aa51-9720699cdb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:50.958332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2a441-4add-4783-aa51-9720699cdb79 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:50.959048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2a441-4add-4783-aa51-9720699cdb79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:50.961268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2a441-4add-4783-aa51-9720699cdb79 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:50.987008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1135/2256] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:36:50 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:36:50.991049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03bb38-e66f-4d0a-a3f0-bfd5189afc71 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:51.002649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03bb38-e66f-4d0a-a3f0-bfd5189afc71 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:51.011569 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a9913-cdc3-48a3-8cd8-e99e050b8773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:51.012241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a9913-cdc3-48a3-8cd8-e99e050b8773 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:51.012699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a9913-cdc3-48a3-8cd8-e99e050b8773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:51.012905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a9913-cdc3-48a3-8cd8-e99e050b8773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:51.013618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a9913-cdc3-48a3-8cd8-e99e050b8773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:51.015366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a9913-cdc3-48a3-8cd8-e99e050b8773 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:51.026586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1122/2257] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:36:51.030826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2a441-4add-4783-aa51-9720699cdb79 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:51.041622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2a441-4add-4783-aa51-9720699cdb79 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:51.046308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb8cc8-7625-4500-ae38-f2bd2e00fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:51.046905 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8cc8-7625-4500-ae38-f2bd2e00fafd admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:51.047225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8cc8-7625-4500-ae38-f2bd2e00fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:51.047502 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8cc8-7625-4500-ae38-f2bd2e00fafd admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:51.048144 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb8cc8-7625-4500-ae38-f2bd2e00fafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:51.049724 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb8cc8-7625-4500-ae38-f2bd2e00fafd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:51.061367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1136/2258] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:36:51.065901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a9913-cdc3-48a3-8cd8-e99e050b8773 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:51.081107 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a9913-cdc3-48a3-8cd8-e99e050b8773 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:51.085850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fb5ab-48b1-4dc4-a319-8a224dfa7027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:51.086544 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fb5ab-48b1-4dc4-a319-8a224dfa7027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:51.086821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fb5ab-48b1-4dc4-a319-8a224dfa7027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:51.087112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fb5ab-48b1-4dc4-a319-8a224dfa7027 admin admin] PATH_INFO: `/v3/projects/cf6f8629fd764dcf9554661162b2c4a3/users/1648bd2e192348f585eb3d9c34f7d1de/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:51.103275 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fb5ab-48b1-4dc4-a319-8a224dfa7027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6f8629fd764dcf9554661162b2c4a3, user_id=1648bd2e192348f585eb3d9c34f7d1de, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:51.106089 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fb5ab-48b1-4dc4-a319-8a224dfa7027 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:51.120693 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1123/2259] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:36:51 2022] PUT /identity/v3/projects/cf6f8629fd764dcf9554661162b2c4a3/users/1648bd2e192348f585eb3d9c34f7d1de/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:36:51.125669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24eacb-b89b-4ef0-8a54-5db1dd5fb620 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:51.125962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24eacb-b89b-4ef0-8a54-5db1dd5fb620 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:51.126254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24eacb-b89b-4ef0-8a54-5db1dd5fb620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:51.147207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3c24eacb-b89b-4ef0-8a54-5db1dd5fb620 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:51.148375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3c24eacb-b89b-4ef0-8a54-5db1dd5fb620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:51.216739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1137/2260] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:36:51.226490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fb5ab-48b1-4dc4-a319-8a224dfa7027 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:51.229120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cc5fb5ab-48b1-4dc4-a319-8a224dfa7027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:51.264952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:36:51.308553 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fb5ab-48b1-4dc4-a319-8a224dfa7027 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:51.312966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeb6ec-522e-47cf-863c-dcd4bbe03435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:51.313942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeb6ec-522e-47cf-863c-dcd4bbe03435 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:51.314700 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeb6ec-522e-47cf-863c-dcd4bbe03435 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:51.315550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeb6ec-522e-47cf-863c-dcd4bbe03435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:51.343701 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eeb6ec-522e-47cf-863c-dcd4bbe03435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:51.345164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eeb6ec-522e-47cf-863c-dcd4bbe03435 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:51.360243 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1124/2261] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:36:54.445605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a02e0d-4d34-42e2-a88e-bdbabdbe0c20 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:54.447537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a02e0d-4d34-42e2-a88e-bdbabdbe0c20 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:54.447537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a02e0d-4d34-42e2-a88e-bdbabdbe0c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:54.468531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-28a02e0d-4d34-42e2-a88e-bdbabdbe0c20 None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:54.469850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-28a02e0d-4d34-42e2-a88e-bdbabdbe0c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:54.498610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:36:54.546312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1138/2262] 10.222.0.15 () {58 vars in 967 bytes} [Sun Aug 7 22:36:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:54.559663 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeb6ec-522e-47cf-863c-dcd4bbe03435 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:54.561077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-59eeb6ec-522e-47cf-863c-dcd4bbe03435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:54.647965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeb6ec-522e-47cf-863c-dcd4bbe03435 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:54.656073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5ce92-83af-4669-9586-f452a9e0d2d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:54.656956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5ce92-83af-4669-9586-f452a9e0d2d2 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:54.657401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5ce92-83af-4669-9586-f452a9e0d2d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:54.657827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5ce92-83af-4669-9586-f452a9e0d2d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:54.668272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5ce92-83af-4669-9586-f452a9e0d2d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:54.670050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5ce92-83af-4669-9586-f452a9e0d2d2 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:54.679348 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1125/2263] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:36:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:36:55.922069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a43b1-e091-4131-ac0b-6e9c5841e06a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:55.922528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a43b1-e091-4131-ac0b-6e9c5841e06a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:55.922664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a43b1-e091-4131-ac0b-6e9c5841e06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:55.978282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7c3a43b1-e091-4131-ac0b-6e9c5841e06a None None] MFA Rules not processed for user `1648bd2e192348f585eb3d9c34f7d1de`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:36:55.979640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7c3a43b1-e091-4131-ac0b-6e9c5841e06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:36:56.080280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1139/2264] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:36:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:36:56.084847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5ce92-83af-4669-9586-f452a9e0d2d2 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:56.100514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5ce92-83af-4669-9586-f452a9e0d2d2 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:56.107979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f33ef-31b3-401d-a1c7-0e86eca63b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:56.109189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f33ef-31b3-401d-a1c7-0e86eca63b4b admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:56.109632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f33ef-31b3-401d-a1c7-0e86eca63b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:56.110377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f33ef-31b3-401d-a1c7-0e86eca63b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:56.111354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f33ef-31b3-401d-a1c7-0e86eca63b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:56.113501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f33ef-31b3-401d-a1c7-0e86eca63b4b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:56.152624 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1126/2265] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:36:56 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:36:56.156862 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a43b1-e091-4131-ac0b-6e9c5841e06a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:56.170388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a43b1-e091-4131-ac0b-6e9c5841e06a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:56.270355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a163fb7-9ced-4b0e-9123-34369c156fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:56.271207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a163fb7-9ced-4b0e-9123-34369c156fed admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:56.271630 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a163fb7-9ced-4b0e-9123-34369c156fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:56.272073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a163fb7-9ced-4b0e-9123-34369c156fed admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:56.272860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a163fb7-9ced-4b0e-9123-34369c156fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:56.275071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a163fb7-9ced-4b0e-9123-34369c156fed admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:56.299585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1140/2266] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:36:56 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:36:56.306168 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f33ef-31b3-401d-a1c7-0e86eca63b4b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:56.320205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f33ef-31b3-401d-a1c7-0e86eca63b4b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:56.325220 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc00fa-19c6-402d-a7cc-f8609d0e978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:56.325836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc00fa-19c6-402d-a7cc-f8609d0e978f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:56.326111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc00fa-19c6-402d-a7cc-f8609d0e978f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:56.326385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc00fa-19c6-402d-a7cc-f8609d0e978f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:56.328110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc00fa-19c6-402d-a7cc-f8609d0e978f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:56.329905 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc00fa-19c6-402d-a7cc-f8609d0e978f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:56.344501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1127/2267] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:36:56.346085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a163fb7-9ced-4b0e-9123-34369c156fed admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:56.357005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a163fb7-9ced-4b0e-9123-34369c156fed admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:56.364343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db645408-6d7b-42e3-a298-aa3b538911a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:56.365112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db645408-6d7b-42e3-a298-aa3b538911a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:56.365978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db645408-6d7b-42e3-a298-aa3b538911a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:56.365978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db645408-6d7b-42e3-a298-aa3b538911a9 admin admin] PATH_INFO: `/v3/projects/32ce7ea4ef7d46898b148e15b22299f3/users/de3d937b838a4679b764d576107a84b0/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:56.383785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db645408-6d7b-42e3-a298-aa3b538911a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ce7ea4ef7d46898b148e15b22299f3, user_id=de3d937b838a4679b764d576107a84b0, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:56.387510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db645408-6d7b-42e3-a298-aa3b538911a9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:56.405682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1141/2268] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:36:56 2022] PUT /identity/v3/projects/32ce7ea4ef7d46898b148e15b22299f3/users/de3d937b838a4679b764d576107a84b0/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:36:56.409735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc00fa-19c6-402d-a7cc-f8609d0e978f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:56.425013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc00fa-19c6-402d-a7cc-f8609d0e978f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:56.518304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e177d19-e3f1-4d56-8b32-25cbcecc8802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:56.518853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177d19-e3f1-4d56-8b32-25cbcecc8802 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:56.519184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177d19-e3f1-4d56-8b32-25cbcecc8802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:56.519462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177d19-e3f1-4d56-8b32-25cbcecc8802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:56.520497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e177d19-e3f1-4d56-8b32-25cbcecc8802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:56.522293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e177d19-e3f1-4d56-8b32-25cbcecc8802 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:56.533725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1128/2269] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:36:56.537803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db645408-6d7b-42e3-a298-aa3b538911a9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:36:56.550145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db645408-6d7b-42e3-a298-aa3b538911a9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:36:56.563740 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f4a85-eea0-4f48-a5a5-105d6f6bf22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:36:56.565103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f4a85-eea0-4f48-a5a5-105d6f6bf22b admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:36:56.565444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f4a85-eea0-4f48-a5a5-105d6f6bf22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:36:56.565784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f4a85-eea0-4f48-a5a5-105d6f6bf22b admin admin] PATH_INFO: `/v3/projects/32ce7ea4ef7d46898b148e15b22299f3/users/de3d937b838a4679b764d576107a84b0/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:36:56.573649 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f4a85-eea0-4f48-a5a5-105d6f6bf22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ce7ea4ef7d46898b148e15b22299f3, user_id=de3d937b838a4679b764d576107a84b0, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:36:56.577940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f4a85-eea0-4f48-a5a5-105d6f6bf22b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:36:56.599817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1142/2270] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:36:56 2022] PUT /identity/v3/projects/32ce7ea4ef7d46898b148e15b22299f3/users/de3d937b838a4679b764d576107a84b0/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:37:00.861062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d699b-acdb-4fbd-aa77-8dfbb99cf5ee None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:37:00.861530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d699b-acdb-4fbd-aa77-8dfbb99cf5ee None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:37:00.861650 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d699b-acdb-4fbd-aa77-8dfbb99cf5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:37:00.891208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9a2d699b-acdb-4fbd-aa77-8dfbb99cf5ee None None] MFA Rules not processed for user `de3d937b838a4679b764d576107a84b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:37:00.892344 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9a2d699b-acdb-4fbd-aa77-8dfbb99cf5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:37:00.896650 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:00.967526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1129/2271] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:37:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:37:00.981653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f4a85-eea0-4f48-a5a5-105d6f6bf22b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:37:00.983538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-629f4a85-eea0-4f48-a5a5-105d6f6bf22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:37:01.005829 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:01.065344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f4a85-eea0-4f48-a5a5-105d6f6bf22b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:37:01.070964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7373c9-4b02-4652-a7cf-0789e1589224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:37:01.071601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7373c9-4b02-4652-a7cf-0789e1589224 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:37:01.071880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7373c9-4b02-4652-a7cf-0789e1589224 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:37:01.072148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7373c9-4b02-4652-a7cf-0789e1589224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:37:01.128402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7373c9-4b02-4652-a7cf-0789e1589224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:37:01.129983 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7373c9-4b02-4652-a7cf-0789e1589224 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:37:01.139425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1143/2272] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:37:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:37:02.222991 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a71655-af45-4f45-8e2d-40f16bed9ae2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:37:02.223456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a71655-af45-4f45-8e2d-40f16bed9ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:37:02.223816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a71655-af45-4f45-8e2d-40f16bed9ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:37:02.246369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-36a71655-af45-4f45-8e2d-40f16bed9ae2 None None] MFA Rules not processed for user `1648bd2e192348f585eb3d9c34f7d1de`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:37:02.248200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-36a71655-af45-4f45-8e2d-40f16bed9ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:37:02.268418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1130/2273] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:37:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:37:11.135539 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=49 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:12.251777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=30 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:19.321048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46510c2-0985-4531-8ba3-b60aa003403b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:37:19.321555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46510c2-0985-4531-8ba3-b60aa003403b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:37:19.321696 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46510c2-0985-4531-8ba3-b60aa003403b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:37:19.340757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c46510c2-0985-4531-8ba3-b60aa003403b None None] MFA Rules not processed for user `ccb8ac5aaec44417bd6aaa4a2b1aca11`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:37:19.341926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c46510c2-0985-4531-8ba3-b60aa003403b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:37:19.396432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1144/2274] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:37:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:37:29.389619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=25 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:37.122591 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a71655-af45-4f45-8e2d-40f16bed9ae2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:37:37.124162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-36a71655-af45-4f45-8e2d-40f16bed9ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:37:37.179376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a71655-af45-4f45-8e2d-40f16bed9ae2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:37:37.182911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6cbcf-3acc-4139-a7f7-ad15109f62e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:37:37.183529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6cbcf-3acc-4139-a7f7-ad15109f62e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:37:37.183805 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6cbcf-3acc-4139-a7f7-ad15109f62e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:37:37.184072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6cbcf-3acc-4139-a7f7-ad15109f62e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:37:37.192990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6cbcf-3acc-4139-a7f7-ad15109f62e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:37:37.194401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6cbcf-3acc-4139-a7f7-ad15109f62e0 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:37:37.203632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1131/2275] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:37:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:37:47.199458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=26 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:48.607586 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46510c2-0985-4531-8ba3-b60aa003403b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:37:48.617407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46510c2-0985-4531-8ba3-b60aa003403b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:37:48.621062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea40c43-63e9-470e-a730-a19a3f8eb995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:37:48.621674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea40c43-63e9-470e-a730-a19a3f8eb995 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:37:48.621935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea40c43-63e9-470e-a730-a19a3f8eb995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:37:48.622204 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea40c43-63e9-470e-a730-a19a3f8eb995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:37:48.623958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3ea40c43-63e9-470e-a730-a19a3f8eb995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:37:48.637175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea40c43-63e9-470e-a730-a19a3f8eb995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:37:48.638579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea40c43-63e9-470e-a730-a19a3f8eb995 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:37:48.650926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1145/2276] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:37:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:37:53.271628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6cbcf-3acc-4139-a7f7-ad15109f62e0 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:37:53.280480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6cbcf-3acc-4139-a7f7-ad15109f62e0 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:37:53.284228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717989e-25d8-4a87-9ebd-e1c9692c9c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:37:53.284872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717989e-25d8-4a87-9ebd-e1c9692c9c2c service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:37:53.285151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717989e-25d8-4a87-9ebd-e1c9692c9c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:37:53.285418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717989e-25d8-4a87-9ebd-e1c9692c9c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:37:53.287177 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2717989e-25d8-4a87-9ebd-e1c9692c9c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:37:53.300771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717989e-25d8-4a87-9ebd-e1c9692c9c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:37:53.302177 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717989e-25d8-4a87-9ebd-e1c9692c9c2c service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:37:53.313492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1132/2277] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:37:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:37:58.645707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=6 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:59.854433 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60056d19-7b49-4d29-a4b2-633c1daf9911 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:37:59.855046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60056d19-7b49-4d29-a4b2-633c1daf9911 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:37:59.855046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60056d19-7b49-4d29-a4b2-633c1daf9911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:37:59.873672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-60056d19-7b49-4d29-a4b2-633c1daf9911 None None] MFA Rules not processed for user `411b1c674ef24c2bab146208d720c0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:37:59.874859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-60056d19-7b49-4d29-a4b2-633c1daf9911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:37:59.927981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1146/2278] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:37:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:38:03.308843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:03.683395 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717989e-25d8-4a87-9ebd-e1c9692c9c2c service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:03.694394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717989e-25d8-4a87-9ebd-e1c9692c9c2c service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:03.699839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d413a21-867b-491d-a32e-e53c8ce125c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:03.700427 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d413a21-867b-491d-a32e-e53c8ce125c2 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:03.700699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d413a21-867b-491d-a32e-e53c8ce125c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:03.700963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d413a21-867b-491d-a32e-e53c8ce125c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:03.704010 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4d413a21-867b-491d-a32e-e53c8ce125c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:03.768008 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d413a21-867b-491d-a32e-e53c8ce125c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:03.769630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d413a21-867b-491d-a32e-e53c8ce125c2 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:03.781277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1133/2279] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:38:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:38:07.692649 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60056d19-7b49-4d29-a4b2-633c1daf9911 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:07.694184 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-60056d19-7b49-4d29-a4b2-633c1daf9911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:07.710629 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60056d19-7b49-4d29-a4b2-633c1daf9911 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:07.716055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd4ad-4677-4d5b-b391-d6ecab24ef6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:07.717169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd4ad-4677-4d5b-b391-d6ecab24ef6b service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:07.717445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd4ad-4677-4d5b-b391-d6ecab24ef6b service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:07.717713 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd4ad-4677-4d5b-b391-d6ecab24ef6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:07.719410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-28fdd4ad-4677-4d5b-b391-d6ecab24ef6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:07.730330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdd4ad-4677-4d5b-b391-d6ecab24ef6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:07.732018 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdd4ad-4677-4d5b-b391-d6ecab24ef6b service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:07.741661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1147/2280] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:38:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:38:13.775451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=28 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:15.295398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a887-a26b-44bb-a35c-a8c1d7b80095 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:15.295997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a887-a26b-44bb-a35c-a8c1d7b80095 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:15.295997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a887-a26b-44bb-a35c-a8c1d7b80095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:15.315285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9105a887-a26b-44bb-a35c-a8c1d7b80095 None None] MFA Rules not processed for user `aff5308e6cb94622853075a723d54a67`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:38:15.316518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9105a887-a26b-44bb-a35c-a8c1d7b80095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:15.324100 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1134/2281] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:38:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:38:15.638754 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd4ad-4677-4d5b-b391-d6ecab24ef6b service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:15.648035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd4ad-4677-4d5b-b391-d6ecab24ef6b service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:15.652067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6f62b-0409-4e6d-b6e2-7ce48b8bb4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:15.652657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6f62b-0409-4e6d-b6e2-7ce48b8bb4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:15.652932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6f62b-0409-4e6d-b6e2-7ce48b8bb4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:15.653198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6f62b-0409-4e6d-b6e2-7ce48b8bb4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:15.654903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e1f6f62b-0409-4e6d-b6e2-7ce48b8bb4d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:15.664383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6f62b-0409-4e6d-b6e2-7ce48b8bb4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:15.666285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6f62b-0409-4e6d-b6e2-7ce48b8bb4d3 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:15.674017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1148/2282] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:38:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:38:15.980490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105a887-a26b-44bb-a35c-a8c1d7b80095 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:15.981918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9105a887-a26b-44bb-a35c-a8c1d7b80095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:16.060860 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105a887-a26b-44bb-a35c-a8c1d7b80095 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:16.065891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09798b8c-e7b3-4cbb-9f9c-d1f5d48829f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db0874a2f443768a9d9842beb2523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:16.066494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09798b8c-e7b3-4cbb-9f9c-d1f5d48829f5 service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:16.066770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09798b8c-e7b3-4cbb-9f9c-d1f5d48829f5 service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:16.067037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09798b8c-e7b3-4cbb-9f9c-d1f5d48829f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:16.068841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-09798b8c-e7b3-4cbb-9f9c-d1f5d48829f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:16.080658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09798b8c-e7b3-4cbb-9f9c-d1f5d48829f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:16.082233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09798b8c-e7b3-4cbb-9f9c-d1f5d48829f5 service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:16.092528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1135/2283] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:38:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:38:21.558576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6f62b-0409-4e6d-b6e2-7ce48b8bb4d3 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:21.567164 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6f62b-0409-4e6d-b6e2-7ce48b8bb4d3 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:21.570733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d68485-3278-401a-814a-4d1745ea1f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:21.572016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d68485-3278-401a-814a-4d1745ea1f80 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:21.572293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d68485-3278-401a-814a-4d1745ea1f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:21.572559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d68485-3278-401a-814a-4d1745ea1f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:21.574226 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a1d68485-3278-401a-814a-4d1745ea1f80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:21.583533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d68485-3278-401a-814a-4d1745ea1f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:21.584920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d68485-3278-401a-814a-4d1745ea1f80 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:21.592735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1149/2284] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:38:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:38:26.088403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=35 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:31.514835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09798b8c-e7b3-4cbb-9f9c-d1f5d48829f5 service placement] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:31.516336 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-09798b8c-e7b3-4cbb-9f9c-d1f5d48829f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:31.571465 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09798b8c-e7b3-4cbb-9f9c-d1f5d48829f5 service placement] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:31.575526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded66d69-c31f-4240-aefa-302d897ac2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:31.576138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66d69-c31f-4240-aefa-302d897ac2db service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:31.576410 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66d69-c31f-4240-aefa-302d897ac2db service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:31.576675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66d69-c31f-4240-aefa-302d897ac2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:31.578385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ded66d69-c31f-4240-aefa-302d897ac2db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:31.589185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=43 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:31.589620 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded66d69-c31f-4240-aefa-302d897ac2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:31.591045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded66d69-c31f-4240-aefa-302d897ac2db service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:31.600261 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1136/2285] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:38:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:38:37.961144 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d68485-3278-401a-814a-4d1745ea1f80 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:37.979897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d68485-3278-401a-814a-4d1745ea1f80 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:37.987773 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3c849-3791-4962-9b5a-1f7d36120c7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:37.988585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3c849-3791-4962-9b5a-1f7d36120c7a service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:37.989010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3c849-3791-4962-9b5a-1f7d36120c7a service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:37.989534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3c849-3791-4962-9b5a-1f7d36120c7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:37.992036 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-30c3c849-3791-4962-9b5a-1f7d36120c7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:38.008033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3c849-3791-4962-9b5a-1f7d36120c7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:38.009824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3c849-3791-4962-9b5a-1f7d36120c7a service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:38.026156 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1150/2286] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:38:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:38:41.596019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=26 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:48.020117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=6 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:51.536652 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded66d69-c31f-4240-aefa-302d897ac2db service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:51.546434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded66d69-c31f-4240-aefa-302d897ac2db service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:51.549940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56932675-936e-4029-b5b7-c3fefde5af3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:51.550518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56932675-936e-4029-b5b7-c3fefde5af3f service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:51.550790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56932675-936e-4029-b5b7-c3fefde5af3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:51.551058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56932675-936e-4029-b5b7-c3fefde5af3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:51.552761 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-56932675-936e-4029-b5b7-c3fefde5af3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:51.615229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56932675-936e-4029-b5b7-c3fefde5af3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:51.616659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56932675-936e-4029-b5b7-c3fefde5af3f service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:51.626076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1137/2287] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:38:52.627532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3c849-3791-4962-9b5a-1f7d36120c7a service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:52.629616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-30c3c849-3791-4962-9b5a-1f7d36120c7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:52.641765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3c849-3791-4962-9b5a-1f7d36120c7a service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:52.645873 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1384526-01b7-48d3-8230-6af285999eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:52.646490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1384526-01b7-48d3-8230-6af285999eda service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:52.646767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1384526-01b7-48d3-8230-6af285999eda service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:52.647035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1384526-01b7-48d3-8230-6af285999eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:52.648878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a1384526-01b7-48d3-8230-6af285999eda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:52.718121 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1384526-01b7-48d3-8230-6af285999eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:52.719858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1384526-01b7-48d3-8230-6af285999eda service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:52.728962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1151/2288] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:38:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:38:54.994672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28003da-d066-454e-9772-4068153c6aca None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:54.995235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28003da-d066-454e-9772-4068153c6aca None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:54.995235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28003da-d066-454e-9772-4068153c6aca None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:54.996628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1138/2289] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:38:55.029891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe47214-e0b0-4725-88ad-ca4d87918e41 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:55.030423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe47214-e0b0-4725-88ad-ca4d87918e41 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:55.030423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe47214-e0b0-4725-88ad-ca4d87918e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:55.052923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-efe47214-e0b0-4725-88ad-ca4d87918e41 None None] MFA Rules not processed for user `90db0874a2f443768a9d9842beb2523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:38:55.054140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-efe47214-e0b0-4725-88ad-ca4d87918e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:55.064693 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1152/2290] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:38:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:38:55.093878 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28003da-d066-454e-9772-4068153c6aca None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:55.107588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28003da-d066-454e-9772-4068153c6aca None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:55.112637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a19dc8-1718-43cc-992d-0e53f84b3d08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db0874a2f443768a9d9842beb2523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:55.113230 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a19dc8-1718-43cc-992d-0e53f84b3d08 service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:55.113501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a19dc8-1718-43cc-992d-0e53f84b3d08 service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:55.113768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a19dc8-1718-43cc-992d-0e53f84b3d08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:55.123693 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a19dc8-1718-43cc-992d-0e53f84b3d08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:55.125310 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a19dc8-1718-43cc-992d-0e53f84b3d08 service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:55.136682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1139/2291] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:38:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:38:55.149787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe47214-e0b0-4725-88ad-ca4d87918e41 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:55.151688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-efe47214-e0b0-4725-88ad-ca4d87918e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:55.175305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe47214-e0b0-4725-88ad-ca4d87918e41 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:55.179998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9383023-56c8-4c61-a529-85b9f397a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:55.180623 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9383023-56c8-4c61-a529-85b9f397a27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:55.181023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9383023-56c8-4c61-a529-85b9f397a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:55.181290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9383023-56c8-4c61-a529-85b9f397a27e admin admin] PATH_INFO: `/v3/users/ccb8ac5aaec44417bd6aaa4a2b1aca11` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:55.182949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9383023-56c8-4c61-a529-85b9f397a27e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccb8ac5aaec44417bd6aaa4a2b1aca11)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:55.184920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9383023-56c8-4c61-a529-85b9f397a27e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:55.231789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c9383023-56c8-4c61-a529-85b9f397a27e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccb8ac5aaec44417bd6aaa4a2b1aca11'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:38:55.238734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c9383023-56c8-4c61-a529-85b9f397a27e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccb8ac5aaec44417bd6aaa4a2b1aca11'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:38:55.247497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c9383023-56c8-4c61-a529-85b9f397a27e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccb8ac5aaec44417bd6aaa4a2b1aca11'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:38:55.248193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c9383023-56c8-4c61-a529-85b9f397a27e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccb8ac5aaec44417bd6aaa4a2b1aca11'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:38:55.262007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c9383023-56c8-4c61-a529-85b9f397a27e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccb8ac5aaec44417bd6aaa4a2b1aca11'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:38:55.268091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1153/2292] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:38:55 2022] DELETE /identity/v3/users/ccb8ac5aaec44417bd6aaa4a2b1aca11 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:38:55.448464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a19dc8-1718-43cc-992d-0e53f84b3d08 service placement] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:55.459934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a19dc8-1718-43cc-992d-0e53f84b3d08 service placement] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:55.522098 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:55.522723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:55.522999 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:55.523302 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073 admin admin] PATH_INFO: `/v3/projects/01db52a9d53f4540aafa5b2db7b693c8` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:55.524417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01db52a9d53f4540aafa5b2db7b693c8)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:55.526661 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:55.575288 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01db52a9d53f4540aafa5b2db7b693c8', 'request_id': 'req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:38:55.580978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01db52a9d53f4540aafa5b2db7b693c8', 'request_id': 'req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:38:55.587149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01db52a9d53f4540aafa5b2db7b693c8', 'request_id': 'req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:38:55.604911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073 admin admin] The token cache is being invalidate because project 01db52a9d53f4540aafa5b2db7b693c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:38:55.605180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:38:55.605843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8dcc03e0-9f9c-47f3-a9c8-1e7add69a073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:38:55.610898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1140/2293] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:38:55 2022] DELETE /identity/v3/projects/01db52a9d53f4540aafa5b2db7b693c8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:38:55.612596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbaba5-c2bf-41bd-b57c-1ec32f914351 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:55.613404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbaba5-c2bf-41bd-b57c-1ec32f914351 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:55.614007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbaba5-c2bf-41bd-b57c-1ec32f914351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:55.637634 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-33fbaba5-c2bf-41bd-b57c-1ec32f914351 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:38:55.639167 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-33fbaba5-c2bf-41bd-b57c-1ec32f914351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:55.706934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1154/2294] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:38:55.717016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad3017-315b-4e37-b82e-ac0067f18ff9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:55.717303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad3017-315b-4e37-b82e-ac0067f18ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:55.717604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad3017-315b-4e37-b82e-ac0067f18ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:55.739734 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-24ad3017-315b-4e37-b82e-ac0067f18ff9 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:38:55.740965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-24ad3017-315b-4e37-b82e-ac0067f18ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:55.750281 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1141/2295] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:38:55.754552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbaba5-c2bf-41bd-b57c-1ec32f914351 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:55.760862 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:55.765942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbaba5-c2bf-41bd-b57c-1ec32f914351 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:55.774885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10199b-9c4f-4aab-94aa-c0dd5567fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:55.775883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10199b-9c4f-4aab-94aa-c0dd5567fb26 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:55.777719 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10199b-9c4f-4aab-94aa-c0dd5567fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:55.778078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10199b-9c4f-4aab-94aa-c0dd5567fb26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:55.779383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10199b-9c4f-4aab-94aa-c0dd5567fb26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:38:55.779799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10199b-9c4f-4aab-94aa-c0dd5567fb26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:55.783905 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10199b-9c4f-4aab-94aa-c0dd5567fb26 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:55.800835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1155/2296] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:38:55.802344 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad3017-315b-4e37-b82e-ac0067f18ff9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:55.809525 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:55.814259 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad3017-315b-4e37-b82e-ac0067f18ff9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:55.821041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb374ed-44fa-4f51-87c5-109e09b1c6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:55.822144 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb374ed-44fa-4f51-87c5-109e09b1c6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:55.822998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb374ed-44fa-4f51-87c5-109e09b1c6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:55.823615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb374ed-44fa-4f51-87c5-109e09b1c6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:55.824584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb374ed-44fa-4f51-87c5-109e09b1c6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:55.827325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb374ed-44fa-4f51-87c5-109e09b1c6e1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:55.873257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1142/2297] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:38:55 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:38:55.877601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10199b-9c4f-4aab-94aa-c0dd5567fb26 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:55.887849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10199b-9c4f-4aab-94aa-c0dd5567fb26 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:56.000354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d86058-1f0d-48f9-89b9-e9c70e259b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:56.001211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d86058-1f0d-48f9-89b9-e9c70e259b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.001564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d86058-1f0d-48f9-89b9-e9c70e259b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.001912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d86058-1f0d-48f9-89b9-e9c70e259b77 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.002692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d86058-1f0d-48f9-89b9-e9c70e259b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:56.004894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d86058-1f0d-48f9-89b9-e9c70e259b77 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:56.033860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1156/2298] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:38:55 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:38:56.037593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb374ed-44fa-4f51-87c5-109e09b1c6e1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:56.054009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb374ed-44fa-4f51-87c5-109e09b1c6e1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:56.059504 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa336798-ecce-4df1-9b17-ce840c2f93e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:56.060207 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa336798-ecce-4df1-9b17-ce840c2f93e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.060515 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa336798-ecce-4df1-9b17-ce840c2f93e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.060789 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa336798-ecce-4df1-9b17-ce840c2f93e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.061439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa336798-ecce-4df1-9b17-ce840c2f93e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:56.063270 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa336798-ecce-4df1-9b17-ce840c2f93e9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:56.078216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1143/2299] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:38:56.080203 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d86058-1f0d-48f9-89b9-e9c70e259b77 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:56.091878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d86058-1f0d-48f9-89b9-e9c70e259b77 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:56.097222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc821a-30fc-4465-9a11-45e22c3e568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:56.098155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc821a-30fc-4465-9a11-45e22c3e568d admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.098617 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc821a-30fc-4465-9a11-45e22c3e568d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.099118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc821a-30fc-4465-9a11-45e22c3e568d admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.100064 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc821a-30fc-4465-9a11-45e22c3e568d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:56.101859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc821a-30fc-4465-9a11-45e22c3e568d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:56.123702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1157/2300] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:38:56.127418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa336798-ecce-4df1-9b17-ce840c2f93e9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:56.141644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa336798-ecce-4df1-9b17-ce840c2f93e9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:56.147664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb84fb-54d9-4c89-bf1f-4e6d6fb131e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:56.148887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb84fb-54d9-4c89-bf1f-4e6d6fb131e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.149583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb84fb-54d9-4c89-bf1f-4e6d6fb131e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.149583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb84fb-54d9-4c89-bf1f-4e6d6fb131e9 admin admin] PATH_INFO: `/v3/projects/13a5b26017ad4b1a85c3f726fed62cb8/users/6468ed4b265b4bbda587024b128e4831/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.171102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb84fb-54d9-4c89-bf1f-4e6d6fb131e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a5b26017ad4b1a85c3f726fed62cb8, user_id=6468ed4b265b4bbda587024b128e4831, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:56.173817 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb84fb-54d9-4c89-bf1f-4e6d6fb131e9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:56.188533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1144/2301] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:38:56 2022] PUT /identity/v3/projects/13a5b26017ad4b1a85c3f726fed62cb8/users/6468ed4b265b4bbda587024b128e4831/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:38:56.199139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41184791-1ae1-4246-95d3-b250f752a7e5 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.199428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41184791-1ae1-4246-95d3-b250f752a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.199705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41184791-1ae1-4246-95d3-b250f752a7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.227725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-41184791-1ae1-4246-95d3-b250f752a7e5 None None] MFA Rules not processed for user `6468ed4b265b4bbda587024b128e4831`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:38:56.228845 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-41184791-1ae1-4246-95d3-b250f752a7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:56.293385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1158/2302] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:38:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:38:56.298107 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb84fb-54d9-4c89-bf1f-4e6d6fb131e9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:56.362091 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb84fb-54d9-4c89-bf1f-4e6d6fb131e9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:56.367011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630383a-5821-4eab-b4e7-799b71ed7206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:56.367641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630383a-5821-4eab-b4e7-799b71ed7206 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.367923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630383a-5821-4eab-b4e7-799b71ed7206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.368325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630383a-5821-4eab-b4e7-799b71ed7206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.368956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630383a-5821-4eab-b4e7-799b71ed7206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:56.371165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630383a-5821-4eab-b4e7-799b71ed7206 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:56.399944 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1145/2303] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:38:56 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:38:56.404875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41184791-1ae1-4246-95d3-b250f752a7e5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:56.416106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41184791-1ae1-4246-95d3-b250f752a7e5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:56.480546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58773b4f-a588-4c2a-b08b-c8e596a99f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:56.481173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58773b4f-a588-4c2a-b08b-c8e596a99f5e admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.481453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58773b4f-a588-4c2a-b08b-c8e596a99f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.481724 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58773b4f-a588-4c2a-b08b-c8e596a99f5e admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.482344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58773b4f-a588-4c2a-b08b-c8e596a99f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:56.484305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58773b4f-a588-4c2a-b08b-c8e596a99f5e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:56.492635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:56.512660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1159/2304] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:38:56 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:38:56.516705 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630383a-5821-4eab-b4e7-799b71ed7206 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:56.531830 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630383a-5821-4eab-b4e7-799b71ed7206 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:56.539380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4516a-9f10-4252-bdfd-6f3d422a3630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:56.541124 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4516a-9f10-4252-bdfd-6f3d422a3630 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.541494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4516a-9f10-4252-bdfd-6f3d422a3630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.541886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4516a-9f10-4252-bdfd-6f3d422a3630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.542660 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4516a-9f10-4252-bdfd-6f3d422a3630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:56.544730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4516a-9f10-4252-bdfd-6f3d422a3630 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:56.563203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1146/2305] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:38:56.563940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58773b4f-a588-4c2a-b08b-c8e596a99f5e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:56.577457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58773b4f-a588-4c2a-b08b-c8e596a99f5e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:56.583227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db603e-948f-40f7-ba5c-c61fe554db12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:56.583907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db603e-948f-40f7-ba5c-c61fe554db12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.584181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db603e-948f-40f7-ba5c-c61fe554db12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.584449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db603e-948f-40f7-ba5c-c61fe554db12 admin admin] PATH_INFO: `/v3/projects/b7a844c137514ebba0aa67929352804f/users/18c8ba52030a438194db6491e9d349e9/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.601433 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db603e-948f-40f7-ba5c-c61fe554db12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a844c137514ebba0aa67929352804f, user_id=18c8ba52030a438194db6491e9d349e9, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:56.604089 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db603e-948f-40f7-ba5c-c61fe554db12 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:56.618054 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1160/2306] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:38:56 2022] PUT /identity/v3/projects/b7a844c137514ebba0aa67929352804f/users/18c8ba52030a438194db6491e9d349e9/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:38:56.622279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4516a-9f10-4252-bdfd-6f3d422a3630 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:56.632585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4516a-9f10-4252-bdfd-6f3d422a3630 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:56.697510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb643ad-af63-4aba-9e36-aaf500c55a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:56.698934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb643ad-af63-4aba-9e36-aaf500c55a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.699316 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb643ad-af63-4aba-9e36-aaf500c55a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.699567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb643ad-af63-4aba-9e36-aaf500c55a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.700181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb643ad-af63-4aba-9e36-aaf500c55a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:56.702330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb643ad-af63-4aba-9e36-aaf500c55a08 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:56.713013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1147/2307] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:38:56.717458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db603e-948f-40f7-ba5c-c61fe554db12 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:56.728480 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db603e-948f-40f7-ba5c-c61fe554db12 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:56.733652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff55c4-304e-4041-9d1c-8233439713fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:56.734376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff55c4-304e-4041-9d1c-8233439713fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.734658 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff55c4-304e-4041-9d1c-8233439713fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.734928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff55c4-304e-4041-9d1c-8233439713fd admin admin] PATH_INFO: `/v3/projects/b7a844c137514ebba0aa67929352804f/users/18c8ba52030a438194db6491e9d349e9/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.737003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff55c4-304e-4041-9d1c-8233439713fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a844c137514ebba0aa67929352804f, user_id=18c8ba52030a438194db6491e9d349e9, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:56.739767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff55c4-304e-4041-9d1c-8233439713fd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:56.753300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1161/2308] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:38:56 2022] PUT /identity/v3/projects/b7a844c137514ebba0aa67929352804f/users/18c8ba52030a438194db6491e9d349e9/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:38:56.764164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3e2df-73de-42dd-9ef5-b500d24e670c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.764430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3e2df-73de-42dd-9ef5-b500d24e670c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.764703 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3e2df-73de-42dd-9ef5-b500d24e670c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.794237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cfc3e2df-73de-42dd-9ef5-b500d24e670c None None] MFA Rules not processed for user `18c8ba52030a438194db6491e9d349e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:38:56.795509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cfc3e2df-73de-42dd-9ef5-b500d24e670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:56.801216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:56.882357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1148/2309] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:38:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:38:56.895443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff55c4-304e-4041-9d1c-8233439713fd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:56.897563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ebff55c4-304e-4041-9d1c-8233439713fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:56.963472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff55c4-304e-4041-9d1c-8233439713fd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:56.967138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5286848-594d-4658-b23d-9f749d46bad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:56.967747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5286848-594d-4658-b23d-9f749d46bad8 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:56.968022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5286848-594d-4658-b23d-9f749d46bad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:56.968289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5286848-594d-4658-b23d-9f749d46bad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:56.978577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5286848-594d-4658-b23d-9f749d46bad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:56.980540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5286848-594d-4658-b23d-9f749d46bad8 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:56.990932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1162/2310] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:38:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:38:57.076876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3e2df-73de-42dd-9ef5-b500d24e670c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:57.086796 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3e2df-73de-42dd-9ef5-b500d24e670c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:57.090798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50237c-8640-43e5-b182-a396d284f7af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:57.091442 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50237c-8640-43e5-b182-a396d284f7af service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:57.091722 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50237c-8640-43e5-b182-a396d284f7af service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:57.091899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50237c-8640-43e5-b182-a396d284f7af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:57.149570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50237c-8640-43e5-b182-a396d284f7af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:57.151384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50237c-8640-43e5-b182-a396d284f7af service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:38:57.161338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1149/2311] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:38:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:38:58.925079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e1422-4563-446f-8353-2fb8efd5deac None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:58.925531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e1422-4563-446f-8353-2fb8efd5deac None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:58.925671 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e1422-4563-446f-8353-2fb8efd5deac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:58.944518 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-342e1422-4563-446f-8353-2fb8efd5deac None None] MFA Rules not processed for user `51e200b8d8c443d5912756bf1d04a82d`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:38:58.945701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-342e1422-4563-446f-8353-2fb8efd5deac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:38:59.001232 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1163/2312] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:38:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:38:59.921407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50237c-8640-43e5-b182-a396d284f7af service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:38:59.985685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50237c-8640-43e5-b182-a396d284f7af service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:38:59.994119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:38:59.994791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:38:59.995811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:38:59.996114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] PATH_INFO: `/v3/users/6468ed4b265b4bbda587024b128e4831` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:38:59.997262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6468ed4b265b4bbda587024b128e4831)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:38:59.999223 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:00.047365 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:00.050862 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6468ed4b265b4bbda587024b128e4831'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.060526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6468ed4b265b4bbda587024b128e4831'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.061147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6468ed4b265b4bbda587024b128e4831'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.061795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6468ed4b265b4bbda587024b128e4831'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.074408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6468ed4b265b4bbda587024b128e4831'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.086902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1150/2313] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:38:59 2022] DELETE /identity/v3/users/6468ed4b265b4bbda587024b128e4831 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:00.091624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3248e-6a7c-4107-b573-bc50b9664caf None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:00.092100 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3248e-6a7c-4107-b573-bc50b9664caf None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:00.092237 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3248e-6a7c-4107-b573-bc50b9664caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:00.111239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3ca3248e-6a7c-4107-b573-bc50b9664caf None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:00.112420 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3ca3248e-6a7c-4107-b573-bc50b9664caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:00.163342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:00.173723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1164/2314] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:00.185253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:00.186971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:00.246300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bfffb-a073-4a36-a0bb-7a39ff23e81c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:00.250133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517591c-e74f-4b20-88b7-b36ea529e97c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:00.250744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517591c-e74f-4b20-88b7-b36ea529e97c service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:00.251020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517591c-e74f-4b20-88b7-b36ea529e97c service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:00.251335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517591c-e74f-4b20-88b7-b36ea529e97c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:00.260320 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517591c-e74f-4b20-88b7-b36ea529e97c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:00.261754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517591c-e74f-4b20-88b7-b36ea529e97c service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:00.271221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1151/2315] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:00.543653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3248e-6a7c-4107-b573-bc50b9664caf None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:00.545230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3ca3248e-6a7c-4107-b573-bc50b9664caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:00.558378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3248e-6a7c-4107-b573-bc50b9664caf None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:00.563182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:00.563980 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:00.564259 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:00.564732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] PATH_INFO: `/v3/projects/13a5b26017ad4b1a85c3f726fed62cb8` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:00.566122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a5b26017ad4b1a85c3f726fed62cb8)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:00.568078 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:00.622432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a5b26017ad4b1a85c3f726fed62cb8', 'request_id': 'req-670d68af-431f-4dfe-bbe5-eea797696cad'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.628933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a5b26017ad4b1a85c3f726fed62cb8', 'request_id': 'req-670d68af-431f-4dfe-bbe5-eea797696cad'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.635916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a5b26017ad4b1a85c3f726fed62cb8', 'request_id': 'req-670d68af-431f-4dfe-bbe5-eea797696cad'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.650886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] The token cache is being invalidate because project 13a5b26017ad4b1a85c3f726fed62cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:00.652008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.653032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.656432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1165/2316] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:00 2022] DELETE /identity/v3/projects/13a5b26017ad4b1a85c3f726fed62cb8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:00.661476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517591c-e74f-4b20-88b7-b36ea529e97c service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:00.678009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517591c-e74f-4b20-88b7-b36ea529e97c service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:00.746667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8ab47-bdf2-4373-91b2-2a09c521d815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:00.747327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8ab47-bdf2-4373-91b2-2a09c521d815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:00.747606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8ab47-bdf2-4373-91b2-2a09c521d815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:00.747872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8ab47-bdf2-4373-91b2-2a09c521d815 admin admin] PATH_INFO: `/v3/users/18c8ba52030a438194db6491e9d349e9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:00.748995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8ab47-bdf2-4373-91b2-2a09c521d815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c8ba52030a438194db6491e9d349e9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:00.751129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8ab47-bdf2-4373-91b2-2a09c521d815 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:00.811435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-94d8ab47-bdf2-4373-91b2-2a09c521d815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c8ba52030a438194db6491e9d349e9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.819186 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-94d8ab47-bdf2-4373-91b2-2a09c521d815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c8ba52030a438194db6491e9d349e9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.819827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-94d8ab47-bdf2-4373-91b2-2a09c521d815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c8ba52030a438194db6491e9d349e9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.820417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-94d8ab47-bdf2-4373-91b2-2a09c521d815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c8ba52030a438194db6491e9d349e9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.828730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:00.834191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-94d8ab47-bdf2-4373-91b2-2a09c521d815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c8ba52030a438194db6491e9d349e9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:00.848831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1152/2317] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:39:00 2022] DELETE /identity/v3/users/18c8ba52030a438194db6491e9d349e9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:01.241233 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:01.242724 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:01.256009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d68af-431f-4dfe-bbe5-eea797696cad admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:01.318701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2711a-cdbb-4039-8a7a-289e24271da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:01.319599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2711a-cdbb-4039-8a7a-289e24271da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:01.320090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2711a-cdbb-4039-8a7a-289e24271da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:01.320368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2711a-cdbb-4039-8a7a-289e24271da5 admin admin] PATH_INFO: `/v3/projects/b7a844c137514ebba0aa67929352804f` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:01.321525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2711a-cdbb-4039-8a7a-289e24271da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a844c137514ebba0aa67929352804f)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:01.324200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2711a-cdbb-4039-8a7a-289e24271da5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:01.389455 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fdd2711a-cdbb-4039-8a7a-289e24271da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a844c137514ebba0aa67929352804f', 'request_id': 'req-fdd2711a-cdbb-4039-8a7a-289e24271da5'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:01.395204 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fdd2711a-cdbb-4039-8a7a-289e24271da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a844c137514ebba0aa67929352804f', 'request_id': 'req-fdd2711a-cdbb-4039-8a7a-289e24271da5'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:01.402035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fdd2711a-cdbb-4039-8a7a-289e24271da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a844c137514ebba0aa67929352804f', 'request_id': 'req-fdd2711a-cdbb-4039-8a7a-289e24271da5'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:01.415531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fdd2711a-cdbb-4039-8a7a-289e24271da5 admin admin] The token cache is being invalidate because project b7a844c137514ebba0aa67929352804f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:01.415817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fdd2711a-cdbb-4039-8a7a-289e24271da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:01.416468 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fdd2711a-cdbb-4039-8a7a-289e24271da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:01.418524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1166/2318] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:01 2022] DELETE /identity/v3/projects/b7a844c137514ebba0aa67929352804f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:01.423686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb760-b7a9-45c1-8ac3-0425ee062849 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:01.424221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb760-b7a9-45c1-8ac3-0425ee062849 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:01.424320 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb760-b7a9-45c1-8ac3-0425ee062849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:01.445248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-328fb760-b7a9-45c1-8ac3-0425ee062849 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:01.446507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-328fb760-b7a9-45c1-8ac3-0425ee062849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:01.508790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1153/2319] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:01.516768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336dc86-29c0-4585-be43-b5b8a02c17f6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:01.517048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336dc86-29c0-4585-be43-b5b8a02c17f6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:01.517322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336dc86-29c0-4585-be43-b5b8a02c17f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:01.537264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c336dc86-29c0-4585-be43-b5b8a02c17f6 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:01.538493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c336dc86-29c0-4585-be43-b5b8a02c17f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:01.546935 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1167/2320] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:01.551443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb760-b7a9-45c1-8ac3-0425ee062849 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:01.561932 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb760-b7a9-45c1-8ac3-0425ee062849 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:01.566573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a8418-2c7f-41ac-80b3-3f5202f6dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:01.567227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a8418-2c7f-41ac-80b3-3f5202f6dc3b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:01.567505 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a8418-2c7f-41ac-80b3-3f5202f6dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:01.567776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a8418-2c7f-41ac-80b3-3f5202f6dc3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:01.568433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a8418-2c7f-41ac-80b3-3f5202f6dc3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:39:01.568730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a8418-2c7f-41ac-80b3-3f5202f6dc3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:01.570346 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a8418-2c7f-41ac-80b3-3f5202f6dc3b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:01.585537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1154/2321] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:39:01.586628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336dc86-29c0-4585-be43-b5b8a02c17f6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:01.595781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336dc86-29c0-4585-be43-b5b8a02c17f6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:01.600597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676b2b5-d8b6-4afd-a9ca-87a69aa6afe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:01.601197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676b2b5-d8b6-4afd-a9ca-87a69aa6afe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:01.601470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676b2b5-d8b6-4afd-a9ca-87a69aa6afe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:01.602277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676b2b5-d8b6-4afd-a9ca-87a69aa6afe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:01.602402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676b2b5-d8b6-4afd-a9ca-87a69aa6afe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:01.604765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676b2b5-d8b6-4afd-a9ca-87a69aa6afe1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:01.609780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:01.638077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1168/2322] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:39:01 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:01.639254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a8418-2c7f-41ac-80b3-3f5202f6dc3b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:01.650286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a8418-2c7f-41ac-80b3-3f5202f6dc3b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:01.710536 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6178a-0891-44cd-ae88-831d6bcca255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:01.711168 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6178a-0891-44cd-ae88-831d6bcca255 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:01.711442 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6178a-0891-44cd-ae88-831d6bcca255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:01.711706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6178a-0891-44cd-ae88-831d6bcca255 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:01.712319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6178a-0891-44cd-ae88-831d6bcca255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:01.714279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6178a-0891-44cd-ae88-831d6bcca255 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:01.738606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1155/2323] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:39:01 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:01.742733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676b2b5-d8b6-4afd-a9ca-87a69aa6afe1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:01.757702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676b2b5-d8b6-4afd-a9ca-87a69aa6afe1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:01.762865 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b86ff-23ec-4229-8a81-eaa0f3eb14d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:01.763584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b86ff-23ec-4229-8a81-eaa0f3eb14d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:01.763924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b86ff-23ec-4229-8a81-eaa0f3eb14d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:01.764253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b86ff-23ec-4229-8a81-eaa0f3eb14d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:01.764895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b86ff-23ec-4229-8a81-eaa0f3eb14d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:01.766519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b86ff-23ec-4229-8a81-eaa0f3eb14d2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:01.782044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1169/2324] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:39:01.785083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6178a-0891-44cd-ae88-831d6bcca255 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:01.800777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6178a-0891-44cd-ae88-831d6bcca255 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:01.806910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87932b4a-a2bc-45ad-ba44-f157405c6eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:01.807870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932b4a-a2bc-45ad-ba44-f157405c6eda admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:01.808266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932b4a-a2bc-45ad-ba44-f157405c6eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:01.808546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932b4a-a2bc-45ad-ba44-f157405c6eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:01.809261 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87932b4a-a2bc-45ad-ba44-f157405c6eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:01.810879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87932b4a-a2bc-45ad-ba44-f157405c6eda admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:01.826400 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1156/2325] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:01.830838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b86ff-23ec-4229-8a81-eaa0f3eb14d2 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:01.842391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b86ff-23ec-4229-8a81-eaa0f3eb14d2 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:01.847007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412860f-214e-4b6a-af8d-2cea1dba37e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:01.847689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412860f-214e-4b6a-af8d-2cea1dba37e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:01.848130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412860f-214e-4b6a-af8d-2cea1dba37e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:01.848406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412860f-214e-4b6a-af8d-2cea1dba37e5 admin admin] PATH_INFO: `/v3/projects/668f8b3fe38148e6a8b67a9359bbe37e/users/877114c693e946b58c95ff75bab92c5f/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:01.869182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412860f-214e-4b6a-af8d-2cea1dba37e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=668f8b3fe38148e6a8b67a9359bbe37e, user_id=877114c693e946b58c95ff75bab92c5f, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:01.872171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412860f-214e-4b6a-af8d-2cea1dba37e5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:01.891282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1170/2326] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:01 2022] PUT /identity/v3/projects/668f8b3fe38148e6a8b67a9359bbe37e/users/877114c693e946b58c95ff75bab92c5f/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:01.902229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b96600-1723-4f21-9231-c9d4ac445f87 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:01.902505 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b96600-1723-4f21-9231-c9d4ac445f87 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:01.902769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b96600-1723-4f21-9231-c9d4ac445f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:01.939727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a2b96600-1723-4f21-9231-c9d4ac445f87 None None] MFA Rules not processed for user `877114c693e946b58c95ff75bab92c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:01.940999 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a2b96600-1723-4f21-9231-c9d4ac445f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:01.982018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:02.019794 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1157/2327] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:02.024057 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412860f-214e-4b6a-af8d-2cea1dba37e5 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:02.095839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412860f-214e-4b6a-af8d-2cea1dba37e5 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:02.100501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee26225-4cdc-40e1-acd3-ba6593ddec18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:02.101101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee26225-4cdc-40e1-acd3-ba6593ddec18 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:02.101371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee26225-4cdc-40e1-acd3-ba6593ddec18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:02.101637 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee26225-4cdc-40e1-acd3-ba6593ddec18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:02.102244 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee26225-4cdc-40e1-acd3-ba6593ddec18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:02.104223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee26225-4cdc-40e1-acd3-ba6593ddec18 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:02.131404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1171/2328] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:39:02 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:39:02.136160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b96600-1723-4f21-9231-c9d4ac445f87 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:02.146762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b96600-1723-4f21-9231-c9d4ac445f87 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:02.206466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c641d4b-1f01-4b7a-be71-7b4343a76451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:02.207069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c641d4b-1f01-4b7a-be71-7b4343a76451 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:02.207370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c641d4b-1f01-4b7a-be71-7b4343a76451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:02.207636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c641d4b-1f01-4b7a-be71-7b4343a76451 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:02.208248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c641d4b-1f01-4b7a-be71-7b4343a76451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:02.210148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c641d4b-1f01-4b7a-be71-7b4343a76451 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:02.230780 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1158/2329] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:39:02 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:02.234706 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee26225-4cdc-40e1-acd3-ba6593ddec18 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:02.245675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee26225-4cdc-40e1-acd3-ba6593ddec18 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:02.250315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed1a17-e116-4824-be9f-bbcec0fe541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:02.250958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed1a17-e116-4824-be9f-bbcec0fe541d admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:02.251261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed1a17-e116-4824-be9f-bbcec0fe541d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:02.251528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed1a17-e116-4824-be9f-bbcec0fe541d admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:02.252173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed1a17-e116-4824-be9f-bbcec0fe541d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:02.253735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed1a17-e116-4824-be9f-bbcec0fe541d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:02.265197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1172/2330] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:02.269178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c641d4b-1f01-4b7a-be71-7b4343a76451 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:02.280196 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c641d4b-1f01-4b7a-be71-7b4343a76451 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:02.285029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb44e0-769c-4bcb-a8ea-b7092644e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:02.285748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb44e0-769c-4bcb-a8ea-b7092644e153 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:02.286184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb44e0-769c-4bcb-a8ea-b7092644e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:02.286463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb44e0-769c-4bcb-a8ea-b7092644e153 admin admin] PATH_INFO: `/v3/projects/9f7fe75b2fce416b906f2c1e088a1556/users/302b4b9c512d43e18b2143d33eda5f0a/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:02.303339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb44e0-769c-4bcb-a8ea-b7092644e153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7fe75b2fce416b906f2c1e088a1556, user_id=302b4b9c512d43e18b2143d33eda5f0a, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:02.306004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb44e0-769c-4bcb-a8ea-b7092644e153 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:02.322774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1159/2331] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:02 2022] PUT /identity/v3/projects/9f7fe75b2fce416b906f2c1e088a1556/users/302b4b9c512d43e18b2143d33eda5f0a/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:02.326812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed1a17-e116-4824-be9f-bbcec0fe541d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:02.337173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed1a17-e116-4824-be9f-bbcec0fe541d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:02.398741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e01de-475b-4f9f-969e-d65856f55845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:02.399373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e01de-475b-4f9f-969e-d65856f55845 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:02.399651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e01de-475b-4f9f-969e-d65856f55845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:02.399922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e01de-475b-4f9f-969e-d65856f55845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:02.400561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e01de-475b-4f9f-969e-d65856f55845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:02.402428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e01de-475b-4f9f-969e-d65856f55845 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:02.412371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1173/2332] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:02.416644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb44e0-769c-4bcb-a8ea-b7092644e153 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:02.427795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb44e0-769c-4bcb-a8ea-b7092644e153 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:02.433111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57409e-86ff-4eef-8893-2ea44c69c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:02.433757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57409e-86ff-4eef-8893-2ea44c69c8fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:02.434031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57409e-86ff-4eef-8893-2ea44c69c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:02.434297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57409e-86ff-4eef-8893-2ea44c69c8fe admin admin] PATH_INFO: `/v3/projects/9f7fe75b2fce416b906f2c1e088a1556/users/302b4b9c512d43e18b2143d33eda5f0a/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:02.436212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57409e-86ff-4eef-8893-2ea44c69c8fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7fe75b2fce416b906f2c1e088a1556, user_id=302b4b9c512d43e18b2143d33eda5f0a, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:02.438828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57409e-86ff-4eef-8893-2ea44c69c8fe admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:02.449231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1160/2333] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:02 2022] PUT /identity/v3/projects/9f7fe75b2fce416b906f2c1e088a1556/users/302b4b9c512d43e18b2143d33eda5f0a/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:02.460497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e326c-770e-409d-9996-39233e6b0b7f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:02.460878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e326c-770e-409d-9996-39233e6b0b7f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:02.461140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e326c-770e-409d-9996-39233e6b0b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:02.489429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2e2e326c-770e-409d-9996-39233e6b0b7f None None] MFA Rules not processed for user `302b4b9c512d43e18b2143d33eda5f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:02.490640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2e2e326c-770e-409d-9996-39233e6b0b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:02.500158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:02.574163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1174/2334] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:02.585815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57409e-86ff-4eef-8893-2ea44c69c8fe admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:02.587522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-da57409e-86ff-4eef-8893-2ea44c69c8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:02.647669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57409e-86ff-4eef-8893-2ea44c69c8fe admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:02.650226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e3ecb-fab1-481a-b2ab-7a2cb7f5a243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:02.651622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e3ecb-fab1-481a-b2ab-7a2cb7f5a243 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:02.651916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e3ecb-fab1-481a-b2ab-7a2cb7f5a243 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:02.652179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e3ecb-fab1-481a-b2ab-7a2cb7f5a243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:02.663248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e3ecb-fab1-481a-b2ab-7a2cb7f5a243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:02.664830 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e3ecb-fab1-481a-b2ab-7a2cb7f5a243 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:02.675496 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1161/2335] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:02.721739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e326c-770e-409d-9996-39233e6b0b7f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:02.723207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2e2e326c-770e-409d-9996-39233e6b0b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:02.735927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e326c-770e-409d-9996-39233e6b0b7f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:02.739797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db617dce-f94b-4bc8-94a8-67d7c843cfa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:02.740427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db617dce-f94b-4bc8-94a8-67d7c843cfa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:02.740704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db617dce-f94b-4bc8-94a8-67d7c843cfa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:02.740974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db617dce-f94b-4bc8-94a8-67d7c843cfa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:02.799818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db617dce-f94b-4bc8-94a8-67d7c843cfa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:02.801254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db617dce-f94b-4bc8-94a8-67d7c843cfa5 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:02.810396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1175/2336] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:06.122659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e3ecb-fab1-481a-b2ab-7a2cb7f5a243 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:06.156481 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:06.184031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e3ecb-fab1-481a-b2ab-7a2cb7f5a243 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:06.188518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:06.189129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:06.189404 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:06.190267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] PATH_INFO: `/v3/users/877114c693e946b58c95ff75bab92c5f` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:06.190892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=877114c693e946b58c95ff75bab92c5f)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:06.192725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:06.237743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877114c693e946b58c95ff75bab92c5f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.245355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877114c693e946b58c95ff75bab92c5f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.245982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877114c693e946b58c95ff75bab92c5f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.246621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877114c693e946b58c95ff75bab92c5f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.258352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877114c693e946b58c95ff75bab92c5f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.270764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1162/2337] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:39:06 2022] DELETE /identity/v3/users/877114c693e946b58c95ff75bab92c5f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:06.275357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aefe5-3f82-473b-bc87-c15923b69531 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:06.276697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aefe5-3f82-473b-bc87-c15923b69531 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:06.276697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aefe5-3f82-473b-bc87-c15923b69531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:06.294878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ed3aefe5-3f82-473b-bc87-c15923b69531 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:06.296087 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ed3aefe5-3f82-473b-bc87-c15923b69531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:06.358352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1176/2338] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:06.368248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:06.369645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:06.428759 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1452d8a-0369-4c3f-ad6b-b2e8735aa6e6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:06.433072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba856c-2de1-4eaa-a30f-cb540ec9abcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:06.433736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba856c-2de1-4eaa-a30f-cb540ec9abcd service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:06.434005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba856c-2de1-4eaa-a30f-cb540ec9abcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:06.434274 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba856c-2de1-4eaa-a30f-cb540ec9abcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:06.443503 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba856c-2de1-4eaa-a30f-cb540ec9abcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:06.444925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba856c-2de1-4eaa-a30f-cb540ec9abcd service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:06.455151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1163/2339] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:39:06.722753 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aefe5-3f82-473b-bc87-c15923b69531 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:06.724240 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ed3aefe5-3f82-473b-bc87-c15923b69531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:06.738117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aefe5-3f82-473b-bc87-c15923b69531 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:06.743751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:06.744464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:06.744848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:06.745784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] PATH_INFO: `/v3/projects/668f8b3fe38148e6a8b67a9359bbe37e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:06.747036 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=668f8b3fe38148e6a8b67a9359bbe37e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:06.749874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:06.794021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:06.802857 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '668f8b3fe38148e6a8b67a9359bbe37e', 'request_id': 'req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.811299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '668f8b3fe38148e6a8b67a9359bbe37e', 'request_id': 'req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.817781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '668f8b3fe38148e6a8b67a9359bbe37e', 'request_id': 'req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.831898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] The token cache is being invalidate because project 668f8b3fe38148e6a8b67a9359bbe37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:06.832330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.833047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.834650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1177/2340] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:06 2022] DELETE /identity/v3/projects/668f8b3fe38148e6a8b67a9359bbe37e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:06.838548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba856c-2de1-4eaa-a30f-cb540ec9abcd service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:06.848055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba856c-2de1-4eaa-a30f-cb540ec9abcd service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:06.897114 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:06.905978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1df5-797d-4588-8d31-5a270e3d6ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:06.906798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1df5-797d-4588-8d31-5a270e3d6ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:06.907303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1df5-797d-4588-8d31-5a270e3d6ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:06.907640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1df5-797d-4588-8d31-5a270e3d6ffb admin admin] PATH_INFO: `/v3/users/302b4b9c512d43e18b2143d33eda5f0a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:06.908964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda1df5-797d-4588-8d31-5a270e3d6ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=302b4b9c512d43e18b2143d33eda5f0a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:06.910901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda1df5-797d-4588-8d31-5a270e3d6ffb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:06.956084 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8dda1df5-797d-4588-8d31-5a270e3d6ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302b4b9c512d43e18b2143d33eda5f0a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.963164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8dda1df5-797d-4588-8d31-5a270e3d6ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302b4b9c512d43e18b2143d33eda5f0a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.963706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8dda1df5-797d-4588-8d31-5a270e3d6ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302b4b9c512d43e18b2143d33eda5f0a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.964295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8dda1df5-797d-4588-8d31-5a270e3d6ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302b4b9c512d43e18b2143d33eda5f0a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.975897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8dda1df5-797d-4588-8d31-5a270e3d6ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302b4b9c512d43e18b2143d33eda5f0a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:06.988344 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1164/2341] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:39:06 2022] DELETE /identity/v3/users/302b4b9c512d43e18b2143d33eda5f0a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:07.254719 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:07.256196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:07.270635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87864b32-aa9f-49eb-8ed0-b144fa0d3b41 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:07.328604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a03dd9-a509-4081-9a5d-f9d9184db18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:07.329247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a03dd9-a509-4081-9a5d-f9d9184db18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:07.329512 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a03dd9-a509-4081-9a5d-f9d9184db18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:07.329779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a03dd9-a509-4081-9a5d-f9d9184db18d admin admin] PATH_INFO: `/v3/projects/9f7fe75b2fce416b906f2c1e088a1556` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:07.330884 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a03dd9-a509-4081-9a5d-f9d9184db18d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7fe75b2fce416b906f2c1e088a1556)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:07.332855 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a03dd9-a509-4081-9a5d-f9d9184db18d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:07.378890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-10a03dd9-a509-4081-9a5d-f9d9184db18d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7fe75b2fce416b906f2c1e088a1556', 'request_id': 'req-10a03dd9-a509-4081-9a5d-f9d9184db18d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:07.384215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-10a03dd9-a509-4081-9a5d-f9d9184db18d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7fe75b2fce416b906f2c1e088a1556', 'request_id': 'req-10a03dd9-a509-4081-9a5d-f9d9184db18d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:07.390650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-10a03dd9-a509-4081-9a5d-f9d9184db18d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7fe75b2fce416b906f2c1e088a1556', 'request_id': 'req-10a03dd9-a509-4081-9a5d-f9d9184db18d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:07.403734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-10a03dd9-a509-4081-9a5d-f9d9184db18d admin admin] The token cache is being invalidate because project 9f7fe75b2fce416b906f2c1e088a1556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:07.404016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-10a03dd9-a509-4081-9a5d-f9d9184db18d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:07.404630 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-10a03dd9-a509-4081-9a5d-f9d9184db18d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:07.406092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1178/2342] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:07 2022] DELETE /identity/v3/projects/9f7fe75b2fce416b906f2c1e088a1556 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:07.411108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31bf36-866a-47e6-87ba-a1416e1c288f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:07.411571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31bf36-866a-47e6-87ba-a1416e1c288f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:07.411667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31bf36-866a-47e6-87ba-a1416e1c288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:07.431642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4f31bf36-866a-47e6-87ba-a1416e1c288f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:07.432847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4f31bf36-866a-47e6-87ba-a1416e1c288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:07.490258 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1165/2343] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:07.498058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f472665-7e2f-40d3-a308-4bb652fadd69 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:07.498343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f472665-7e2f-40d3-a308-4bb652fadd69 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:07.498646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f472665-7e2f-40d3-a308-4bb652fadd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:07.518545 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4f472665-7e2f-40d3-a308-4bb652fadd69 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:07.519772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4f472665-7e2f-40d3-a308-4bb652fadd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:07.528344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1179/2344] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:07.532498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31bf36-866a-47e6-87ba-a1416e1c288f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:07.541879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31bf36-866a-47e6-87ba-a1416e1c288f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:07.546394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c965d-426f-4856-ba47-63141c7728a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:07.546976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c965d-426f-4856-ba47-63141c7728a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:07.547278 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c965d-426f-4856-ba47-63141c7728a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:07.547543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c965d-426f-4856-ba47-63141c7728a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:07.548183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c965d-426f-4856-ba47-63141c7728a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:39:07.548482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c965d-426f-4856-ba47-63141c7728a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:07.550040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c965d-426f-4856-ba47-63141c7728a0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:07.561426 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1166/2345] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:39:07.565448 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f472665-7e2f-40d3-a308-4bb652fadd69 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:07.575015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f472665-7e2f-40d3-a308-4bb652fadd69 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:07.579639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76394-6ede-450a-bed6-e037e501fd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:07.580249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76394-6ede-450a-bed6-e037e501fd2a admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:07.580520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76394-6ede-450a-bed6-e037e501fd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:07.580785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76394-6ede-450a-bed6-e037e501fd2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:07.581402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d76394-6ede-450a-bed6-e037e501fd2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:07.583316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d76394-6ede-450a-bed6-e037e501fd2a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:07.610136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1180/2346] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:39:07 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:07.614227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c965d-426f-4856-ba47-63141c7728a0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:07.624122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c965d-426f-4856-ba47-63141c7728a0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:07.679630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea972438-a25d-4f63-935c-d39e0ce7c5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:07.680150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea972438-a25d-4f63-935c-d39e0ce7c5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:07.680422 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea972438-a25d-4f63-935c-d39e0ce7c5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:07.680691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea972438-a25d-4f63-935c-d39e0ce7c5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:07.681308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea972438-a25d-4f63-935c-d39e0ce7c5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:07.683241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea972438-a25d-4f63-935c-d39e0ce7c5c6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:07.691709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:07.705171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1167/2347] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:39:07 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:39:07.709259 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76394-6ede-450a-bed6-e037e501fd2a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:07.719851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76394-6ede-450a-bed6-e037e501fd2a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:07.724366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95e408-4dd9-4221-a618-cd13d3897b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:07.725053 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95e408-4dd9-4221-a618-cd13d3897b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:07.725331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95e408-4dd9-4221-a618-cd13d3897b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:07.725594 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95e408-4dd9-4221-a618-cd13d3897b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:07.726221 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95e408-4dd9-4221-a618-cd13d3897b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:07.728171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95e408-4dd9-4221-a618-cd13d3897b79 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:07.737651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1181/2348] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:07.741429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea972438-a25d-4f63-935c-d39e0ce7c5c6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:07.751311 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea972438-a25d-4f63-935c-d39e0ce7c5c6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:07.755873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c509f-f7c7-4f3f-b388-62e81b3df8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:07.756457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c509f-f7c7-4f3f-b388-62e81b3df8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:07.756731 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c509f-f7c7-4f3f-b388-62e81b3df8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:07.756995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c509f-f7c7-4f3f-b388-62e81b3df8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:07.757628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c509f-f7c7-4f3f-b388-62e81b3df8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:07.759222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c509f-f7c7-4f3f-b388-62e81b3df8ed admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:07.769972 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1168/2349] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:07.773818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95e408-4dd9-4221-a618-cd13d3897b79 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:07.784626 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95e408-4dd9-4221-a618-cd13d3897b79 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:07.789170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617953e-4050-41f4-9917-682c19101c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:07.789794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617953e-4050-41f4-9917-682c19101c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:07.790067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617953e-4050-41f4-9917-682c19101c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:07.790332 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617953e-4050-41f4-9917-682c19101c3a admin admin] PATH_INFO: `/v3/projects/6bdd65c1a2a54656870896fb8052dc70/users/aec52c6fd4364445865e06f211f7b2ce/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:07.804716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617953e-4050-41f4-9917-682c19101c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdd65c1a2a54656870896fb8052dc70, user_id=aec52c6fd4364445865e06f211f7b2ce, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:07.808296 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617953e-4050-41f4-9917-682c19101c3a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:07.810757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:07.824014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1182/2350] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:07 2022] PUT /identity/v3/projects/6bdd65c1a2a54656870896fb8052dc70/users/aec52c6fd4364445865e06f211f7b2ce/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:07.834407 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385fe58-a495-419e-a1c6-ce56748b4779 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:07.834692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385fe58-a495-419e-a1c6-ce56748b4779 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:07.834962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385fe58-a495-419e-a1c6-ce56748b4779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:07.866261 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2385fe58-a495-419e-a1c6-ce56748b4779 None None] MFA Rules not processed for user `aec52c6fd4364445865e06f211f7b2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:07.867814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2385fe58-a495-419e-a1c6-ce56748b4779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:07.942986 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1169/2351] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:07.944274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617953e-4050-41f4-9917-682c19101c3a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:07.990492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385fe58-a495-419e-a1c6-ce56748b4779 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:07.992430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2385fe58-a495-419e-a1c6-ce56748b4779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:08.023839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617953e-4050-41f4-9917-682c19101c3a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:08.028923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86f03d-9aa9-4af0-80f5-0885962903b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:08.029527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86f03d-9aa9-4af0-80f5-0885962903b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:08.029809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86f03d-9aa9-4af0-80f5-0885962903b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:08.030082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86f03d-9aa9-4af0-80f5-0885962903b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:08.030817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86f03d-9aa9-4af0-80f5-0885962903b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:08.032767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86f03d-9aa9-4af0-80f5-0885962903b1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:08.063061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1183/2352] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:39:07 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:08.067000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86f03d-9aa9-4af0-80f5-0885962903b1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:08.097480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385fe58-a495-419e-a1c6-ce56748b4779 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:08.133145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86f03d-9aa9-4af0-80f5-0885962903b1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:08.138491 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c557236-8224-4adc-8cd2-2ed65972f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:08.139228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c557236-8224-4adc-8cd2-2ed65972f932 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:08.139622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c557236-8224-4adc-8cd2-2ed65972f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:08.140002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c557236-8224-4adc-8cd2-2ed65972f932 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:08.140684 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c557236-8224-4adc-8cd2-2ed65972f932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:08.142639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c557236-8224-4adc-8cd2-2ed65972f932 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:08.166527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1184/2353] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:39:08 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:39:08.168096 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c557236-8224-4adc-8cd2-2ed65972f932 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:08.171008 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db1a26-b458-4100-80d1-21d4fab25b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:08.171641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db1a26-b458-4100-80d1-21d4fab25b34 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:08.171919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db1a26-b458-4100-80d1-21d4fab25b34 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:08.172184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db1a26-b458-4100-80d1-21d4fab25b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:08.174135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-08db1a26-b458-4100-80d1-21d4fab25b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:08.177698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c557236-8224-4adc-8cd2-2ed65972f932 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:08.183037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee0ace-4cc4-40e2-9432-891a36f72c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:08.183536 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:08.183669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee0ace-4cc4-40e2-9432-891a36f72c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:08.183912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee0ace-4cc4-40e2-9432-891a36f72c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:08.184460 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee0ace-4cc4-40e2-9432-891a36f72c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:08.184813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee0ace-4cc4-40e2-9432-891a36f72c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:08.186553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee0ace-4cc4-40e2-9432-891a36f72c0d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:08.187933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db1a26-b458-4100-80d1-21d4fab25b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:08.190139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db1a26-b458-4100-80d1-21d4fab25b34 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:08.197170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1185/2354] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:39:08.201334 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee0ace-4cc4-40e2-9432-891a36f72c0d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:08.201458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1170/2355] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:08.211100 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee0ace-4cc4-40e2-9432-891a36f72c0d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:08.215813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b395570-84e7-40b7-8eeb-31f5c375ce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:08.216543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b395570-84e7-40b7-8eeb-31f5c375ce6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:08.216708 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b395570-84e7-40b7-8eeb-31f5c375ce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:08.217007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b395570-84e7-40b7-8eeb-31f5c375ce6a admin admin] PATH_INFO: `/v3/projects/5e6f9a132f9943258c2b8900aba6dbda/users/55829cb34b7943a4965bbd577152d163/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:08.232145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b395570-84e7-40b7-8eeb-31f5c375ce6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6f9a132f9943258c2b8900aba6dbda, user_id=55829cb34b7943a4965bbd577152d163, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:08.234544 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b395570-84e7-40b7-8eeb-31f5c375ce6a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:08.248281 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1186/2356] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:08 2022] PUT /identity/v3/projects/5e6f9a132f9943258c2b8900aba6dbda/users/55829cb34b7943a4965bbd577152d163/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:39:08.252324 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db1a26-b458-4100-80d1-21d4fab25b34 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:08.264543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db1a26-b458-4100-80d1-21d4fab25b34 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:08.321234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f157e-9522-4186-9d18-5e452902f9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:08.321832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f157e-9522-4186-9d18-5e452902f9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:08.322103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f157e-9522-4186-9d18-5e452902f9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:08.322367 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f157e-9522-4186-9d18-5e452902f9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:08.323050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f157e-9522-4186-9d18-5e452902f9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:08.324659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f157e-9522-4186-9d18-5e452902f9a2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:08.334277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1171/2357] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:08.338474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b395570-84e7-40b7-8eeb-31f5c375ce6a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:08.350307 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b395570-84e7-40b7-8eeb-31f5c375ce6a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:08.355849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18508f7b-dfc1-4722-9534-4edd66e32ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:08.356497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508f7b-dfc1-4722-9534-4edd66e32ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:08.356771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508f7b-dfc1-4722-9534-4edd66e32ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:08.357071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508f7b-dfc1-4722-9534-4edd66e32ca8 admin admin] PATH_INFO: `/v3/projects/5e6f9a132f9943258c2b8900aba6dbda/users/55829cb34b7943a4965bbd577152d163/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:08.358953 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18508f7b-dfc1-4722-9534-4edd66e32ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6f9a132f9943258c2b8900aba6dbda, user_id=55829cb34b7943a4965bbd577152d163, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:08.361664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18508f7b-dfc1-4722-9534-4edd66e32ca8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:08.373429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1187/2358] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:08 2022] PUT /identity/v3/projects/5e6f9a132f9943258c2b8900aba6dbda/users/55829cb34b7943a4965bbd577152d163/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:39:08.384963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dabdb1-3b80-4b48-ac81-1b29c9a40cac None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:08.385273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dabdb1-3b80-4b48-ac81-1b29c9a40cac None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:08.385958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dabdb1-3b80-4b48-ac81-1b29c9a40cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:08.413610 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-07dabdb1-3b80-4b48-ac81-1b29c9a40cac None None] MFA Rules not processed for user `55829cb34b7943a4965bbd577152d163`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:08.414810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-07dabdb1-3b80-4b48-ac81-1b29c9a40cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:08.485129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1172/2359] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:08.497183 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18508f7b-dfc1-4722-9534-4edd66e32ca8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:08.499113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-18508f7b-dfc1-4722-9534-4edd66e32ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:08.521045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:08.557983 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18508f7b-dfc1-4722-9534-4edd66e32ca8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:08.561668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96467f6-afc7-4d1e-9596-2ec3f240ff6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:08.562256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96467f6-afc7-4d1e-9596-2ec3f240ff6c service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:08.562534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96467f6-afc7-4d1e-9596-2ec3f240ff6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:08.562803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96467f6-afc7-4d1e-9596-2ec3f240ff6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:08.571653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96467f6-afc7-4d1e-9596-2ec3f240ff6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:08.573258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96467f6-afc7-4d1e-9596-2ec3f240ff6c service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:08.582541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1188/2360] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:08.611448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dabdb1-3b80-4b48-ac81-1b29c9a40cac None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:08.673306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dabdb1-3b80-4b48-ac81-1b29c9a40cac None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:08.677951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:08.678571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:08.678847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:08.679136 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] PATH_INFO: `/v3/users/aec52c6fd4364445865e06f211f7b2ce` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:08.680257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec52c6fd4364445865e06f211f7b2ce)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:08.682162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:08.701613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:08.733010 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec52c6fd4364445865e06f211f7b2ce'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:08.740083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec52c6fd4364445865e06f211f7b2ce'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:08.740716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec52c6fd4364445865e06f211f7b2ce'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:08.741313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec52c6fd4364445865e06f211f7b2ce'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:08.752957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec52c6fd4364445865e06f211f7b2ce'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:08.764884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1173/2361] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:39:08 2022] DELETE /identity/v3/users/aec52c6fd4364445865e06f211f7b2ce => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:08.769648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07926afc-dfb5-496c-9a41-c3a7b81f9779 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:08.769933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07926afc-dfb5-496c-9a41-c3a7b81f9779 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:08.770206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07926afc-dfb5-496c-9a41-c3a7b81f9779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:08.789279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-07926afc-dfb5-496c-9a41-c3a7b81f9779 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:08.790466 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-07926afc-dfb5-496c-9a41-c3a7b81f9779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:08.848580 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1189/2362] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:08.859035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:08.860484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:08.917129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593b1c6-a52b-4dbd-910d-c8127d85520b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:08.920800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c798f7-643e-4a0b-9483-add91fb409f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:08.921392 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c798f7-643e-4a0b-9483-add91fb409f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:08.921662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c798f7-643e-4a0b-9483-add91fb409f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:08.921929 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c798f7-643e-4a0b-9483-add91fb409f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:08.930645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c798f7-643e-4a0b-9483-add91fb409f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:08.932122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c798f7-643e-4a0b-9483-add91fb409f9 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:08.941284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1174/2363] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:09.211777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07926afc-dfb5-496c-9a41-c3a7b81f9779 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:09.213235 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-07926afc-dfb5-496c-9a41-c3a7b81f9779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:09.228784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07926afc-dfb5-496c-9a41-c3a7b81f9779 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:09.234486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:09.235243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:09.235463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:09.235735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] PATH_INFO: `/v3/projects/6bdd65c1a2a54656870896fb8052dc70` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:09.236916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bdd65c1a2a54656870896fb8052dc70)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:09.238762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:09.286134 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bdd65c1a2a54656870896fb8052dc70', 'request_id': 'req-4c523d05-5e0a-4b55-9344-a00ab7a45f38'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.291468 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bdd65c1a2a54656870896fb8052dc70', 'request_id': 'req-4c523d05-5e0a-4b55-9344-a00ab7a45f38'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.298162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bdd65c1a2a54656870896fb8052dc70', 'request_id': 'req-4c523d05-5e0a-4b55-9344-a00ab7a45f38'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.310505 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] The token cache is being invalidate because project 6bdd65c1a2a54656870896fb8052dc70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:09.310793 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.311431 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.312902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1190/2364] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:09 2022] DELETE /identity/v3/projects/6bdd65c1a2a54656870896fb8052dc70 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:09.316948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c798f7-643e-4a0b-9483-add91fb409f9 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:09.326413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c798f7-643e-4a0b-9483-add91fb409f9 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:09.381603 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e58a1-7f1a-4b44-b7c3-a819a7f38d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:09.382216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e58a1-7f1a-4b44-b7c3-a819a7f38d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:09.382491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e58a1-7f1a-4b44-b7c3-a819a7f38d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:09.382758 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e58a1-7f1a-4b44-b7c3-a819a7f38d80 admin admin] PATH_INFO: `/v3/users/55829cb34b7943a4965bbd577152d163` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:09.383920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e58a1-7f1a-4b44-b7c3-a819a7f38d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55829cb34b7943a4965bbd577152d163)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:09.385850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e58a1-7f1a-4b44-b7c3-a819a7f38d80 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:09.424967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:09.432567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fd2e58a1-7f1a-4b44-b7c3-a819a7f38d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55829cb34b7943a4965bbd577152d163'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.440566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fd2e58a1-7f1a-4b44-b7c3-a819a7f38d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55829cb34b7943a4965bbd577152d163'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.441312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fd2e58a1-7f1a-4b44-b7c3-a819a7f38d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55829cb34b7943a4965bbd577152d163'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.442018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fd2e58a1-7f1a-4b44-b7c3-a819a7f38d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55829cb34b7943a4965bbd577152d163'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.454618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fd2e58a1-7f1a-4b44-b7c3-a819a7f38d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55829cb34b7943a4965bbd577152d163'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.466872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1175/2365] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:39:09 2022] DELETE /identity/v3/users/55829cb34b7943a4965bbd577152d163 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:09.731592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:09.733219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:09.746115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c523d05-5e0a-4b55-9344-a00ab7a45f38 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:09.795145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:09.811678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97020bf-ab63-4c80-ba27-300e063446b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:09.812317 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97020bf-ab63-4c80-ba27-300e063446b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:09.812595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97020bf-ab63-4c80-ba27-300e063446b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:09.812867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97020bf-ab63-4c80-ba27-300e063446b2 admin admin] PATH_INFO: `/v3/projects/5e6f9a132f9943258c2b8900aba6dbda` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:09.814029 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97020bf-ab63-4c80-ba27-300e063446b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6f9a132f9943258c2b8900aba6dbda)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:09.815976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97020bf-ab63-4c80-ba27-300e063446b2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:09.861353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f97020bf-ab63-4c80-ba27-300e063446b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6f9a132f9943258c2b8900aba6dbda', 'request_id': 'req-f97020bf-ab63-4c80-ba27-300e063446b2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.866698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f97020bf-ab63-4c80-ba27-300e063446b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6f9a132f9943258c2b8900aba6dbda', 'request_id': 'req-f97020bf-ab63-4c80-ba27-300e063446b2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.873239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f97020bf-ab63-4c80-ba27-300e063446b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6f9a132f9943258c2b8900aba6dbda', 'request_id': 'req-f97020bf-ab63-4c80-ba27-300e063446b2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.885456 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f97020bf-ab63-4c80-ba27-300e063446b2 admin admin] The token cache is being invalidate because project 5e6f9a132f9943258c2b8900aba6dbda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:09.886253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f97020bf-ab63-4c80-ba27-300e063446b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.886870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f97020bf-ab63-4c80-ba27-300e063446b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:09.888362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1191/2366] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:09 2022] DELETE /identity/v3/projects/5e6f9a132f9943258c2b8900aba6dbda => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:09.893193 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53320d37-94d3-4dd2-8456-2127f465e7e5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:09.893482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53320d37-94d3-4dd2-8456-2127f465e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:09.893762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53320d37-94d3-4dd2-8456-2127f465e7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:09.913674 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-53320d37-94d3-4dd2-8456-2127f465e7e5 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:09.914882 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-53320d37-94d3-4dd2-8456-2127f465e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:09.975198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1176/2367] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:09.982863 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d896-8055-4129-b809-e22fbfd43630 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:09.983191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d896-8055-4129-b809-e22fbfd43630 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:09.983534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d896-8055-4129-b809-e22fbfd43630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.002749 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0211d896-8055-4129-b809-e22fbfd43630 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:10.003955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0211d896-8055-4129-b809-e22fbfd43630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:10.012223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1192/2368] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:10.016430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53320d37-94d3-4dd2-8456-2127f465e7e5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.026893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53320d37-94d3-4dd2-8456-2127f465e7e5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:10.031426 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999fb85-7b8d-43db-b802-a141707830c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:10.032009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999fb85-7b8d-43db-b802-a141707830c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.032281 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999fb85-7b8d-43db-b802-a141707830c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.032546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999fb85-7b8d-43db-b802-a141707830c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.033181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999fb85-7b8d-43db-b802-a141707830c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:39:10.033575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999fb85-7b8d-43db-b802-a141707830c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:10.035161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999fb85-7b8d-43db-b802-a141707830c1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:10.046343 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1177/2369] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:39:10.050480 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211d896-8055-4129-b809-e22fbfd43630 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.060075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211d896-8055-4129-b809-e22fbfd43630 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:10.064678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9f75c-de91-40b2-b567-d7c0ee6b6cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:10.065194 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9f75c-de91-40b2-b567-d7c0ee6b6cde admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.065465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9f75c-de91-40b2-b567-d7c0ee6b6cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.065727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9f75c-de91-40b2-b567-d7c0ee6b6cde admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.066329 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9f75c-de91-40b2-b567-d7c0ee6b6cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:10.068221 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9f75c-de91-40b2-b567-d7c0ee6b6cde admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:10.095770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1193/2370] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:39:10 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:39:10.100057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999fb85-7b8d-43db-b802-a141707830c1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.109959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999fb85-7b8d-43db-b802-a141707830c1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:10.165155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e300129-47ed-4232-985c-3d91a40dffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:10.165805 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e300129-47ed-4232-985c-3d91a40dffa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.166080 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e300129-47ed-4232-985c-3d91a40dffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.166347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e300129-47ed-4232-985c-3d91a40dffa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.166963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e300129-47ed-4232-985c-3d91a40dffa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:10.168936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e300129-47ed-4232-985c-3d91a40dffa3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:10.190400 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1178/2371] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:39:10 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:39:10.193869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9f75c-de91-40b2-b567-d7c0ee6b6cde admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.205024 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9f75c-de91-40b2-b567-d7c0ee6b6cde admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:10.209852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c244ce1-71d9-4ad9-bb9a-99df8fc0c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:10.210468 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c244ce1-71d9-4ad9-bb9a-99df8fc0c383 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.210732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c244ce1-71d9-4ad9-bb9a-99df8fc0c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.211003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c244ce1-71d9-4ad9-bb9a-99df8fc0c383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.211709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c244ce1-71d9-4ad9-bb9a-99df8fc0c383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:10.213283 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c244ce1-71d9-4ad9-bb9a-99df8fc0c383 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:10.225040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1194/2372] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:39:10.227485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e300129-47ed-4232-985c-3d91a40dffa3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.237657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e300129-47ed-4232-985c-3d91a40dffa3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:10.242265 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2abe9b-89b7-4e5f-b201-4969514ad47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:10.242853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2abe9b-89b7-4e5f-b201-4969514ad47d admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.243152 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2abe9b-89b7-4e5f-b201-4969514ad47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.243420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2abe9b-89b7-4e5f-b201-4969514ad47d admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.244061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2abe9b-89b7-4e5f-b201-4969514ad47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:10.246129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2abe9b-89b7-4e5f-b201-4969514ad47d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:10.256791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1179/2373] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:39:10.261596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c244ce1-71d9-4ad9-bb9a-99df8fc0c383 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.271504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c244ce1-71d9-4ad9-bb9a-99df8fc0c383 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:10.276340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaf8e5-57aa-4924-9d1d-5490c723738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:10.277159 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf8e5-57aa-4924-9d1d-5490c723738e admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.277507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf8e5-57aa-4924-9d1d-5490c723738e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.277777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf8e5-57aa-4924-9d1d-5490c723738e admin admin] PATH_INFO: `/v3/projects/d329ec478c7b49ea892e43d11da75c3c/users/5babecdd20244fdc9868f71ae784589a/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.296486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaf8e5-57aa-4924-9d1d-5490c723738e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d329ec478c7b49ea892e43d11da75c3c, user_id=5babecdd20244fdc9868f71ae784589a, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:10.299279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaf8e5-57aa-4924-9d1d-5490c723738e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:10.321885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1195/2374] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:10 2022] PUT /identity/v3/projects/d329ec478c7b49ea892e43d11da75c3c/users/5babecdd20244fdc9868f71ae784589a/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:10.332646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565d778-a097-4a0f-bbc8-77a744129bf1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.332963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565d778-a097-4a0f-bbc8-77a744129bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.333196 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565d778-a097-4a0f-bbc8-77a744129bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.365146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5565d778-a097-4a0f-bbc8-77a744129bf1 None None] MFA Rules not processed for user `5babecdd20244fdc9868f71ae784589a`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:10.366473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5565d778-a097-4a0f-bbc8-77a744129bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:10.384569 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:10.443857 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1180/2375] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:10.448343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaf8e5-57aa-4924-9d1d-5490c723738e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.508665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaf8e5-57aa-4924-9d1d-5490c723738e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:10.513289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9a709-0c32-411c-a873-bf7cd5cf7841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:10.513881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9a709-0c32-411c-a873-bf7cd5cf7841 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.514156 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9a709-0c32-411c-a873-bf7cd5cf7841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.514426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9a709-0c32-411c-a873-bf7cd5cf7841 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.515058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9a709-0c32-411c-a873-bf7cd5cf7841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:10.516957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9a709-0c32-411c-a873-bf7cd5cf7841 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:10.537373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:10.547166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1196/2376] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:39:10 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:10.551124 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565d778-a097-4a0f-bbc8-77a744129bf1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.562229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565d778-a097-4a0f-bbc8-77a744129bf1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:10.617648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b3fe3-a34f-4453-9f77-9d8fa629b571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:10.618173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b3fe3-a34f-4453-9f77-9d8fa629b571 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.618451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b3fe3-a34f-4453-9f77-9d8fa629b571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.618725 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b3fe3-a34f-4453-9f77-9d8fa629b571 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.619391 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b3fe3-a34f-4453-9f77-9d8fa629b571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:10.621915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b3fe3-a34f-4453-9f77-9d8fa629b571 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:10.642527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1181/2377] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:39:10 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:10.646451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9a709-0c32-411c-a873-bf7cd5cf7841 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.656988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9a709-0c32-411c-a873-bf7cd5cf7841 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:10.663658 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c3204-09f9-45b7-8994-85624004c035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:10.664256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c3204-09f9-45b7-8994-85624004c035 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.664532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c3204-09f9-45b7-8994-85624004c035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.664803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c3204-09f9-45b7-8994-85624004c035 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.665461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c3204-09f9-45b7-8994-85624004c035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:10.667586 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c3204-09f9-45b7-8994-85624004c035 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:10.678267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1197/2378] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:10.683318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b3fe3-a34f-4453-9f77-9d8fa629b571 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.694993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b3fe3-a34f-4453-9f77-9d8fa629b571 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:10.699585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934461b6-6dc7-44f4-afc2-48b52712f341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:10.700222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934461b6-6dc7-44f4-afc2-48b52712f341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.700497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934461b6-6dc7-44f4-afc2-48b52712f341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.700764 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934461b6-6dc7-44f4-afc2-48b52712f341 admin admin] PATH_INFO: `/v3/projects/f0c74beaa78d4d3cb1ac3e838d311740/users/fe392f2787294699bfab1468d3f0e567/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.715000 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934461b6-6dc7-44f4-afc2-48b52712f341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c74beaa78d4d3cb1ac3e838d311740, user_id=fe392f2787294699bfab1468d3f0e567, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:10.717653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934461b6-6dc7-44f4-afc2-48b52712f341 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:10.730384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1182/2379] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:10 2022] PUT /identity/v3/projects/f0c74beaa78d4d3cb1ac3e838d311740/users/fe392f2787294699bfab1468d3f0e567/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:10.734360 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c3204-09f9-45b7-8994-85624004c035 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.744510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c3204-09f9-45b7-8994-85624004c035 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:10.800946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605238e9-1864-4b31-95db-346ec23d9845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:10.801540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605238e9-1864-4b31-95db-346ec23d9845 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.801811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605238e9-1864-4b31-95db-346ec23d9845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.802075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605238e9-1864-4b31-95db-346ec23d9845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.802703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605238e9-1864-4b31-95db-346ec23d9845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:10.804305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605238e9-1864-4b31-95db-346ec23d9845 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:10.813903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1198/2380] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:10.818127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934461b6-6dc7-44f4-afc2-48b52712f341 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.828279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934461b6-6dc7-44f4-afc2-48b52712f341 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:10.832973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb277bf4-856b-4435-92ee-d01afc61a910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:10.833607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb277bf4-856b-4435-92ee-d01afc61a910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.833879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb277bf4-856b-4435-92ee-d01afc61a910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.834173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb277bf4-856b-4435-92ee-d01afc61a910 admin admin] PATH_INFO: `/v3/projects/f0c74beaa78d4d3cb1ac3e838d311740/users/fe392f2787294699bfab1468d3f0e567/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.836115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb277bf4-856b-4435-92ee-d01afc61a910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c74beaa78d4d3cb1ac3e838d311740, user_id=fe392f2787294699bfab1468d3f0e567, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:10.839292 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb277bf4-856b-4435-92ee-d01afc61a910 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:10.849155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1183/2381] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:10 2022] PUT /identity/v3/projects/f0c74beaa78d4d3cb1ac3e838d311740/users/fe392f2787294699bfab1468d3f0e567/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:10.860519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d909b1-fcfe-4334-a576-0c8b22a349ca None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:10.860803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d909b1-fcfe-4334-a576-0c8b22a349ca None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:10.861073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d909b1-fcfe-4334-a576-0c8b22a349ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:10.887615 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d1d909b1-fcfe-4334-a576-0c8b22a349ca None None] MFA Rules not processed for user `fe392f2787294699bfab1468d3f0e567`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:10.888727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d1d909b1-fcfe-4334-a576-0c8b22a349ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:10.953753 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1199/2382] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:10.965359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb277bf4-856b-4435-92ee-d01afc61a910 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:10.967061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fb277bf4-856b-4435-92ee-d01afc61a910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:11.024989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb277bf4-856b-4435-92ee-d01afc61a910 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:11.029396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab08d3-4efa-459f-94fa-3afd0d6cebed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:11.029994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab08d3-4efa-459f-94fa-3afd0d6cebed service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:11.030267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab08d3-4efa-459f-94fa-3afd0d6cebed service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:11.030535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab08d3-4efa-459f-94fa-3afd0d6cebed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:11.039207 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab08d3-4efa-459f-94fa-3afd0d6cebed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:11.040624 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab08d3-4efa-459f-94fa-3afd0d6cebed service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:11.050421 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1184/2383] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:11.129679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d909b1-fcfe-4334-a576-0c8b22a349ca None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:11.139807 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d909b1-fcfe-4334-a576-0c8b22a349ca None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:11.143285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd5554-f07a-49d6-ab32-976549f58ee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:11.143867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd5554-f07a-49d6-ab32-976549f58ee7 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:11.144139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd5554-f07a-49d6-ab32-976549f58ee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:11.144405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd5554-f07a-49d6-ab32-976549f58ee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:11.200336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd5554-f07a-49d6-ab32-976549f58ee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:11.201756 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd5554-f07a-49d6-ab32-976549f58ee7 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:11.210443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1200/2384] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:15.909241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab08d3-4efa-459f-94fa-3afd0d6cebed service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:15.918017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:15.971787 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab08d3-4efa-459f-94fa-3afd0d6cebed service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:15.976249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:15.976856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:15.977128 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:15.977393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] PATH_INFO: `/v3/users/5babecdd20244fdc9868f71ae784589a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:15.978489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5babecdd20244fdc9868f71ae784589a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:15.980462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:16.027283 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5babecdd20244fdc9868f71ae784589a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.034273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5babecdd20244fdc9868f71ae784589a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.034899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5babecdd20244fdc9868f71ae784589a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.035519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5babecdd20244fdc9868f71ae784589a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.047167 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5babecdd20244fdc9868f71ae784589a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.059470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1185/2385] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:39:15 2022] DELETE /identity/v3/users/5babecdd20244fdc9868f71ae784589a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:16.063899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278553bb-4466-4e51-b711-9cc04add78ac None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:16.064392 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278553bb-4466-4e51-b711-9cc04add78ac None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:16.064502 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278553bb-4466-4e51-b711-9cc04add78ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:16.078395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:16.085816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-278553bb-4466-4e51-b711-9cc04add78ac None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:16.087004 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-278553bb-4466-4e51-b711-9cc04add78ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:16.143551 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1201/2386] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:16.153306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:16.154771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:16.214519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059e07b-eed6-4f00-bd37-0de49936ae1d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:16.218229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc468e66-26ba-4232-9b6f-1bb8a9251bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:16.218833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc468e66-26ba-4232-9b6f-1bb8a9251bfb service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:16.219133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc468e66-26ba-4232-9b6f-1bb8a9251bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:16.219404 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc468e66-26ba-4232-9b6f-1bb8a9251bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:16.228474 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc468e66-26ba-4232-9b6f-1bb8a9251bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:16.229984 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc468e66-26ba-4232-9b6f-1bb8a9251bfb service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:16.240689 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1186/2387] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:16.517612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278553bb-4466-4e51-b711-9cc04add78ac None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:16.519041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-278553bb-4466-4e51-b711-9cc04add78ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:16.534232 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278553bb-4466-4e51-b711-9cc04add78ac None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:16.539964 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:16.540589 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:16.540853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:16.541113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] PATH_INFO: `/v3/projects/d329ec478c7b49ea892e43d11da75c3c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:16.542227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d329ec478c7b49ea892e43d11da75c3c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:16.544651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:16.590727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd329ec478c7b49ea892e43d11da75c3c', 'request_id': 'req-39fc53f5-aa65-47ea-8837-bf905ad9db3e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.596480 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd329ec478c7b49ea892e43d11da75c3c', 'request_id': 'req-39fc53f5-aa65-47ea-8837-bf905ad9db3e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.602366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd329ec478c7b49ea892e43d11da75c3c', 'request_id': 'req-39fc53f5-aa65-47ea-8837-bf905ad9db3e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.614374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] The token cache is being invalidate because project d329ec478c7b49ea892e43d11da75c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:16.614656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.615316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.616746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1202/2388] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:16 2022] DELETE /identity/v3/projects/d329ec478c7b49ea892e43d11da75c3c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:16.620726 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc468e66-26ba-4232-9b6f-1bb8a9251bfb service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:16.631291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc468e66-26ba-4232-9b6f-1bb8a9251bfb service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:16.656576 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:16.689961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8518ba5-eb44-464c-a6dc-cde0f2d8611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:16.690580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8518ba5-eb44-464c-a6dc-cde0f2d8611a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:16.690855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8518ba5-eb44-464c-a6dc-cde0f2d8611a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:16.691156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8518ba5-eb44-464c-a6dc-cde0f2d8611a admin admin] PATH_INFO: `/v3/users/fe392f2787294699bfab1468d3f0e567` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:16.692295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8518ba5-eb44-464c-a6dc-cde0f2d8611a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe392f2787294699bfab1468d3f0e567)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:16.694203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8518ba5-eb44-464c-a6dc-cde0f2d8611a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:16.739881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b8518ba5-eb44-464c-a6dc-cde0f2d8611a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe392f2787294699bfab1468d3f0e567'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.747657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b8518ba5-eb44-464c-a6dc-cde0f2d8611a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe392f2787294699bfab1468d3f0e567'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.748249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b8518ba5-eb44-464c-a6dc-cde0f2d8611a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe392f2787294699bfab1468d3f0e567'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.748832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b8518ba5-eb44-464c-a6dc-cde0f2d8611a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe392f2787294699bfab1468d3f0e567'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.760616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b8518ba5-eb44-464c-a6dc-cde0f2d8611a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe392f2787294699bfab1468d3f0e567'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:16.772831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1187/2389] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:39:16 2022] DELETE /identity/v3/users/fe392f2787294699bfab1468d3f0e567 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:17.041433 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:17.043566 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:17.060108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc53f5-aa65-47ea-8837-bf905ad9db3e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:17.123580 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:17.124207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:17.124453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:17.124717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000 admin admin] PATH_INFO: `/v3/projects/f0c74beaa78d4d3cb1ac3e838d311740` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:17.125828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c74beaa78d4d3cb1ac3e838d311740)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:17.127788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:17.161494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:17.175018 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c74beaa78d4d3cb1ac3e838d311740', 'request_id': 'req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:17.180654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c74beaa78d4d3cb1ac3e838d311740', 'request_id': 'req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:17.186838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c74beaa78d4d3cb1ac3e838d311740', 'request_id': 'req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:17.201159 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000 admin admin] The token cache is being invalidate because project f0c74beaa78d4d3cb1ac3e838d311740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:17.201448 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:17.202073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e0b93f5e-5e97-4570-abd5-0d16cb0ad000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:17.203586 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1203/2390] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:17 2022] DELETE /identity/v3/projects/f0c74beaa78d4d3cb1ac3e838d311740 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:39:17.208544 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1af43-155c-4542-b873-1abfb126e094 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:17.209009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1af43-155c-4542-b873-1abfb126e094 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:17.209105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1af43-155c-4542-b873-1abfb126e094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:17.228537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1cf1af43-155c-4542-b873-1abfb126e094 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:17.229716 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1cf1af43-155c-4542-b873-1abfb126e094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:17.294483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1188/2391] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:39:17.297605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13777c57-2368-46c6-bf52-1aedfdd37c5a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:17.297954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13777c57-2368-46c6-bf52-1aedfdd37c5a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:17.298301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13777c57-2368-46c6-bf52-1aedfdd37c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:17.319077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-13777c57-2368-46c6-bf52-1aedfdd37c5a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:17.320541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-13777c57-2368-46c6-bf52-1aedfdd37c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:17.328999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1204/2392] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:39:17.333313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1af43-155c-4542-b873-1abfb126e094 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:17.343563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1af43-155c-4542-b873-1abfb126e094 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:17.348092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca215e7b-5e74-41fb-ab1e-648a2466eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:17.348670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca215e7b-5e74-41fb-ab1e-648a2466eeef admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:17.348942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca215e7b-5e74-41fb-ab1e-648a2466eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:17.349206 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca215e7b-5e74-41fb-ab1e-648a2466eeef admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:17.349870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca215e7b-5e74-41fb-ab1e-648a2466eeef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:39:17.350162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca215e7b-5e74-41fb-ab1e-648a2466eeef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:17.351763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca215e7b-5e74-41fb-ab1e-648a2466eeef admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:17.362855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1189/2393] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:39:17.366958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13777c57-2368-46c6-bf52-1aedfdd37c5a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:17.376006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13777c57-2368-46c6-bf52-1aedfdd37c5a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:17.380638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172972-6ce6-4ee5-9cd6-267a44494e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:17.381220 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172972-6ce6-4ee5-9cd6-267a44494e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:17.381494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172972-6ce6-4ee5-9cd6-267a44494e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:17.381761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172972-6ce6-4ee5-9cd6-267a44494e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:17.382367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2172972-6ce6-4ee5-9cd6-267a44494e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:17.384273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2172972-6ce6-4ee5-9cd6-267a44494e6d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:17.413136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1205/2394] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:39:17 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:17.417277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca215e7b-5e74-41fb-ab1e-648a2466eeef admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:17.427235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca215e7b-5e74-41fb-ab1e-648a2466eeef admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:17.458439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:17.484367 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3187d92-7586-45e7-a6c1-99d8669afaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:17.484956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3187d92-7586-45e7-a6c1-99d8669afaae admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:17.485232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3187d92-7586-45e7-a6c1-99d8669afaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:17.485502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3187d92-7586-45e7-a6c1-99d8669afaae admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:17.486109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3187d92-7586-45e7-a6c1-99d8669afaae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:17.488069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3187d92-7586-45e7-a6c1-99d8669afaae admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:17.508266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1190/2395] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:39:17 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:17.512988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172972-6ce6-4ee5-9cd6-267a44494e6d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:17.523814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172972-6ce6-4ee5-9cd6-267a44494e6d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:17.529365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23876e-ee49-4742-8479-f734ebce4db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:17.529940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23876e-ee49-4742-8479-f734ebce4db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:17.530210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23876e-ee49-4742-8479-f734ebce4db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:17.530474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23876e-ee49-4742-8479-f734ebce4db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:17.531128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23876e-ee49-4742-8479-f734ebce4db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:17.532943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23876e-ee49-4742-8479-f734ebce4db5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:17.542414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1206/2396] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:17.546224 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3187d92-7586-45e7-a6c1-99d8669afaae admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:17.555995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3187d92-7586-45e7-a6c1-99d8669afaae admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:17.561203 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8bd16-dc4f-4675-aea9-007f6738cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:17.561783 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8bd16-dc4f-4675-aea9-007f6738cd1d admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:17.562057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8bd16-dc4f-4675-aea9-007f6738cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:17.562358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8bd16-dc4f-4675-aea9-007f6738cd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:17.562994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8bd16-dc4f-4675-aea9-007f6738cd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:17.564624 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8bd16-dc4f-4675-aea9-007f6738cd1d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:17.575855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1191/2397] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:17.584960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23876e-ee49-4742-8479-f734ebce4db5 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:17.595472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23876e-ee49-4742-8479-f734ebce4db5 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:17.600028 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a0afc-d057-4300-b110-07b649c4f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:17.600657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a0afc-d057-4300-b110-07b649c4f659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:17.600928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a0afc-d057-4300-b110-07b649c4f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:17.601193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a0afc-d057-4300-b110-07b649c4f659 admin admin] PATH_INFO: `/v3/projects/b3e3b265f8f54278895893735c31de5a/users/ff056f66504c48ccb4d2f2400459d0e6/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:17.615735 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a0afc-d057-4300-b110-07b649c4f659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e3b265f8f54278895893735c31de5a, user_id=ff056f66504c48ccb4d2f2400459d0e6, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:17.618666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a0afc-d057-4300-b110-07b649c4f659 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:17.631074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1207/2398] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:17 2022] PUT /identity/v3/projects/b3e3b265f8f54278895893735c31de5a/users/ff056f66504c48ccb4d2f2400459d0e6/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:17.642237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44365e9-d844-463c-9523-6dfbe4f80814 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:17.642516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44365e9-d844-463c-9523-6dfbe4f80814 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:17.642792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44365e9-d844-463c-9523-6dfbe4f80814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:17.670883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f44365e9-d844-463c-9523-6dfbe4f80814 None None] MFA Rules not processed for user `ff056f66504c48ccb4d2f2400459d0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:17.672080 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f44365e9-d844-463c-9523-6dfbe4f80814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:17.734884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1192/2399] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:17.745858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a0afc-d057-4300-b110-07b649c4f659 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:17.747633 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-917a0afc-d057-4300-b110-07b649c4f659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:17.803534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a0afc-d057-4300-b110-07b649c4f659 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:17.807292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37e01e-c09c-4868-adbb-17c4b8aa364f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:17.807889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37e01e-c09c-4868-adbb-17c4b8aa364f service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:17.808225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37e01e-c09c-4868-adbb-17c4b8aa364f service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:17.808477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37e01e-c09c-4868-adbb-17c4b8aa364f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:17.816815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37e01e-c09c-4868-adbb-17c4b8aa364f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:17.818233 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37e01e-c09c-4868-adbb-17c4b8aa364f service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:17.826859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1208/2400] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:20.964677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44365e9-d844-463c-9523-6dfbe4f80814 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:21.027937 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44365e9-d844-463c-9523-6dfbe4f80814 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:21.032416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:21.033026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:21.033301 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:21.033567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] PATH_INFO: `/v3/users/ff056f66504c48ccb4d2f2400459d0e6` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:21.034664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff056f66504c48ccb4d2f2400459d0e6)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:21.036616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:21.079361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:21.080978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff056f66504c48ccb4d2f2400459d0e6'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:21.088736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff056f66504c48ccb4d2f2400459d0e6'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:21.089581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff056f66504c48ccb4d2f2400459d0e6'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:21.090948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff056f66504c48ccb4d2f2400459d0e6'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:21.102735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff056f66504c48ccb4d2f2400459d0e6'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:21.114601 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1193/2401] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:39:20 2022] DELETE /identity/v3/users/ff056f66504c48ccb4d2f2400459d0e6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:21.119042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bef2b-ea51-4cc4-bab6-e70888c376f9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:21.119577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bef2b-ea51-4cc4-bab6-e70888c376f9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:21.119684 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bef2b-ea51-4cc4-bab6-e70888c376f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:21.138305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-fa1bef2b-ea51-4cc4-bab6-e70888c376f9 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:21.139586 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fa1bef2b-ea51-4cc4-bab6-e70888c376f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:21.189481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:21.200619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1209/2402] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:21.209957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:21.211386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:21.267341 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed9f0b-4dc9-4387-8c80-01f82c983dd3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:21.270902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb55088-79aa-4b20-a0bb-60adf9201272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:21.271519 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb55088-79aa-4b20-a0bb-60adf9201272 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:21.271793 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb55088-79aa-4b20-a0bb-60adf9201272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:21.272056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb55088-79aa-4b20-a0bb-60adf9201272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:21.281002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb55088-79aa-4b20-a0bb-60adf9201272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:21.282408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb55088-79aa-4b20-a0bb-60adf9201272 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:21.291598 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1194/2403] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:21.559111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bef2b-ea51-4cc4-bab6-e70888c376f9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:21.560723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fa1bef2b-ea51-4cc4-bab6-e70888c376f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:21.573729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bef2b-ea51-4cc4-bab6-e70888c376f9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:21.579013 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:21.579683 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:21.579949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:21.580338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c admin admin] PATH_INFO: `/v3/projects/b3e3b265f8f54278895893735c31de5a` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:21.581463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e3b265f8f54278895893735c31de5a)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:21.583515 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:21.630061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e3b265f8f54278895893735c31de5a', 'request_id': 'req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:21.635696 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e3b265f8f54278895893735c31de5a', 'request_id': 'req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:21.642033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e3b265f8f54278895893735c31de5a', 'request_id': 'req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:21.654362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c admin admin] The token cache is being invalidate because project b3e3b265f8f54278895893735c31de5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:21.654644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:21.655278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-031015d8-5cb2-4dd1-ae17-1e4ddd345f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:21.656747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1210/2404] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:21 2022] DELETE /identity/v3/projects/b3e3b265f8f54278895893735c31de5a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:21.661509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0ba71-8098-4562-a2a9-36f891320596 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:21.661819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0ba71-8098-4562-a2a9-36f891320596 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:21.662090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0ba71-8098-4562-a2a9-36f891320596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:21.681521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-06d0ba71-8098-4562-a2a9-36f891320596 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:21.682704 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-06d0ba71-8098-4562-a2a9-36f891320596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:21.741100 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1195/2405] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:21.749555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff6ce-7c4b-4d54-a469-7bdb615fd7c4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:21.749836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff6ce-7c4b-4d54-a469-7bdb615fd7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:21.750109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff6ce-7c4b-4d54-a469-7bdb615fd7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:21.770788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-969ff6ce-7c4b-4d54-a469-7bdb615fd7c4 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:21.771993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-969ff6ce-7c4b-4d54-a469-7bdb615fd7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:21.780009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1211/2406] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:21.784069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0ba71-8098-4562-a2a9-36f891320596 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:21.794402 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0ba71-8098-4562-a2a9-36f891320596 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:21.798984 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c2ee0-9560-438d-90fd-d025e3604be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:21.799606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c2ee0-9560-438d-90fd-d025e3604be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:21.799879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c2ee0-9560-438d-90fd-d025e3604be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:21.800145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c2ee0-9560-438d-90fd-d025e3604be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:21.800779 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c2ee0-9560-438d-90fd-d025e3604be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:39:21.801076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c2ee0-9560-438d-90fd-d025e3604be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:21.802646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c2ee0-9560-438d-90fd-d025e3604be1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:21.814570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1196/2407] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:39:21.818754 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ff6ce-7c4b-4d54-a469-7bdb615fd7c4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:21.827743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ff6ce-7c4b-4d54-a469-7bdb615fd7c4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:21.832291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b575e1-c5eb-44fe-a436-2d44a726d1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:21.832866 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b575e1-c5eb-44fe-a436-2d44a726d1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:21.833137 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b575e1-c5eb-44fe-a436-2d44a726d1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:21.833399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b575e1-c5eb-44fe-a436-2d44a726d1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:21.834006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b575e1-c5eb-44fe-a436-2d44a726d1b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:21.835903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b575e1-c5eb-44fe-a436-2d44a726d1b8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:21.861616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1212/2408] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:39:21 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:39:21.865563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c2ee0-9560-438d-90fd-d025e3604be1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:21.876197 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c2ee0-9560-438d-90fd-d025e3604be1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:21.922921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:21.932909 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bec58-774d-4b96-b926-0291c0b29115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:21.933498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bec58-774d-4b96-b926-0291c0b29115 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:21.934356 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bec58-774d-4b96-b926-0291c0b29115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:21.934642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bec58-774d-4b96-b926-0291c0b29115 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:21.935277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bec58-774d-4b96-b926-0291c0b29115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:21.937174 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bec58-774d-4b96-b926-0291c0b29115 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:21.957103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1197/2409] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:39:21 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:21.961401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b575e1-c5eb-44fe-a436-2d44a726d1b8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:21.971438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b575e1-c5eb-44fe-a436-2d44a726d1b8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:21.975988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65bb47-1ba8-45c7-b545-d66b522bcae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:21.976562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65bb47-1ba8-45c7-b545-d66b522bcae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:21.976836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65bb47-1ba8-45c7-b545-d66b522bcae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:21.977103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65bb47-1ba8-45c7-b545-d66b522bcae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:21.977737 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65bb47-1ba8-45c7-b545-d66b522bcae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:21.979331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65bb47-1ba8-45c7-b545-d66b522bcae4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:21.990660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1213/2410] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:21.994654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bec58-774d-4b96-b926-0291c0b29115 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:22.005207 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bec58-774d-4b96-b926-0291c0b29115 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:22.009826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290bd7-b00a-4b0d-8523-ebea8f51ead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:22.010408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290bd7-b00a-4b0d-8523-ebea8f51ead0 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.010683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290bd7-b00a-4b0d-8523-ebea8f51ead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.010950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290bd7-b00a-4b0d-8523-ebea8f51ead0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.011619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce290bd7-b00a-4b0d-8523-ebea8f51ead0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:22.013184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce290bd7-b00a-4b0d-8523-ebea8f51ead0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:22.023334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1198/2411] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:22.028123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65bb47-1ba8-45c7-b545-d66b522bcae4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:22.037798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65bb47-1ba8-45c7-b545-d66b522bcae4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:22.042389 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b6aec-aca1-4232-b53a-8f3c6756bb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:22.043694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b6aec-aca1-4232-b53a-8f3c6756bb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.043974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b6aec-aca1-4232-b53a-8f3c6756bb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.044243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b6aec-aca1-4232-b53a-8f3c6756bb2f admin admin] PATH_INFO: `/v3/projects/77d656d48e6046a98645d69f89f30d8e/users/2a2a377f021447289ca14c28f288d9db/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.058259 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b6aec-aca1-4232-b53a-8f3c6756bb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d656d48e6046a98645d69f89f30d8e, user_id=2a2a377f021447289ca14c28f288d9db, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:22.060922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b6aec-aca1-4232-b53a-8f3c6756bb2f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:22.073670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1214/2412] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:22 2022] PUT /identity/v3/projects/77d656d48e6046a98645d69f89f30d8e/users/2a2a377f021447289ca14c28f288d9db/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:22.083980 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c70ec-139a-43ba-a699-2b43c58156e0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.084374 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c70ec-139a-43ba-a699-2b43c58156e0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.084752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c70ec-139a-43ba-a699-2b43c58156e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.112738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3c6c70ec-139a-43ba-a699-2b43c58156e0 None None] MFA Rules not processed for user `2a2a377f021447289ca14c28f288d9db`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:22.113922 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3c6c70ec-139a-43ba-a699-2b43c58156e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:22.175776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1199/2413] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:22.180232 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b6aec-aca1-4232-b53a-8f3c6756bb2f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:22.240008 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b6aec-aca1-4232-b53a-8f3c6756bb2f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:22.244655 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49000-08a2-4e92-8a49-357605d1774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:22.245189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49000-08a2-4e92-8a49-357605d1774a admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.245461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49000-08a2-4e92-8a49-357605d1774a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.245726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49000-08a2-4e92-8a49-357605d1774a admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.246372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e49000-08a2-4e92-8a49-357605d1774a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:22.248252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e49000-08a2-4e92-8a49-357605d1774a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:22.273234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1215/2414] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:39:22 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:22.278044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c70ec-139a-43ba-a699-2b43c58156e0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:22.288964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c70ec-139a-43ba-a699-2b43c58156e0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:22.343926 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4944e9c-7606-4615-ae66-bb2498582774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:22.344517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4944e9c-7606-4615-ae66-bb2498582774 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.344790 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4944e9c-7606-4615-ae66-bb2498582774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.345059 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4944e9c-7606-4615-ae66-bb2498582774 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.345677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4944e9c-7606-4615-ae66-bb2498582774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:22.347605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4944e9c-7606-4615-ae66-bb2498582774 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:22.372616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1200/2415] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:39:22 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:22.373631 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49000-08a2-4e92-8a49-357605d1774a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:22.380209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:22.384278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49000-08a2-4e92-8a49-357605d1774a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:22.390006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0d4e7-e71e-41ae-ad48-0ab0758c496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:22.390739 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0d4e7-e71e-41ae-ad48-0ab0758c496f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.391199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0d4e7-e71e-41ae-ad48-0ab0758c496f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.391618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0d4e7-e71e-41ae-ad48-0ab0758c496f admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.392302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0d4e7-e71e-41ae-ad48-0ab0758c496f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:22.394142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0d4e7-e71e-41ae-ad48-0ab0758c496f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:22.405071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1216/2416] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:22.408948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4944e9c-7606-4615-ae66-bb2498582774 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:22.419363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4944e9c-7606-4615-ae66-bb2498582774 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:22.424026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d37a51-e58e-47b5-b6fb-439f4d985f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:22.424609 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d37a51-e58e-47b5-b6fb-439f4d985f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.424886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d37a51-e58e-47b5-b6fb-439f4d985f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.425154 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d37a51-e58e-47b5-b6fb-439f4d985f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.425788 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d37a51-e58e-47b5-b6fb-439f4d985f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:22.427422 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d37a51-e58e-47b5-b6fb-439f4d985f25 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:22.437693 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1201/2417] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:22.441547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0d4e7-e71e-41ae-ad48-0ab0758c496f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:22.451501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0d4e7-e71e-41ae-ad48-0ab0758c496f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:22.455958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3ed20-1071-4261-8cee-08ac6ff68ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:22.456606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3ed20-1071-4261-8cee-08ac6ff68ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.456876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3ed20-1071-4261-8cee-08ac6ff68ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.457143 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3ed20-1071-4261-8cee-08ac6ff68ec5 admin admin] PATH_INFO: `/v3/projects/85dbea31968643419791b5d6cd4eb390/users/2e9e30a1c2d54e88b24ac94f2e2de283/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.471755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3ed20-1071-4261-8cee-08ac6ff68ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85dbea31968643419791b5d6cd4eb390, user_id=2e9e30a1c2d54e88b24ac94f2e2de283, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:22.474399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3ed20-1071-4261-8cee-08ac6ff68ec5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:22.487632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1217/2418] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:22 2022] PUT /identity/v3/projects/85dbea31968643419791b5d6cd4eb390/users/2e9e30a1c2d54e88b24ac94f2e2de283/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:22.552883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366aa2eb-bc7a-4e82-959e-9145700e0d84 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.553165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366aa2eb-bc7a-4e82-959e-9145700e0d84 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.553440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366aa2eb-bc7a-4e82-959e-9145700e0d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.582041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-366aa2eb-bc7a-4e82-959e-9145700e0d84 None None] MFA Rules not processed for user `2e9e30a1c2d54e88b24ac94f2e2de283`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:22.583265 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-366aa2eb-bc7a-4e82-959e-9145700e0d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:22.612856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:22.648366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1202/2419] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:22.653163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3ed20-1071-4261-8cee-08ac6ff68ec5 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:22.712972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3ed20-1071-4261-8cee-08ac6ff68ec5 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:22.719033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49bf77-6aaa-4670-ba0e-88b47bca941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:22.719812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49bf77-6aaa-4670-ba0e-88b47bca941c admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.721203 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49bf77-6aaa-4670-ba0e-88b47bca941c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.721529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49bf77-6aaa-4670-ba0e-88b47bca941c admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.722157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49bf77-6aaa-4670-ba0e-88b47bca941c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:22.724075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49bf77-6aaa-4670-ba0e-88b47bca941c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:22.752437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1218/2420] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:39:22 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:22.756286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366aa2eb-bc7a-4e82-959e-9145700e0d84 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:22.767063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366aa2eb-bc7a-4e82-959e-9145700e0d84 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:22.824463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c487d-2f5f-4c42-9679-5bbf313091a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:22.824982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c487d-2f5f-4c42-9679-5bbf313091a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.825254 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c487d-2f5f-4c42-9679-5bbf313091a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.825518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c487d-2f5f-4c42-9679-5bbf313091a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.826135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c487d-2f5f-4c42-9679-5bbf313091a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:22.828065 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c487d-2f5f-4c42-9679-5bbf313091a0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:22.848676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1203/2421] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:39:22 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:22.852664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49bf77-6aaa-4670-ba0e-88b47bca941c admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:22.863438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49bf77-6aaa-4670-ba0e-88b47bca941c admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:22.868025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453032a6-74cc-410c-af4c-340711f91150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:22.868617 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453032a6-74cc-410c-af4c-340711f91150 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.868895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453032a6-74cc-410c-af4c-340711f91150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.869170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453032a6-74cc-410c-af4c-340711f91150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.869810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453032a6-74cc-410c-af4c-340711f91150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:22.871484 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453032a6-74cc-410c-af4c-340711f91150 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:22.881712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1219/2422] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:22.885840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c487d-2f5f-4c42-9679-5bbf313091a0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:22.896141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c487d-2f5f-4c42-9679-5bbf313091a0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:22.900775 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61bb21-e3d2-4db1-bf8e-b975689d8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:22.901412 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61bb21-e3d2-4db1-bf8e-b975689d8184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:22.901943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61bb21-e3d2-4db1-bf8e-b975689d8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:22.902218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61bb21-e3d2-4db1-bf8e-b975689d8184 admin admin] PATH_INFO: `/v3/projects/57d9f6f15dac4c558ee736ec19ebc879/users/708c71ee9baf4c26966bcfa0ce9afe26/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:22.917234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61bb21-e3d2-4db1-bf8e-b975689d8184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d9f6f15dac4c558ee736ec19ebc879, user_id=708c71ee9baf4c26966bcfa0ce9afe26, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:22.920503 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61bb21-e3d2-4db1-bf8e-b975689d8184 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:22.932970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1204/2423] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:22 2022] PUT /identity/v3/projects/57d9f6f15dac4c558ee736ec19ebc879/users/708c71ee9baf4c26966bcfa0ce9afe26/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:22.936969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453032a6-74cc-410c-af4c-340711f91150 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:22.946989 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453032a6-74cc-410c-af4c-340711f91150 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:23.003045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73a6e0-2fca-49c3-9d4e-4ad167538724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:23.003691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a6e0-2fca-49c3-9d4e-4ad167538724 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:23.003961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a6e0-2fca-49c3-9d4e-4ad167538724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:23.004223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a6e0-2fca-49c3-9d4e-4ad167538724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:23.004978 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73a6e0-2fca-49c3-9d4e-4ad167538724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:23.006564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73a6e0-2fca-49c3-9d4e-4ad167538724 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:23.016081 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1220/2424] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:23.020368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61bb21-e3d2-4db1-bf8e-b975689d8184 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:23.031351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61bb21-e3d2-4db1-bf8e-b975689d8184 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:23.035897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ed34-36ff-4122-8676-e9b84ec639a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:23.036530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ed34-36ff-4122-8676-e9b84ec639a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:23.036800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ed34-36ff-4122-8676-e9b84ec639a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:23.037066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ed34-36ff-4122-8676-e9b84ec639a7 admin admin] PATH_INFO: `/v3/projects/57d9f6f15dac4c558ee736ec19ebc879/users/708c71ee9baf4c26966bcfa0ce9afe26/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:23.038927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082ed34-36ff-4122-8676-e9b84ec639a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d9f6f15dac4c558ee736ec19ebc879, user_id=708c71ee9baf4c26966bcfa0ce9afe26, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:23.041546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082ed34-36ff-4122-8676-e9b84ec639a7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:23.051993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1205/2425] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:23 2022] PUT /identity/v3/projects/57d9f6f15dac4c558ee736ec19ebc879/users/708c71ee9baf4c26966bcfa0ce9afe26/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:23.061940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dce86-50af-4125-b8de-605dea3c1574 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:23.062219 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dce86-50af-4125-b8de-605dea3c1574 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:23.062485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dce86-50af-4125-b8de-605dea3c1574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:23.089021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8c1dce86-50af-4125-b8de-605dea3c1574 None None] MFA Rules not processed for user `708c71ee9baf4c26966bcfa0ce9afe26`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:23.090661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8c1dce86-50af-4125-b8de-605dea3c1574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:23.118657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:23.159600 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1221/2426] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:23.170726 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ed34-36ff-4122-8676-e9b84ec639a7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:23.172428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3082ed34-36ff-4122-8676-e9b84ec639a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:23.228748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ed34-36ff-4122-8676-e9b84ec639a7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:23.232495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e49e4-402e-4095-b804-2c042c6ae988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:23.233086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e49e4-402e-4095-b804-2c042c6ae988 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:23.233360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e49e4-402e-4095-b804-2c042c6ae988 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:23.233644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e49e4-402e-4095-b804-2c042c6ae988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:23.265732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:23.289624 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e49e4-402e-4095-b804-2c042c6ae988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:23.291049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e49e4-402e-4095-b804-2c042c6ae988 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:23.299774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1206/2427] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:24.787058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dce86-50af-4125-b8de-605dea3c1574 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:24.788504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8c1dce86-50af-4125-b8de-605dea3c1574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:24.800126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dce86-50af-4125-b8de-605dea3c1574 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:24.803640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efc688-92d6-4fed-bd5b-9acf1e884415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:24.804225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efc688-92d6-4fed-bd5b-9acf1e884415 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:24.804497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efc688-92d6-4fed-bd5b-9acf1e884415 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:24.804765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efc688-92d6-4fed-bd5b-9acf1e884415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:24.860198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efc688-92d6-4fed-bd5b-9acf1e884415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:24.861545 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efc688-92d6-4fed-bd5b-9acf1e884415 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:24.870193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1222/2428] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:25.390289 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e49e4-402e-4095-b804-2c042c6ae988 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:25.398702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e49e4-402e-4095-b804-2c042c6ae988 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:25.402534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826df6f-281c-4347-b927-66a4e662cf3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:25.403149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826df6f-281c-4347-b927-66a4e662cf3e service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:25.403426 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826df6f-281c-4347-b927-66a4e662cf3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:25.403691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826df6f-281c-4347-b927-66a4e662cf3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:25.412331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826df6f-281c-4347-b927-66a4e662cf3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:25.413727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826df6f-281c-4347-b927-66a4e662cf3e service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:25.423408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1207/2429] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:29.261384 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efc688-92d6-4fed-bd5b-9acf1e884415 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:29.324452 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efc688-92d6-4fed-bd5b-9acf1e884415 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:29.328929 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:29.329541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:29.329818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:29.330087 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] PATH_INFO: `/v3/users/2a2a377f021447289ca14c28f288d9db` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:29.331216 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2a377f021447289ca14c28f288d9db)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:29.333139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:29.378402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2a377f021447289ca14c28f288d9db'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:29.385131 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2a377f021447289ca14c28f288d9db'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:29.392173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2a377f021447289ca14c28f288d9db'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:29.392833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2a377f021447289ca14c28f288d9db'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:29.394789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:29.406548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2a377f021447289ca14c28f288d9db'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:29.412496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1223/2430] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:39:29 2022] DELETE /identity/v3/users/2a2a377f021447289ca14c28f288d9db => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:29.422415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605f9de-fd50-40fd-a779-bcc2a429fe3f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:29.422920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605f9de-fd50-40fd-a779-bcc2a429fe3f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:29.423044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605f9de-fd50-40fd-a779-bcc2a429fe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:29.442122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0605f9de-fd50-40fd-a779-bcc2a429fe3f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:29.443323 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0605f9de-fd50-40fd-a779-bcc2a429fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:29.501662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1208/2431] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:29.511285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:29.512680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:29.568402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7c52b-9bae-4dc1-b1b1-323cfd8ceeb7 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:29.572268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03591b5-9e0a-4e97-9fde-74c03ba6a0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:29.572863 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03591b5-9e0a-4e97-9fde-74c03ba6a0bc service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:29.573137 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03591b5-9e0a-4e97-9fde-74c03ba6a0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:29.573400 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03591b5-9e0a-4e97-9fde-74c03ba6a0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:29.583972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03591b5-9e0a-4e97-9fde-74c03ba6a0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:29.585410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03591b5-9e0a-4e97-9fde-74c03ba6a0bc service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:29.597029 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1224/2432] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:29.862644 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605f9de-fd50-40fd-a779-bcc2a429fe3f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:29.864263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0605f9de-fd50-40fd-a779-bcc2a429fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:29.876108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605f9de-fd50-40fd-a779-bcc2a429fe3f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:29.880657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:29.881434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:29.881707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:29.881974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] PATH_INFO: `/v3/projects/77d656d48e6046a98645d69f89f30d8e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:29.883123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d656d48e6046a98645d69f89f30d8e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:29.885015 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:29.931843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d656d48e6046a98645d69f89f30d8e', 'request_id': 'req-6c5739ca-c781-4edb-8acb-cbe32d0acf74'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:29.937307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d656d48e6046a98645d69f89f30d8e', 'request_id': 'req-6c5739ca-c781-4edb-8acb-cbe32d0acf74'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:29.943262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d656d48e6046a98645d69f89f30d8e', 'request_id': 'req-6c5739ca-c781-4edb-8acb-cbe32d0acf74'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:29.956054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] The token cache is being invalidate because project 77d656d48e6046a98645d69f89f30d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:29.956341 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:29.956953 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:29.958419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1209/2433] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:29 2022] DELETE /identity/v3/projects/77d656d48e6046a98645d69f89f30d8e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:29.962424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03591b5-9e0a-4e97-9fde-74c03ba6a0bc service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:29.974066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03591b5-9e0a-4e97-9fde-74c03ba6a0bc service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:30.035954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:30.036519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:30.036799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:30.037067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] PATH_INFO: `/v3/users/2e9e30a1c2d54e88b24ac94f2e2de283` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:30.038207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9e30a1c2d54e88b24ac94f2e2de283)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:30.041690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:30.092769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9e30a1c2d54e88b24ac94f2e2de283'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.099861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9e30a1c2d54e88b24ac94f2e2de283'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.107969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9e30a1c2d54e88b24ac94f2e2de283'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.108569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9e30a1c2d54e88b24ac94f2e2de283'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.120875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9e30a1c2d54e88b24ac94f2e2de283'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.127484 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1225/2434] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:39:29 2022] DELETE /identity/v3/users/2e9e30a1c2d54e88b24ac94f2e2de283 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:30.419645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:30.421700 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:30.437584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5739ca-c781-4edb-8acb-cbe32d0acf74 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:30.482468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:30.496728 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:30.497356 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:30.497632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:30.497904 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] PATH_INFO: `/v3/projects/85dbea31968643419791b5d6cd4eb390` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:30.499011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85dbea31968643419791b5d6cd4eb390)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:30.500989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:30.546617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85dbea31968643419791b5d6cd4eb390', 'request_id': 'req-27b26c66-6f64-4e73-bc24-29073b96bd47'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.551928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85dbea31968643419791b5d6cd4eb390', 'request_id': 'req-27b26c66-6f64-4e73-bc24-29073b96bd47'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.557802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85dbea31968643419791b5d6cd4eb390', 'request_id': 'req-27b26c66-6f64-4e73-bc24-29073b96bd47'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.570247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] The token cache is being invalidate because project 85dbea31968643419791b5d6cd4eb390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:30.570526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.571160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.572616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1210/2435] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:30 2022] DELETE /identity/v3/projects/85dbea31968643419791b5d6cd4eb390 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:30.577169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:30.578646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:30.587741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:30.591426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afdf95-c2be-4055-aad5-df8e54b4be68 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:30.648679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4bd88-3600-4904-8563-ef6d9ff06953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:30.649295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4bd88-3600-4904-8563-ef6d9ff06953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:30.649572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4bd88-3600-4904-8563-ef6d9ff06953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:30.649842 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4bd88-3600-4904-8563-ef6d9ff06953 admin admin] PATH_INFO: `/v3/users/708c71ee9baf4c26966bcfa0ce9afe26` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:30.650939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4bd88-3600-4904-8563-ef6d9ff06953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=708c71ee9baf4c26966bcfa0ce9afe26)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:30.653142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4bd88-3600-4904-8563-ef6d9ff06953 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:30.700232 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a7f4bd88-3600-4904-8563-ef6d9ff06953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708c71ee9baf4c26966bcfa0ce9afe26'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.706973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a7f4bd88-3600-4904-8563-ef6d9ff06953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708c71ee9baf4c26966bcfa0ce9afe26'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.714536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a7f4bd88-3600-4904-8563-ef6d9ff06953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708c71ee9baf4c26966bcfa0ce9afe26'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.715526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a7f4bd88-3600-4904-8563-ef6d9ff06953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708c71ee9baf4c26966bcfa0ce9afe26'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.727213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a7f4bd88-3600-4904-8563-ef6d9ff06953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708c71ee9baf4c26966bcfa0ce9afe26'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:30.734779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1226/2436] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:39:30 2022] DELETE /identity/v3/users/708c71ee9baf4c26966bcfa0ce9afe26 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:31.013361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:31.014828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:31.029864 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b26c66-6f64-4e73-bc24-29073b96bd47 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:31.085770 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:31.086318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:31.086593 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:31.086862 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c admin admin] PATH_INFO: `/v3/projects/57d9f6f15dac4c558ee736ec19ebc879` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:31.087984 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d9f6f15dac4c558ee736ec19ebc879)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:31.089880 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:31.136899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d9f6f15dac4c558ee736ec19ebc879', 'request_id': 'req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:31.142351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d9f6f15dac4c558ee736ec19ebc879', 'request_id': 'req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:31.148267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d9f6f15dac4c558ee736ec19ebc879', 'request_id': 'req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:31.161255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c admin admin] The token cache is being invalidate because project 57d9f6f15dac4c558ee736ec19ebc879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:31.161535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:31.162129 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7ff6fc9b-6ca0-4ded-8c71-a23583784b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:31.163693 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1211/2437] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:31 2022] DELETE /identity/v3/projects/57d9f6f15dac4c558ee736ec19ebc879 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:31.169236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ef73b-f23e-4344-a8f6-8f234cdcc84f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:31.169520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ef73b-f23e-4344-a8f6-8f234cdcc84f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:31.169817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ef73b-f23e-4344-a8f6-8f234cdcc84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:31.188714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-466ef73b-f23e-4344-a8f6-8f234cdcc84f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:31.189892 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-466ef73b-f23e-4344-a8f6-8f234cdcc84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:31.246479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1227/2438] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:31.255337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345183-1ef5-4b03-bccd-9dbac1d0ea32 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:31.255651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345183-1ef5-4b03-bccd-9dbac1d0ea32 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:31.255928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345183-1ef5-4b03-bccd-9dbac1d0ea32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:31.270479 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:31.276607 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d4345183-1ef5-4b03-bccd-9dbac1d0ea32 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:31.279020 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d4345183-1ef5-4b03-bccd-9dbac1d0ea32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:31.288412 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1212/2439] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:31.292529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ef73b-f23e-4344-a8f6-8f234cdcc84f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:31.302915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ef73b-f23e-4344-a8f6-8f234cdcc84f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:31.307618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68d057-72ac-4c59-8486-c3d454118b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:31.308207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68d057-72ac-4c59-8486-c3d454118b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:31.308484 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68d057-72ac-4c59-8486-c3d454118b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:31.308802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68d057-72ac-4c59-8486-c3d454118b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:31.309447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68d057-72ac-4c59-8486-c3d454118b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:39:31.309751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68d057-72ac-4c59-8486-c3d454118b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:31.311353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68d057-72ac-4c59-8486-c3d454118b43 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:31.322607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1228/2440] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:39:31.326682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345183-1ef5-4b03-bccd-9dbac1d0ea32 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:31.336081 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345183-1ef5-4b03-bccd-9dbac1d0ea32 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:31.341209 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccab4d3-37ff-44f6-958b-b077616feed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:31.341792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccab4d3-37ff-44f6-958b-b077616feed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:31.342063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccab4d3-37ff-44f6-958b-b077616feed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:31.342327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccab4d3-37ff-44f6-958b-b077616feed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:31.343050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccab4d3-37ff-44f6-958b-b077616feed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:31.344966 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccab4d3-37ff-44f6-958b-b077616feed5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:31.377091 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1213/2441] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:39:31 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:31.388552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68d057-72ac-4c59-8486-c3d454118b43 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:31.400044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68d057-72ac-4c59-8486-c3d454118b43 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:31.410235 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:31.462943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab0d35-bfe9-49f8-88c8-feb0bb045d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:31.463569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab0d35-bfe9-49f8-88c8-feb0bb045d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:31.463862 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab0d35-bfe9-49f8-88c8-feb0bb045d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:31.464119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab0d35-bfe9-49f8-88c8-feb0bb045d39 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:31.464723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab0d35-bfe9-49f8-88c8-feb0bb045d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:31.467209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab0d35-bfe9-49f8-88c8-feb0bb045d39 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:31.492465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1229/2442] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:39:31 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:31.496774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccab4d3-37ff-44f6-958b-b077616feed5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:31.508066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccab4d3-37ff-44f6-958b-b077616feed5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:31.513558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af335a1b-41ef-45a4-9e4c-97ca44d6bf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:31.514219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af335a1b-41ef-45a4-9e4c-97ca44d6bf2a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:31.514601 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af335a1b-41ef-45a4-9e4c-97ca44d6bf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:31.514928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af335a1b-41ef-45a4-9e4c-97ca44d6bf2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:31.515664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af335a1b-41ef-45a4-9e4c-97ca44d6bf2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:31.517464 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af335a1b-41ef-45a4-9e4c-97ca44d6bf2a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:31.528281 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1214/2443] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:31.532391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab0d35-bfe9-49f8-88c8-feb0bb045d39 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:31.544300 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab0d35-bfe9-49f8-88c8-feb0bb045d39 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:31.549042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16d31f-0ba4-4ccd-828d-90968be30f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:31.549632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16d31f-0ba4-4ccd-828d-90968be30f59 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:31.549905 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16d31f-0ba4-4ccd-828d-90968be30f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:31.550172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16d31f-0ba4-4ccd-828d-90968be30f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:31.550803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16d31f-0ba4-4ccd-828d-90968be30f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:31.552411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16d31f-0ba4-4ccd-828d-90968be30f59 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:31.563388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1230/2444] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:31.568328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af335a1b-41ef-45a4-9e4c-97ca44d6bf2a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:31.579866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af335a1b-41ef-45a4-9e4c-97ca44d6bf2a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:31.584645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866bcad-0748-45cf-b980-a3fd6eff7714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:31.585344 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866bcad-0748-45cf-b980-a3fd6eff7714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:31.585620 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866bcad-0748-45cf-b980-a3fd6eff7714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:31.585891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866bcad-0748-45cf-b980-a3fd6eff7714 admin admin] PATH_INFO: `/v3/projects/98cc5401207840a387253e7bdb7ac7aa/users/e47b36dffb624db08b6b11618c9f73be/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:31.603307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866bcad-0748-45cf-b980-a3fd6eff7714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98cc5401207840a387253e7bdb7ac7aa, user_id=e47b36dffb624db08b6b11618c9f73be, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:31.606013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866bcad-0748-45cf-b980-a3fd6eff7714 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:31.621232 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1215/2445] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:31 2022] PUT /identity/v3/projects/98cc5401207840a387253e7bdb7ac7aa/users/e47b36dffb624db08b6b11618c9f73be/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:31.631196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e873a48-d882-424e-8e51-289fe90ac090 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:31.631656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e873a48-d882-424e-8e51-289fe90ac090 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:31.631774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e873a48-d882-424e-8e51-289fe90ac090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:31.662440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3e873a48-d882-424e-8e51-289fe90ac090 None None] MFA Rules not processed for user `e47b36dffb624db08b6b11618c9f73be`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:31.663783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3e873a48-d882-424e-8e51-289fe90ac090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:31.733373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1231/2446] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:31.743871 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866bcad-0748-45cf-b980-a3fd6eff7714 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:31.750712 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5866bcad-0748-45cf-b980-a3fd6eff7714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:31.811849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866bcad-0748-45cf-b980-a3fd6eff7714 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:31.816374 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1774-ae05-4196-9ce7-fa9534f3db9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:31.816978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1774-ae05-4196-9ce7-fa9534f3db9a service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:31.817255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1774-ae05-4196-9ce7-fa9534f3db9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:31.817544 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1774-ae05-4196-9ce7-fa9534f3db9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:31.826437 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa1774-ae05-4196-9ce7-fa9534f3db9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:31.827888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa1774-ae05-4196-9ce7-fa9534f3db9a service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:31.836832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1216/2447] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:41.274269 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7315f31-2510-46a6-8514-c213ba6ef793 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:41.274745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7315f31-2510-46a6-8514-c213ba6ef793 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:41.274869 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7315f31-2510-46a6-8514-c213ba6ef793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:41.294046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d7315f31-2510-46a6-8514-c213ba6ef793 None None] MFA Rules not processed for user `411b1c674ef24c2bab146208d720c0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:41.295276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d7315f31-2510-46a6-8514-c213ba6ef793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:41.349973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1232/2448] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:41.832807 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:41.842332 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1774-ae05-4196-9ce7-fa9534f3db9a service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:41.904138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1774-ae05-4196-9ce7-fa9534f3db9a service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:41.909001 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11025804-f00e-4185-a685-028b093036db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:41.909678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11025804-f00e-4185-a685-028b093036db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:41.909956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11025804-f00e-4185-a685-028b093036db admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:41.910225 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11025804-f00e-4185-a685-028b093036db admin admin] PATH_INFO: `/v3/users/e47b36dffb624db08b6b11618c9f73be` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:41.911517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11025804-f00e-4185-a685-028b093036db admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47b36dffb624db08b6b11618c9f73be)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:41.913458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11025804-f00e-4185-a685-028b093036db admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:41.974101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-11025804-f00e-4185-a685-028b093036db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47b36dffb624db08b6b11618c9f73be'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:41.983585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-11025804-f00e-4185-a685-028b093036db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47b36dffb624db08b6b11618c9f73be'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:41.984217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-11025804-f00e-4185-a685-028b093036db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47b36dffb624db08b6b11618c9f73be'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:41.984819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-11025804-f00e-4185-a685-028b093036db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47b36dffb624db08b6b11618c9f73be'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:42.001961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-11025804-f00e-4185-a685-028b093036db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47b36dffb624db08b6b11618c9f73be'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:42.019874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1217/2449] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:39:41 2022] DELETE /identity/v3/users/e47b36dffb624db08b6b11618c9f73be => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:42.024247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62d172-0b8f-4971-8c12-970ccf80d48d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:42.024602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62d172-0b8f-4971-8c12-970ccf80d48d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:42.024880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62d172-0b8f-4971-8c12-970ccf80d48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:42.044254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-de62d172-0b8f-4971-8c12-970ccf80d48d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:42.045449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-de62d172-0b8f-4971-8c12-970ccf80d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:42.064603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:42.107810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1233/2450] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:42.117700 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11025804-f00e-4185-a685-028b093036db admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:42.119428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-11025804-f00e-4185-a685-028b093036db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:42.178829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11025804-f00e-4185-a685-028b093036db admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:42.182799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2c5c-46d3-4f8a-a0f3-49979de3131a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:42.183440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2c5c-46d3-4f8a-a0f3-49979de3131a service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:42.183719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2c5c-46d3-4f8a-a0f3-49979de3131a service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:42.184019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2c5c-46d3-4f8a-a0f3-49979de3131a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:42.193429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a2c5c-46d3-4f8a-a0f3-49979de3131a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:42.194849 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a2c5c-46d3-4f8a-a0f3-49979de3131a service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:42.205861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1218/2451] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:42.485084 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62d172-0b8f-4971-8c12-970ccf80d48d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:42.486534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-de62d172-0b8f-4971-8c12-970ccf80d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:42.499824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62d172-0b8f-4971-8c12-970ccf80d48d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:42.513230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fda5c-cbb3-400b-a9f0-493b6d950858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:42.514015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fda5c-cbb3-400b-a9f0-493b6d950858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:42.514354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fda5c-cbb3-400b-a9f0-493b6d950858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:42.514595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fda5c-cbb3-400b-a9f0-493b6d950858 admin admin] PATH_INFO: `/v3/projects/98cc5401207840a387253e7bdb7ac7aa` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:42.516231 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fda5c-cbb3-400b-a9f0-493b6d950858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98cc5401207840a387253e7bdb7ac7aa)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:42.518346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fda5c-cbb3-400b-a9f0-493b6d950858 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:42.566287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dc4fda5c-cbb3-400b-a9f0-493b6d950858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98cc5401207840a387253e7bdb7ac7aa', 'request_id': 'req-dc4fda5c-cbb3-400b-a9f0-493b6d950858'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:42.572195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dc4fda5c-cbb3-400b-a9f0-493b6d950858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98cc5401207840a387253e7bdb7ac7aa', 'request_id': 'req-dc4fda5c-cbb3-400b-a9f0-493b6d950858'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:42.579607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dc4fda5c-cbb3-400b-a9f0-493b6d950858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98cc5401207840a387253e7bdb7ac7aa', 'request_id': 'req-dc4fda5c-cbb3-400b-a9f0-493b6d950858'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:42.592833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dc4fda5c-cbb3-400b-a9f0-493b6d950858 admin admin] The token cache is being invalidate because project 98cc5401207840a387253e7bdb7ac7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:39:42.593121 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dc4fda5c-cbb3-400b-a9f0-493b6d950858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:42.593731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dc4fda5c-cbb3-400b-a9f0-493b6d950858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:39:42.595279 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1234/2452] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:39:42 2022] DELETE /identity/v3/projects/98cc5401207840a387253e7bdb7ac7aa => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:42.600531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5ab0a-a382-4851-91e4-7236ab060ad7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:42.600759 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5ab0a-a382-4851-91e4-7236ab060ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:42.601035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5ab0a-a382-4851-91e4-7236ab060ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:42.622247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-14d5ab0a-a382-4851-91e4-7236ab060ad7 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:42.623522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-14d5ab0a-a382-4851-91e4-7236ab060ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:42.639943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:42.689906 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1219/2453] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:42.698476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46509a74-e7a0-458f-bb3e-585a7a774638 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:42.698771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46509a74-e7a0-458f-bb3e-585a7a774638 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:42.699100 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46509a74-e7a0-458f-bb3e-585a7a774638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:42.718543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-46509a74-e7a0-458f-bb3e-585a7a774638 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:42.719822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-46509a74-e7a0-458f-bb3e-585a7a774638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:42.727556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1235/2454] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:42.732243 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5ab0a-a382-4851-91e4-7236ab060ad7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:42.741773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5ab0a-a382-4851-91e4-7236ab060ad7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:42.746976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dae18-a00d-43db-a2ee-4a35bb00f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:42.747622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dae18-a00d-43db-a2ee-4a35bb00f751 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:42.747894 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dae18-a00d-43db-a2ee-4a35bb00f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:42.748164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dae18-a00d-43db-a2ee-4a35bb00f751 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:42.748803 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dae18-a00d-43db-a2ee-4a35bb00f751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:39:42.749100 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dae18-a00d-43db-a2ee-4a35bb00f751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:42.750685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dae18-a00d-43db-a2ee-4a35bb00f751 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:42.761994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1220/2455] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:39:42.766183 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46509a74-e7a0-458f-bb3e-585a7a774638 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:42.775371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46509a74-e7a0-458f-bb3e-585a7a774638 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:42.781290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf69f09-e722-4e7d-8ba3-293b3ce26c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:42.782033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf69f09-e722-4e7d-8ba3-293b3ce26c46 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:42.782415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf69f09-e722-4e7d-8ba3-293b3ce26c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:42.782685 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf69f09-e722-4e7d-8ba3-293b3ce26c46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:42.783325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf69f09-e722-4e7d-8ba3-293b3ce26c46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:42.786050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf69f09-e722-4e7d-8ba3-293b3ce26c46 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:42.821093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1236/2456] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:39:42 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:39:42.822453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dae18-a00d-43db-a2ee-4a35bb00f751 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:42.833500 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dae18-a00d-43db-a2ee-4a35bb00f751 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:42.890290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecea05-1669-4a4f-b3cc-7826d8391347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:42.890898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecea05-1669-4a4f-b3cc-7826d8391347 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:42.891287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecea05-1669-4a4f-b3cc-7826d8391347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:42.891626 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecea05-1669-4a4f-b3cc-7826d8391347 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:42.892314 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecea05-1669-4a4f-b3cc-7826d8391347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:42.894217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecea05-1669-4a4f-b3cc-7826d8391347 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:42.915693 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1221/2457] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:39:42 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:39:42.920361 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf69f09-e722-4e7d-8ba3-293b3ce26c46 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:42.931232 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf69f09-e722-4e7d-8ba3-293b3ce26c46 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:42.936540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c830f35-e2e5-4da7-b783-508289204345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:42.937166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c830f35-e2e5-4da7-b783-508289204345 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:42.937504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c830f35-e2e5-4da7-b783-508289204345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:42.937781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c830f35-e2e5-4da7-b783-508289204345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:42.938422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c830f35-e2e5-4da7-b783-508289204345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:42.940053 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c830f35-e2e5-4da7-b783-508289204345 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:42.953722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1237/2458] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:42.955018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecea05-1669-4a4f-b3cc-7826d8391347 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:42.967147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecea05-1669-4a4f-b3cc-7826d8391347 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:42.971963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d7c82-2e7a-420a-9192-e72e0ec26e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:42.973669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d7c82-2e7a-420a-9192-e72e0ec26e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:42.973669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d7c82-2e7a-420a-9192-e72e0ec26e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:42.973669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d7c82-2e7a-420a-9192-e72e0ec26e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:42.974055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d7c82-2e7a-420a-9192-e72e0ec26e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:42.975772 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d7c82-2e7a-420a-9192-e72e0ec26e30 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:42.993022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1222/2459] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:39:42.998255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c830f35-e2e5-4da7-b783-508289204345 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:43.012368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c830f35-e2e5-4da7-b783-508289204345 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:43.017176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37723ab-d50f-4f02-9489-1e3e44a44ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:43.017985 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37723ab-d50f-4f02-9489-1e3e44a44ada admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:43.018268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37723ab-d50f-4f02-9489-1e3e44a44ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:43.018542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37723ab-d50f-4f02-9489-1e3e44a44ada admin admin] PATH_INFO: `/v3/projects/30350f7212254bb3a5069d5f653f9625/users/ba27cac397e449c2bba4ed5ecd6be0aa/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:43.037966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37723ab-d50f-4f02-9489-1e3e44a44ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=30350f7212254bb3a5069d5f653f9625, user_id=ba27cac397e449c2bba4ed5ecd6be0aa, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:43.042200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37723ab-d50f-4f02-9489-1e3e44a44ada admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:43.058098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1238/2460] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:39:42 2022] PUT /identity/v3/projects/30350f7212254bb3a5069d5f653f9625/users/ba27cac397e449c2bba4ed5ecd6be0aa/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:39:43.063280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b4c02-a3d3-4f25-bad5-7ec2b785428c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:43.063566 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b4c02-a3d3-4f25-bad5-7ec2b785428c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:43.063840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b4c02-a3d3-4f25-bad5-7ec2b785428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:43.087074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-391b4c02-a3d3-4f25-bad5-7ec2b785428c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:43.088347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-391b4c02-a3d3-4f25-bad5-7ec2b785428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:43.159630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1223/2461] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:43.169585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37723ab-d50f-4f02-9489-1e3e44a44ada admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:43.171292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b37723ab-d50f-4f02-9489-1e3e44a44ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:43.216157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:43.228251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37723ab-d50f-4f02-9489-1e3e44a44ada admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:43.232719 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052eec9e-4fd6-415c-834a-dd672fed97d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:43.233311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052eec9e-4fd6-415c-834a-dd672fed97d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:43.233588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052eec9e-4fd6-415c-834a-dd672fed97d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:43.233859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052eec9e-4fd6-415c-834a-dd672fed97d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:43.242811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052eec9e-4fd6-415c-834a-dd672fed97d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:43.244253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052eec9e-4fd6-415c-834a-dd672fed97d6 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:43.253773 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1239/2462] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:44.178273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91229838-227d-41df-b2b2-e42edccf6fc8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:44.178778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91229838-227d-41df-b2b2-e42edccf6fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:44.178886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91229838-227d-41df-b2b2-e42edccf6fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:44.221410 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-91229838-227d-41df-b2b2-e42edccf6fc8 None None] MFA Rules not processed for user `ba27cac397e449c2bba4ed5ecd6be0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:44.222618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-91229838-227d-41df-b2b2-e42edccf6fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:44.241009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:44.311280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1224/2463] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:44.326678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052eec9e-4fd6-415c-834a-dd672fed97d6 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:44.328342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-052eec9e-4fd6-415c-834a-dd672fed97d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:44.399131 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052eec9e-4fd6-415c-834a-dd672fed97d6 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:44.403687 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef9c5c-4d85-4e2e-96cf-6630158b3145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:44.404603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef9c5c-4d85-4e2e-96cf-6630158b3145 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:44.404860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef9c5c-4d85-4e2e-96cf-6630158b3145 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:44.405238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef9c5c-4d85-4e2e-96cf-6630158b3145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:44.420268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef9c5c-4d85-4e2e-96cf-6630158b3145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:44.421849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef9c5c-4d85-4e2e-96cf-6630158b3145 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:44.431129 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1240/2464] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:39:45.800634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c82c-f7cb-4dbd-96cb-ad1bfb47fab5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:45.801115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c82c-f7cb-4dbd-96cb-ad1bfb47fab5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:45.801284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c82c-f7cb-4dbd-96cb-ad1bfb47fab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:45.820664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6179c82c-f7cb-4dbd-96cb-ad1bfb47fab5 None None] MFA Rules not processed for user `ba27cac397e449c2bba4ed5ecd6be0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:39:45.821847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6179c82c-f7cb-4dbd-96cb-ad1bfb47fab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:45.829206 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1225/2465] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:39:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:39:54.426946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=32 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:55.815507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=22 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:56.506314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef9c5c-4d85-4e2e-96cf-6630158b3145 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:39:56.508390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b6ef9c5c-4d85-4e2e-96cf-6630158b3145 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:56.587991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef9c5c-4d85-4e2e-96cf-6630158b3145 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:39:56.594039 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34208df7-3262-4856-ae4f-e07c5b71892e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:39:56.594816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34208df7-3262-4856-ae4f-e07c5b71892e service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:39:56.595196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34208df7-3262-4856-ae4f-e07c5b71892e service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:39:56.595471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34208df7-3262-4856-ae4f-e07c5b71892e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:39:56.597553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-34208df7-3262-4856-ae4f-e07c5b71892e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:39:56.611468 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34208df7-3262-4856-ae4f-e07c5b71892e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:39:56.612673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34208df7-3262-4856-ae4f-e07c5b71892e service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:39:56.627356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1241/2466] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:39:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:40:06.620198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=34 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:07.421025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9c0a4-44a5-44d7-81ef-2740596d7b37 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:07.421586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9c0a4-44a5-44d7-81ef-2740596d7b37 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:07.421586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9c0a4-44a5-44d7-81ef-2740596d7b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:07.442401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-96f9c0a4-44a5-44d7-81ef-2740596d7b37 None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:40:07.443632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-96f9c0a4-44a5-44d7-81ef-2740596d7b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:07.504336 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1226/2467] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:40:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:40:07.555745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34208df7-3262-4856-ae4f-e07c5b71892e service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:40:07.557383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-34208df7-3262-4856-ae4f-e07c5b71892e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:07.633153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34208df7-3262-4856-ae4f-e07c5b71892e service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:40:07.638407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04b16f-6f66-42db-bac4-a912706e121c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:40:07.639174 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04b16f-6f66-42db-bac4-a912706e121c service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:07.639451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04b16f-6f66-42db-bac4-a912706e121c service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:07.639876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04b16f-6f66-42db-bac4-a912706e121c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:07.650030 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04b16f-6f66-42db-bac4-a912706e121c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:40:07.651695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04b16f-6f66-42db-bac4-a912706e121c service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:40:07.660084 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1242/2468] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:40:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:40:17.495338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=25 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:17.656927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=32 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:21.864245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddda8f-7f04-4b89-823f-10395bc0c896 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:21.864784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddda8f-7f04-4b89-823f-10395bc0c896 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:21.864784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddda8f-7f04-4b89-823f-10395bc0c896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:21.884126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e8ddda8f-7f04-4b89-823f-10395bc0c896 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:40:21.885318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e8ddda8f-7f04-4b89-823f-10395bc0c896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:21.893868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1227/2469] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 7 22:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:40:21.915551 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04b16f-6f66-42db-bac4-a912706e121c service swift] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:40:21.927616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04b16f-6f66-42db-bac4-a912706e121c service swift] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:40:21.933093 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5ef77-da43-43e2-a21b-7e0e4a0575d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:40:21.933684 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5ef77-da43-43e2-a21b-7e0e4a0575d9 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:21.933957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5ef77-da43-43e2-a21b-7e0e4a0575d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:21.934222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5ef77-da43-43e2-a21b-7e0e4a0575d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:21.943476 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5ef77-da43-43e2-a21b-7e0e4a0575d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:40:21.945360 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5ef77-da43-43e2-a21b-7e0e4a0575d9 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:40:21.963458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1243/2470] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:40:26.243329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddda8f-7f04-4b89-823f-10395bc0c896 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:40:26.252940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddda8f-7f04-4b89-823f-10395bc0c896 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:40:26.256552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc52ed-ad59-4132-a10e-11cf737fac98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:40:26.257148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc52ed-ad59-4132-a10e-11cf737fac98 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:26.257423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc52ed-ad59-4132-a10e-11cf737fac98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:26.257690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc52ed-ad59-4132-a10e-11cf737fac98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:26.259588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-44dc52ed-ad59-4132-a10e-11cf737fac98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:26.269623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc52ed-ad59-4132-a10e-11cf737fac98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:40:26.271050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc52ed-ad59-4132-a10e-11cf737fac98 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:40:26.280547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1228/2471] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:40:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:40:26.426837 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adc318-54f9-49b2-8da8-a243f4380b4b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:26.427397 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adc318-54f9-49b2-8da8-a243f4380b4b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:26.427397 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adc318-54f9-49b2-8da8-a243f4380b4b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:26.428757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1244/2472] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:40:26.434961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3f36a-5aaa-40a6-9230-b065a60fd4f1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:26.435287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3f36a-5aaa-40a6-9230-b065a60fd4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:26.435552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3f36a-5aaa-40a6-9230-b065a60fd4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:26.455313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-26f3f36a-5aaa-40a6-9230-b065a60fd4f1 None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:40:26.456518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-26f3f36a-5aaa-40a6-9230-b065a60fd4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:26.465808 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1229/2473] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:40:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:40:26.478252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adc318-54f9-49b2-8da8-a243f4380b4b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:40:26.480086 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-76adc318-54f9-49b2-8da8-a243f4380b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:26.538041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adc318-54f9-49b2-8da8-a243f4380b4b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:40:26.541623 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f26387-f57c-4856-8763-d794098c5b37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6639f15880c4c718f41cd84cb79c750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:40:26.542223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f26387-f57c-4856-8763-d794098c5b37 service glance] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:26.542498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f26387-f57c-4856-8763-d794098c5b37 service glance] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:26.542781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f26387-f57c-4856-8763-d794098c5b37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:26.553165 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f26387-f57c-4856-8763-d794098c5b37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:40:26.554568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f26387-f57c-4856-8763-d794098c5b37 service glance] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:40:26.565948 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1245/2474] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:40:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:40:26.633309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26060d6-f68d-4362-b3ec-f64b53704c1a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:26.633507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26060d6-f68d-4362-b3ec-f64b53704c1a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:26.633778 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26060d6-f68d-4362-b3ec-f64b53704c1a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:26.635150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1230/2475] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 22:40:26.640383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713b4d3-3ebe-4dec-a759-ffaf2b967dc6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:26.640661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713b4d3-3ebe-4dec-a759-ffaf2b967dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:26.640924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713b4d3-3ebe-4dec-a759-ffaf2b967dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:26.661299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4713b4d3-3ebe-4dec-a759-ffaf2b967dc6 None None] MFA Rules not processed for user `8c68d5fdc4a946499ae86cdff0149470`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:40:26.662552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4713b4d3-3ebe-4dec-a759-ffaf2b967dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:26.669072 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1246/2476] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:40:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:40:26.680771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26060d6-f68d-4362-b3ec-f64b53704c1a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:40:26.682476 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f26060d6-f68d-4362-b3ec-f64b53704c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:26.696023 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26060d6-f68d-4362-b3ec-f64b53704c1a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:40:26.699534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d5386-3707-414a-bab2-51cab64cd75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:40:26.700118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d5386-3707-414a-bab2-51cab64cd75d service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:26.700962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d5386-3707-414a-bab2-51cab64cd75d service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:26.701228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d5386-3707-414a-bab2-51cab64cd75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:26.708205 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d5386-3707-414a-bab2-51cab64cd75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:40:26.709895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d5386-3707-414a-bab2-51cab64cd75d service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:40:26.717512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1231/2477] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:40:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:40:26.831110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7154409-829f-4793-84a5-32f3cdf6e8f6 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:26.831444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7154409-829f-4793-84a5-32f3cdf6e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:26.831711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7154409-829f-4793-84a5-32f3cdf6e8f6 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:26.833066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1247/2478] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 22:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 22:40:26.838349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878c805-5610-4a12-a4bd-16d9146fff50 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:26.838634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878c805-5610-4a12-a4bd-16d9146fff50 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:26.838910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878c805-5610-4a12-a4bd-16d9146fff50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:26.858910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2878c805-5610-4a12-a4bd-16d9146fff50 None None] MFA Rules not processed for user `cc8bf701e94c403ab70fcffaeb81b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:40:26.860119 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2878c805-5610-4a12-a4bd-16d9146fff50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:26.869574 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1232/2479] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 22:40:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:40:26.880408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7154409-829f-4793-84a5-32f3cdf6e8f6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:40:26.891894 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7154409-829f-4793-84a5-32f3cdf6e8f6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:40:26.895527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2494b-c05b-4f81-85d1-da0dbc03548d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:40:26.896116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2494b-c05b-4f81-85d1-da0dbc03548d service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:26.896389 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2494b-c05b-4f81-85d1-da0dbc03548d service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:26.896654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2494b-c05b-4f81-85d1-da0dbc03548d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:26.907578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2494b-c05b-4f81-85d1-da0dbc03548d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:40:26.908981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2494b-c05b-4f81-85d1-da0dbc03548d service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:40:26.920145 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1248/2480] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:40:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:40:29.044041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181bdae-4478-4e88-aa49-ddb5eb9b151c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:29.044580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181bdae-4478-4e88-aa49-ddb5eb9b151c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:29.044580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181bdae-4478-4e88-aa49-ddb5eb9b151c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:29.064530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a181bdae-4478-4e88-aa49-ddb5eb9b151c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:40:29.065752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a181bdae-4478-4e88-aa49-ddb5eb9b151c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:29.073929 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1233/2481] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 7 22:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:40:29.098717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2494b-c05b-4f81-85d1-da0dbc03548d service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:40:29.110420 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2494b-c05b-4f81-85d1-da0dbc03548d service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:40:29.116290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e5270-9c0a-4d8a-af33-64d44cb2c5ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:40:29.116893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e5270-9c0a-4d8a-af33-64d44cb2c5ad service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:29.117171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e5270-9c0a-4d8a-af33-64d44cb2c5ad service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:29.117443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e5270-9c0a-4d8a-af33-64d44cb2c5ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:29.126250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e5270-9c0a-4d8a-af33-64d44cb2c5ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:40:29.127859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e5270-9c0a-4d8a-af33-64d44cb2c5ad service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:40:29.137362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1249/2482] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:40:36.482466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82e4f1-0ba5-41f0-807b-89a3d692bb12 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:36.483398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82e4f1-0ba5-41f0-807b-89a3d692bb12 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:36.483895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82e4f1-0ba5-41f0-807b-89a3d692bb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:36.505933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5b82e4f1-0ba5-41f0-807b-89a3d692bb12 None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:40:36.507805 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5b82e4f1-0ba5-41f0-807b-89a3d692bb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:36.516188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1234/2483] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:40:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:40:36.530117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e5270-9c0a-4d8a-af33-64d44cb2c5ad service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:40:36.542194 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e5270-9c0a-4d8a-af33-64d44cb2c5ad service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:40:36.550507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04004c49-fccc-4b05-9c95-142c8c002248 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:40:36.551276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04004c49-fccc-4b05-9c95-142c8c002248 service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:36.551614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04004c49-fccc-4b05-9c95-142c8c002248 service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:36.552057 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04004c49-fccc-4b05-9c95-142c8c002248 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:36.562447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04004c49-fccc-4b05-9c95-142c8c002248 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:40:36.564367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04004c49-fccc-4b05-9c95-142c8c002248 service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:40:36.574296 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1250/2484] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:40:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:40:37.504679 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab8b4-ad01-441d-9036-596944f39f9a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:37.505267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab8b4-ad01-441d-9036-596944f39f9a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:37.505267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab8b4-ad01-441d-9036-596944f39f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:37.527211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-912ab8b4-ad01-441d-9036-596944f39f9a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:40:37.528734 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-912ab8b4-ad01-441d-9036-596944f39f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:37.539041 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1235/2485] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 7 22:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:40:37.560697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04004c49-fccc-4b05-9c95-142c8c002248 service swift] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:40:37.572665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04004c49-fccc-4b05-9c95-142c8c002248 service swift] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:40:37.578370 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35395f9-f2a3-40e3-be38-321a51747517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:40:37.578955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35395f9-f2a3-40e3-be38-321a51747517 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:37.579402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35395f9-f2a3-40e3-be38-321a51747517 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:37.579773 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35395f9-f2a3-40e3-be38-321a51747517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:37.588917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35395f9-f2a3-40e3-be38-321a51747517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:40:37.590783 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35395f9-f2a3-40e3-be38-321a51747517 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:40:37.604991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1251/2486] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:40:47.520267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=30 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:47.599331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=59 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:58.068865 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec464c4-e5a5-4c63-b657-ae8ce60b1994 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:58.069350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec464c4-e5a5-4c63-b657-ae8ce60b1994 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:58.069350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec464c4-e5a5-4c63-b657-ae8ce60b1994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:58.148539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fec464c4-e5a5-4c63-b657-ae8ce60b1994 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:40:58.149743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fec464c4-e5a5-4c63-b657-ae8ce60b1994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:58.208975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1236/2487] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 7 22:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:40:58.240450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35395f9-f2a3-40e3-be38-321a51747517 service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:40:58.241905 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d35395f9-f2a3-40e3-be38-321a51747517 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:40:58.336781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35395f9-f2a3-40e3-be38-321a51747517 service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:40:58.344740 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b8fac-cf7b-458d-84ec-0912541a7762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:40:58.345354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b8fac-cf7b-458d-84ec-0912541a7762 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:40:58.345628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b8fac-cf7b-458d-84ec-0912541a7762 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:40:58.345898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b8fac-cf7b-458d-84ec-0912541a7762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:40:58.354421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b8fac-cf7b-458d-84ec-0912541a7762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:40:58.356023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b8fac-cf7b-458d-84ec-0912541a7762 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:40:58.366025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1252/2488] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:02.226832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec464c4-e5a5-4c63-b657-ae8ce60b1994 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:02.228390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fec464c4-e5a5-4c63-b657-ae8ce60b1994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:02.342466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec464c4-e5a5-4c63-b657-ae8ce60b1994 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:02.348992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da494e77-ada3-4653-9951-0aac3468e3bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db0874a2f443768a9d9842beb2523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:02.349733 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494e77-ada3-4653-9951-0aac3468e3bd service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:02.350031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494e77-ada3-4653-9951-0aac3468e3bd service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:02.350911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494e77-ada3-4653-9951-0aac3468e3bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:02.352302 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-da494e77-ada3-4653-9951-0aac3468e3bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:02.364197 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494e77-ada3-4653-9951-0aac3468e3bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:02.365752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494e77-ada3-4653-9951-0aac3468e3bd service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:02.376458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1237/2489] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:03.285691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165c3fe-7d32-4564-a6ec-63c7ecd258cd None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:03.286175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165c3fe-7d32-4564-a6ec-63c7ecd258cd None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:03.286285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165c3fe-7d32-4564-a6ec-63c7ecd258cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:03.305542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7165c3fe-7d32-4564-a6ec-63c7ecd258cd None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:03.306720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7165c3fe-7d32-4564-a6ec-63c7ecd258cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:03.314437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1253/2490] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 7 22:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:03.336707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da494e77-ada3-4653-9951-0aac3468e3bd service placement] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:03.349437 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da494e77-ada3-4653-9951-0aac3468e3bd service placement] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:03.356920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7827e0-104a-4355-86fc-a67d6e8b8d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:03.357533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7827e0-104a-4355-86fc-a67d6e8b8d21 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:03.357818 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7827e0-104a-4355-86fc-a67d6e8b8d21 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:03.358156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7827e0-104a-4355-86fc-a67d6e8b8d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:03.367699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7827e0-104a-4355-86fc-a67d6e8b8d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:03.369355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7827e0-104a-4355-86fc-a67d6e8b8d21 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:03.379409 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1238/2491] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:03.753408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22700b-88f5-4df3-85c0-6421410d6078 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:03.754134 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22700b-88f5-4df3-85c0-6421410d6078 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:03.754498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22700b-88f5-4df3-85c0-6421410d6078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:03.788947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ea22700b-88f5-4df3-85c0-6421410d6078 None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:03.790142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ea22700b-88f5-4df3-85c0-6421410d6078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:03.797591 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1254/2492] 10.222.0.15 () {58 vars in 967 bytes} [Sun Aug 7 22:41:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:03.812509 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7827e0-104a-4355-86fc-a67d6e8b8d21 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:03.830025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7827e0-104a-4355-86fc-a67d6e8b8d21 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:03.836285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dab98f-e888-4772-84a0-8f41fbea9cb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:03.836963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dab98f-e888-4772-84a0-8f41fbea9cb4 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:03.837312 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dab98f-e888-4772-84a0-8f41fbea9cb4 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:03.837654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dab98f-e888-4772-84a0-8f41fbea9cb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:03.847060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dab98f-e888-4772-84a0-8f41fbea9cb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:03.848742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dab98f-e888-4772-84a0-8f41fbea9cb4 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:03.858923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1239/2493] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:41:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:41:08.513647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628dbfb-7305-4460-ad96-2e22a65f35ed None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:08.514121 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628dbfb-7305-4460-ad96-2e22a65f35ed None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:08.514213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628dbfb-7305-4460-ad96-2e22a65f35ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:08.533933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8628dbfb-7305-4460-ad96-2e22a65f35ed None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:08.535131 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8628dbfb-7305-4460-ad96-2e22a65f35ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:08.542782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1255/2494] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 7 22:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:08.563681 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dab98f-e888-4772-84a0-8f41fbea9cb4 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:08.571417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:08.576289 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dab98f-e888-4772-84a0-8f41fbea9cb4 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:08.582501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90a3fb-d45f-4c92-977b-e38d1f80a24c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:08.583078 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90a3fb-d45f-4c92-977b-e38d1f80a24c service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:08.583389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90a3fb-d45f-4c92-977b-e38d1f80a24c service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:08.583654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90a3fb-d45f-4c92-977b-e38d1f80a24c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:08.592249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90a3fb-d45f-4c92-977b-e38d1f80a24c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:08.593798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90a3fb-d45f-4c92-977b-e38d1f80a24c service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:08.603307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1240/2495] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:18.528513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=49 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:18.599031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:30.720945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bca34a-10c0-4000-8726-40206951b5c9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:30.721405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bca34a-10c0-4000-8726-40206951b5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:30.721500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bca34a-10c0-4000-8726-40206951b5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:30.740366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-24bca34a-10c0-4000-8726-40206951b5c9 None None] MFA Rules not processed for user `ba27cac397e449c2bba4ed5ecd6be0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:30.741489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-24bca34a-10c0-4000-8726-40206951b5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:30.748266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1256/2496] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:31.284964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90a3fb-d45f-4c92-977b-e38d1f80a24c service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:31.327928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90a3fb-d45f-4c92-977b-e38d1f80a24c service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:31.337438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b37d20-d198-43cf-94a0-9bfcf257f7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:31.338161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b37d20-d198-43cf-94a0-9bfcf257f7ac service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:31.338868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b37d20-d198-43cf-94a0-9bfcf257f7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:31.339406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b37d20-d198-43cf-94a0-9bfcf257f7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:31.342882 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e9b37d20-d198-43cf-94a0-9bfcf257f7ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:31.369061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b37d20-d198-43cf-94a0-9bfcf257f7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:31.370529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b37d20-d198-43cf-94a0-9bfcf257f7ac service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:31.381333 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1241/2497] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:41:34.649304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bca34a-10c0-4000-8726-40206951b5c9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:34.663117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bca34a-10c0-4000-8726-40206951b5c9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:34.673709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0758a8-0623-4725-bf96-979fe3870ff6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db0874a2f443768a9d9842beb2523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:34.674764 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0758a8-0623-4725-bf96-979fe3870ff6 service placement] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:34.675296 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0758a8-0623-4725-bf96-979fe3870ff6 service placement] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:34.675787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0758a8-0623-4725-bf96-979fe3870ff6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:34.678080 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0d0758a8-0623-4725-bf96-979fe3870ff6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:34.695138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0758a8-0623-4725-bf96-979fe3870ff6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:34.697091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0758a8-0623-4725-bf96-979fe3870ff6 service placement] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:34.718117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b37d20-d198-43cf-94a0-9bfcf257f7ac service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:34.720117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e9b37d20-d198-43cf-94a0-9bfcf257f7ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:34.722982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1257/2498] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:34.734250 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b37d20-d198-43cf-94a0-9bfcf257f7ac service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:34.747455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582401ac-3eaa-4353-a454-80c0f828ee35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:34.748812 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582401ac-3eaa-4353-a454-80c0f828ee35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:34.749226 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582401ac-3eaa-4353-a454-80c0f828ee35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:34.749724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582401ac-3eaa-4353-a454-80c0f828ee35 admin admin] PATH_INFO: `/v3/users/51e200b8d8c443d5912756bf1d04a82d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:34.751670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582401ac-3eaa-4353-a454-80c0f828ee35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e200b8d8c443d5912756bf1d04a82d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:34.754726 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582401ac-3eaa-4353-a454-80c0f828ee35 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:34.815951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-582401ac-3eaa-4353-a454-80c0f828ee35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e200b8d8c443d5912756bf1d04a82d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:34.825273 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-582401ac-3eaa-4353-a454-80c0f828ee35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e200b8d8c443d5912756bf1d04a82d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:34.826149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-582401ac-3eaa-4353-a454-80c0f828ee35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e200b8d8c443d5912756bf1d04a82d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:34.826765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-582401ac-3eaa-4353-a454-80c0f828ee35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e200b8d8c443d5912756bf1d04a82d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:34.839979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-582401ac-3eaa-4353-a454-80c0f828ee35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e200b8d8c443d5912756bf1d04a82d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:34.853293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1242/2499] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:34 2022] DELETE /identity/v3/users/51e200b8d8c443d5912756bf1d04a82d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:35.039669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0758a8-0623-4725-bf96-979fe3870ff6 service placement] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:35.052563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0758a8-0623-4725-bf96-979fe3870ff6 service placement] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:35.119280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370b659-e03d-425a-a641-e40b7ce4e53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:35.119908 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370b659-e03d-425a-a641-e40b7ce4e53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:35.120182 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370b659-e03d-425a-a641-e40b7ce4e53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:35.120451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370b659-e03d-425a-a641-e40b7ce4e53b admin admin] PATH_INFO: `/v3/projects/6bd5c44768574454ab5ec245148bd47a` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:35.121569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370b659-e03d-425a-a641-e40b7ce4e53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd5c44768574454ab5ec245148bd47a)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:35.123526 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370b659-e03d-425a-a641-e40b7ce4e53b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:35.170586 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d370b659-e03d-425a-a641-e40b7ce4e53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd5c44768574454ab5ec245148bd47a', 'request_id': 'req-d370b659-e03d-425a-a641-e40b7ce4e53b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:35.176295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d370b659-e03d-425a-a641-e40b7ce4e53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd5c44768574454ab5ec245148bd47a', 'request_id': 'req-d370b659-e03d-425a-a641-e40b7ce4e53b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:35.182322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d370b659-e03d-425a-a641-e40b7ce4e53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd5c44768574454ab5ec245148bd47a', 'request_id': 'req-d370b659-e03d-425a-a641-e40b7ce4e53b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:35.195498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d370b659-e03d-425a-a641-e40b7ce4e53b admin admin] The token cache is being invalidate because project 6bd5c44768574454ab5ec245148bd47a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:41:35.195786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d370b659-e03d-425a-a641-e40b7ce4e53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:35.196393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d370b659-e03d-425a-a641-e40b7ce4e53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:35.198106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1258/2500] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:41:35 2022] DELETE /identity/v3/projects/6bd5c44768574454ab5ec245148bd47a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:35.202754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367154d-c210-4fed-a8aa-6fa32b4da551 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:35.203034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367154d-c210-4fed-a8aa-6fa32b4da551 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:35.203352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367154d-c210-4fed-a8aa-6fa32b4da551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:35.222392 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9367154d-c210-4fed-a8aa-6fa32b4da551 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:35.223613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9367154d-c210-4fed-a8aa-6fa32b4da551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:35.289485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1243/2501] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:35.297511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f231600-90f7-437d-9f6f-7df20e761f1c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:35.297704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f231600-90f7-437d-9f6f-7df20e761f1c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:35.297917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f231600-90f7-437d-9f6f-7df20e761f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:35.320243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5f231600-90f7-437d-9f6f-7df20e761f1c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:35.321474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5f231600-90f7-437d-9f6f-7df20e761f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:35.329518 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1259/2502] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:35.333833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367154d-c210-4fed-a8aa-6fa32b4da551 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:35.343659 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367154d-c210-4fed-a8aa-6fa32b4da551 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:35.348408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0c183-a99b-47cd-80fb-9d6199248c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:35.349018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0c183-a99b-47cd-80fb-9d6199248c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:35.349286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0c183-a99b-47cd-80fb-9d6199248c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:35.349555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0c183-a99b-47cd-80fb-9d6199248c2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:35.350227 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0c183-a99b-47cd-80fb-9d6199248c2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:41:35.350527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0c183-a99b-47cd-80fb-9d6199248c2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:35.352151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0c183-a99b-47cd-80fb-9d6199248c2b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:35.366743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1244/2503] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:41:35.370886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f231600-90f7-437d-9f6f-7df20e761f1c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:35.380728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f231600-90f7-437d-9f6f-7df20e761f1c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:35.385376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b77b6a-9531-4c61-908f-ac2a9150ac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:35.385967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b77b6a-9531-4c61-908f-ac2a9150ac78 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:35.386243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b77b6a-9531-4c61-908f-ac2a9150ac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:35.386510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b77b6a-9531-4c61-908f-ac2a9150ac78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:35.387186 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b77b6a-9531-4c61-908f-ac2a9150ac78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:35.389072 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b77b6a-9531-4c61-908f-ac2a9150ac78 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:35.417759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1260/2504] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:35 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:35.421940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0c183-a99b-47cd-80fb-9d6199248c2b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:35.433415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0c183-a99b-47cd-80fb-9d6199248c2b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:35.467406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:35.496795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee42295-bd2f-4458-bbc4-6a6661699304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:35.497402 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42295-bd2f-4458-bbc4-6a6661699304 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:35.497676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42295-bd2f-4458-bbc4-6a6661699304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:35.497970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42295-bd2f-4458-bbc4-6a6661699304 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:35.498559 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee42295-bd2f-4458-bbc4-6a6661699304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:35.500516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee42295-bd2f-4458-bbc4-6a6661699304 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:35.526493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1245/2505] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:35 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:35.530343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b77b6a-9531-4c61-908f-ac2a9150ac78 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:35.543932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b77b6a-9531-4c61-908f-ac2a9150ac78 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:35.551284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287fce5-aa08-4ae1-a39c-d78db66f2a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:35.552619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287fce5-aa08-4ae1-a39c-d78db66f2a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:35.552902 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287fce5-aa08-4ae1-a39c-d78db66f2a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:35.553225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287fce5-aa08-4ae1-a39c-d78db66f2a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:35.554067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287fce5-aa08-4ae1-a39c-d78db66f2a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:35.556105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287fce5-aa08-4ae1-a39c-d78db66f2a9f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:35.569532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1261/2506] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:41:35.574253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee42295-bd2f-4458-bbc4-6a6661699304 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:35.584902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee42295-bd2f-4458-bbc4-6a6661699304 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:35.589818 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68360566-38bc-4585-92bc-5e185be77ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:35.590497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68360566-38bc-4585-92bc-5e185be77ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:35.590845 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68360566-38bc-4585-92bc-5e185be77ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:35.591222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68360566-38bc-4585-92bc-5e185be77ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:35.591936 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68360566-38bc-4585-92bc-5e185be77ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:35.593592 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68360566-38bc-4585-92bc-5e185be77ff9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:35.604537 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1246/2507] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:41:35.609163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287fce5-aa08-4ae1-a39c-d78db66f2a9f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:35.619944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287fce5-aa08-4ae1-a39c-d78db66f2a9f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:35.625367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8af7f-a3ff-4019-a99e-d52fd48ba603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:35.625553 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8af7f-a3ff-4019-a99e-d52fd48ba603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:35.625946 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8af7f-a3ff-4019-a99e-d52fd48ba603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:35.626248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8af7f-a3ff-4019-a99e-d52fd48ba603 admin admin] PATH_INFO: `/v3/projects/2b83990362eb4b4a96284c4ce1acd0ad/users/621eeda9a70b478088d53cf37853c511/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:35.642707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8af7f-a3ff-4019-a99e-d52fd48ba603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b83990362eb4b4a96284c4ce1acd0ad, user_id=621eeda9a70b478088d53cf37853c511, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:35.645486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8af7f-a3ff-4019-a99e-d52fd48ba603 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:35.661910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1262/2508] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:35 2022] PUT /identity/v3/projects/2b83990362eb4b4a96284c4ce1acd0ad/users/621eeda9a70b478088d53cf37853c511/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:35.673128 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583f4fd-3a4e-44f6-a1ad-58bea5501f75 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:35.673536 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583f4fd-3a4e-44f6-a1ad-58bea5501f75 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:35.673983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583f4fd-3a4e-44f6-a1ad-58bea5501f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:35.734342 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d583f4fd-3a4e-44f6-a1ad-58bea5501f75 None None] MFA Rules not processed for user `621eeda9a70b478088d53cf37853c511`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:35.740092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d583f4fd-3a4e-44f6-a1ad-58bea5501f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:35.924410 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1247/2509] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:35.935859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8af7f-a3ff-4019-a99e-d52fd48ba603 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:35.938610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1bf8af7f-a3ff-4019-a99e-d52fd48ba603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:35.949768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:36.046665 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8af7f-a3ff-4019-a99e-d52fd48ba603 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:36.055435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc19f3-968b-4fac-85df-d5d5a20af666 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:36.057172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc19f3-968b-4fac-85df-d5d5a20af666 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:36.057670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc19f3-968b-4fac-85df-d5d5a20af666 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:36.058142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc19f3-968b-4fac-85df-d5d5a20af666 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:36.071187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc19f3-968b-4fac-85df-d5d5a20af666 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:36.073504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc19f3-968b-4fac-85df-d5d5a20af666 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:36.091445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1263/2510] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:36.362653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583f4fd-3a4e-44f6-a1ad-58bea5501f75 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:36.469928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583f4fd-3a4e-44f6-a1ad-58bea5501f75 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:36.475151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:36.476382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:36.476382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:36.476573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] PATH_INFO: `/v3/users/621eeda9a70b478088d53cf37853c511` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:36.477746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621eeda9a70b478088d53cf37853c511)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:36.479872 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:36.549855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621eeda9a70b478088d53cf37853c511'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:36.552184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:36.561497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621eeda9a70b478088d53cf37853c511'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:36.563929 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621eeda9a70b478088d53cf37853c511'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:36.564634 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621eeda9a70b478088d53cf37853c511'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:36.583600 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621eeda9a70b478088d53cf37853c511'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:36.597956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1248/2511] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:36 2022] DELETE /identity/v3/users/621eeda9a70b478088d53cf37853c511 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:36.602532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a8007-9fe8-4a11-8fae-a15a9e553afd None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:36.602814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a8007-9fe8-4a11-8fae-a15a9e553afd None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:36.603110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a8007-9fe8-4a11-8fae-a15a9e553afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:36.624013 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-fe1a8007-9fe8-4a11-8fae-a15a9e553afd None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:36.625536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fe1a8007-9fe8-4a11-8fae-a15a9e553afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:36.703161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1264/2512] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:36.713327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:36.716195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:36.826155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0613f0c-5186-4b36-8f7d-b73fd49fdeb2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:36.835604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65746e4-5bec-445a-8c0b-330df6e3f6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:36.836585 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65746e4-5bec-445a-8c0b-330df6e3f6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:36.837028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65746e4-5bec-445a-8c0b-330df6e3f6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:36.837458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65746e4-5bec-445a-8c0b-330df6e3f6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:36.864639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65746e4-5bec-445a-8c0b-330df6e3f6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:36.869769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65746e4-5bec-445a-8c0b-330df6e3f6b9 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:36.897377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1249/2513] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:37.583585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a8007-9fe8-4a11-8fae-a15a9e553afd None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:37.585276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fe1a8007-9fe8-4a11-8fae-a15a9e553afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:37.604409 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a8007-9fe8-4a11-8fae-a15a9e553afd None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:37.609212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7324220-de5c-46da-a83a-a5d937404013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:37.610168 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7324220-de5c-46da-a83a-a5d937404013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:37.610484 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7324220-de5c-46da-a83a-a5d937404013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:37.610903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7324220-de5c-46da-a83a-a5d937404013 admin admin] PATH_INFO: `/v3/projects/2b83990362eb4b4a96284c4ce1acd0ad` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:37.612263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7324220-de5c-46da-a83a-a5d937404013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b83990362eb4b4a96284c4ce1acd0ad)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:37.614682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7324220-de5c-46da-a83a-a5d937404013 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:37.667378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c7324220-de5c-46da-a83a-a5d937404013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b83990362eb4b4a96284c4ce1acd0ad', 'request_id': 'req-c7324220-de5c-46da-a83a-a5d937404013'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:37.672968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c7324220-de5c-46da-a83a-a5d937404013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b83990362eb4b4a96284c4ce1acd0ad', 'request_id': 'req-c7324220-de5c-46da-a83a-a5d937404013'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:37.680375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c7324220-de5c-46da-a83a-a5d937404013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b83990362eb4b4a96284c4ce1acd0ad', 'request_id': 'req-c7324220-de5c-46da-a83a-a5d937404013'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:37.695446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c7324220-de5c-46da-a83a-a5d937404013 admin admin] The token cache is being invalidate because project 2b83990362eb4b4a96284c4ce1acd0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:41:37.695725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c7324220-de5c-46da-a83a-a5d937404013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:37.696803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c7324220-de5c-46da-a83a-a5d937404013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:37.703036 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1265/2514] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:41:37 2022] DELETE /identity/v3/projects/2b83990362eb4b4a96284c4ce1acd0ad => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:37.704447 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43efd13-e5dd-40ef-a913-00e64c795381 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:37.704822 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43efd13-e5dd-40ef-a913-00e64c795381 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:37.705201 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43efd13-e5dd-40ef-a913-00e64c795381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:37.726757 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e43efd13-e5dd-40ef-a913-00e64c795381 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:37.727992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e43efd13-e5dd-40ef-a913-00e64c795381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:37.789365 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1250/2515] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:37.797181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff1ae9-7017-4ec0-81fa-fe6f3285b140 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:37.797641 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff1ae9-7017-4ec0-81fa-fe6f3285b140 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:37.797770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff1ae9-7017-4ec0-81fa-fe6f3285b140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:37.817379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b1ff1ae9-7017-4ec0-81fa-fe6f3285b140 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:37.818562 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b1ff1ae9-7017-4ec0-81fa-fe6f3285b140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:37.826989 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1266/2516] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:37.831814 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43efd13-e5dd-40ef-a913-00e64c795381 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:37.842632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43efd13-e5dd-40ef-a913-00e64c795381 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:37.847503 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b4768-d982-4e41-af15-de880b918719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:37.848125 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b4768-d982-4e41-af15-de880b918719 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:37.848406 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b4768-d982-4e41-af15-de880b918719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:37.848682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b4768-d982-4e41-af15-de880b918719 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:37.849327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b4768-d982-4e41-af15-de880b918719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:41:37.849632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b4768-d982-4e41-af15-de880b918719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:37.851293 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b4768-d982-4e41-af15-de880b918719 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:37.863108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1251/2517] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:41:37.867556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff1ae9-7017-4ec0-81fa-fe6f3285b140 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:37.877045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff1ae9-7017-4ec0-81fa-fe6f3285b140 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:37.882246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2842b-4bb4-48fa-8753-c6892da149fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:37.882832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2842b-4bb4-48fa-8753-c6892da149fa admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:37.883122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2842b-4bb4-48fa-8753-c6892da149fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:37.883391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2842b-4bb4-48fa-8753-c6892da149fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:37.884011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2842b-4bb4-48fa-8753-c6892da149fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:37.885911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2842b-4bb4-48fa-8753-c6892da149fa admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:37.891930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:37.921216 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1267/2518] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:37 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:37.922475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b4768-d982-4e41-af15-de880b918719 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:37.933373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b4768-d982-4e41-af15-de880b918719 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:37.977161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:37.995597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe78a42-ba0e-492e-a4b1-ab1ea1c80231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:37.996198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe78a42-ba0e-492e-a4b1-ab1ea1c80231 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:37.996469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe78a42-ba0e-492e-a4b1-ab1ea1c80231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:37.996735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe78a42-ba0e-492e-a4b1-ab1ea1c80231 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:37.997378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe78a42-ba0e-492e-a4b1-ab1ea1c80231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:37.999306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe78a42-ba0e-492e-a4b1-ab1ea1c80231 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:38.020419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1252/2519] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:37 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:41:38.024580 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2842b-4bb4-48fa-8753-c6892da149fa admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:38.034984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2842b-4bb4-48fa-8753-c6892da149fa admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:38.039613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8d239-48e5-45f9-836c-7e3443c7be54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:38.040200 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8d239-48e5-45f9-836c-7e3443c7be54 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:38.040478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8d239-48e5-45f9-836c-7e3443c7be54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:38.040751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8d239-48e5-45f9-836c-7e3443c7be54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:38.041388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8d239-48e5-45f9-836c-7e3443c7be54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:38.043125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8d239-48e5-45f9-836c-7e3443c7be54 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:38.053661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1268/2520] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:38.057511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe78a42-ba0e-492e-a4b1-ab1ea1c80231 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:38.068046 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe78a42-ba0e-492e-a4b1-ab1ea1c80231 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:38.072697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6811f86-1eae-42a2-97fd-ad57e3e8b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:38.073290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6811f86-1eae-42a2-97fd-ad57e3e8b99b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:38.073568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6811f86-1eae-42a2-97fd-ad57e3e8b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:38.073841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6811f86-1eae-42a2-97fd-ad57e3e8b99b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:38.074475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6811f86-1eae-42a2-97fd-ad57e3e8b99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:38.076099 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6811f86-1eae-42a2-97fd-ad57e3e8b99b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:38.086426 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1253/2521] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:38.090313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8d239-48e5-45f9-836c-7e3443c7be54 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:38.100128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8d239-48e5-45f9-836c-7e3443c7be54 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:38.104776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3c83-bfb0-43c0-bd64-ab09c74b5a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:38.105419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3c83-bfb0-43c0-bd64-ab09c74b5a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:38.105697 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3c83-bfb0-43c0-bd64-ab09c74b5a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:38.105972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3c83-bfb0-43c0-bd64-ab09c74b5a33 admin admin] PATH_INFO: `/v3/projects/aafae0ec3aad415b84fe29502ed87332/users/86f51b38c839498fafc88d45b106d72e/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:38.120733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb3c83-bfb0-43c0-bd64-ab09c74b5a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aafae0ec3aad415b84fe29502ed87332, user_id=86f51b38c839498fafc88d45b106d72e, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:38.123441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb3c83-bfb0-43c0-bd64-ab09c74b5a33 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:38.137853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1269/2522] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:38 2022] PUT /identity/v3/projects/aafae0ec3aad415b84fe29502ed87332/users/86f51b38c839498fafc88d45b106d72e/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:38.148187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4b89f-061b-4024-b17a-d0762384e434 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:38.148563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4b89f-061b-4024-b17a-d0762384e434 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:38.148839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4b89f-061b-4024-b17a-d0762384e434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:38.177001 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f7d4b89f-061b-4024-b17a-d0762384e434 None None] MFA Rules not processed for user `86f51b38c839498fafc88d45b106d72e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:38.178216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f7d4b89f-061b-4024-b17a-d0762384e434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:38.240050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1254/2523] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:38.244524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3c83-bfb0-43c0-bd64-ab09c74b5a33 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:38.305872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3c83-bfb0-43c0-bd64-ab09c74b5a33 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:38.310503 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f94b6-0294-4885-83a5-7effb192d080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:38.311105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f94b6-0294-4885-83a5-7effb192d080 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:38.311396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f94b6-0294-4885-83a5-7effb192d080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:38.311672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f94b6-0294-4885-83a5-7effb192d080 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:38.312277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f94b6-0294-4885-83a5-7effb192d080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:38.314172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f94b6-0294-4885-83a5-7effb192d080 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:38.341432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1270/2524] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:38 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:38.345376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4b89f-061b-4024-b17a-d0762384e434 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:38.356116 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4b89f-061b-4024-b17a-d0762384e434 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:38.412050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fc763-1031-4d5b-b833-7a998b6ae239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:38.412649 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fc763-1031-4d5b-b833-7a998b6ae239 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:38.412923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fc763-1031-4d5b-b833-7a998b6ae239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:38.413190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fc763-1031-4d5b-b833-7a998b6ae239 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:38.413811 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fc763-1031-4d5b-b833-7a998b6ae239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:38.415784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fc763-1031-4d5b-b833-7a998b6ae239 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:38.438090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1255/2525] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:38 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:38.442319 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f94b6-0294-4885-83a5-7effb192d080 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:38.453822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f94b6-0294-4885-83a5-7effb192d080 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:38.458468 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c94fe-8d6b-4b68-9111-bd1ec87620b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:38.459058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c94fe-8d6b-4b68-9111-bd1ec87620b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:38.459363 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c94fe-8d6b-4b68-9111-bd1ec87620b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:38.459631 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c94fe-8d6b-4b68-9111-bd1ec87620b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:38.460265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c94fe-8d6b-4b68-9111-bd1ec87620b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:38.461822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c94fe-8d6b-4b68-9111-bd1ec87620b9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:38.473206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1271/2526] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:41:38.477678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fc763-1031-4d5b-b833-7a998b6ae239 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:38.488287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fc763-1031-4d5b-b833-7a998b6ae239 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:38.492923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593791e-bc26-434d-a458-0b6c5436ffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:38.493572 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593791e-bc26-434d-a458-0b6c5436ffe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:38.493848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593791e-bc26-434d-a458-0b6c5436ffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:38.494117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593791e-bc26-434d-a458-0b6c5436ffe3 admin admin] PATH_INFO: `/v3/projects/4d90cfd35f6944b8a4b54bdedebca941/users/bd4687393a064bab847123ac80cf626d/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:38.509066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593791e-bc26-434d-a458-0b6c5436ffe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d90cfd35f6944b8a4b54bdedebca941, user_id=bd4687393a064bab847123ac80cf626d, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:38.511824 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593791e-bc26-434d-a458-0b6c5436ffe3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:38.525485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1256/2527] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:38 2022] PUT /identity/v3/projects/4d90cfd35f6944b8a4b54bdedebca941/users/bd4687393a064bab847123ac80cf626d/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:38.529242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c94fe-8d6b-4b68-9111-bd1ec87620b9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:38.540122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c94fe-8d6b-4b68-9111-bd1ec87620b9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:38.597765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c15944-ed95-482d-8af4-3f9bc1ee8bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:38.598309 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15944-ed95-482d-8af4-3f9bc1ee8bff admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:38.598588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15944-ed95-482d-8af4-3f9bc1ee8bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:38.598860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15944-ed95-482d-8af4-3f9bc1ee8bff admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:38.599534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c15944-ed95-482d-8af4-3f9bc1ee8bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:38.601117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c15944-ed95-482d-8af4-3f9bc1ee8bff admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:38.610765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1272/2528] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:38.615568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593791e-bc26-434d-a458-0b6c5436ffe3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:38.625730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593791e-bc26-434d-a458-0b6c5436ffe3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:38.630345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fc611-d95e-46b4-b349-afd2cadb0fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:38.630978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fc611-d95e-46b4-b349-afd2cadb0fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:38.631300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fc611-d95e-46b4-b349-afd2cadb0fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:38.631570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fc611-d95e-46b4-b349-afd2cadb0fbe admin admin] PATH_INFO: `/v3/projects/4d90cfd35f6944b8a4b54bdedebca941/users/bd4687393a064bab847123ac80cf626d/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:38.633482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fc611-d95e-46b4-b349-afd2cadb0fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d90cfd35f6944b8a4b54bdedebca941, user_id=bd4687393a064bab847123ac80cf626d, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:38.636111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fc611-d95e-46b4-b349-afd2cadb0fbe admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:38.646160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1257/2529] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:38 2022] PUT /identity/v3/projects/4d90cfd35f6944b8a4b54bdedebca941/users/bd4687393a064bab847123ac80cf626d/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:38.657592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac12a-1dbe-43e1-98cb-5de3ddb42875 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:38.658135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac12a-1dbe-43e1-98cb-5de3ddb42875 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:38.658411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac12a-1dbe-43e1-98cb-5de3ddb42875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:38.688599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-687ac12a-1dbe-43e1-98cb-5de3ddb42875 None None] MFA Rules not processed for user `bd4687393a064bab847123ac80cf626d`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:38.689842 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-687ac12a-1dbe-43e1-98cb-5de3ddb42875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:38.699258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:38.765468 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1273/2530] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:38.777169 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fc611-d95e-46b4-b349-afd2cadb0fbe admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:38.778923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-223fc611-d95e-46b4-b349-afd2cadb0fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:38.784816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:38.864741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fc611-d95e-46b4-b349-afd2cadb0fbe admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:38.868524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc665877-c594-4749-aeb5-b26ffbc0e3b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:38.869120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc665877-c594-4749-aeb5-b26ffbc0e3b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:38.869427 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc665877-c594-4749-aeb5-b26ffbc0e3b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:38.869641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc665877-c594-4749-aeb5-b26ffbc0e3b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:38.878745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc665877-c594-4749-aeb5-b26ffbc0e3b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:38.880207 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc665877-c594-4749-aeb5-b26ffbc0e3b6 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:38.889612 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1258/2531] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:39.296362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac12a-1dbe-43e1-98cb-5de3ddb42875 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:39.357416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac12a-1dbe-43e1-98cb-5de3ddb42875 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:39.361856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:39.362474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:39.362745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:39.363013 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] PATH_INFO: `/v3/users/86f51b38c839498fafc88d45b106d72e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:39.364285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f51b38c839498fafc88d45b106d72e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:39.366193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:39.412440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f51b38c839498fafc88d45b106d72e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:39.419119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f51b38c839498fafc88d45b106d72e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:39.425955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f51b38c839498fafc88d45b106d72e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:39.426561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f51b38c839498fafc88d45b106d72e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:39.438103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f51b38c839498fafc88d45b106d72e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:39.444372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1274/2532] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:39 2022] DELETE /identity/v3/users/86f51b38c839498fafc88d45b106d72e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:39.448829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cfbb1-6f9d-4453-bdee-0397854ffa6d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:39.449175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cfbb1-6f9d-4453-bdee-0397854ffa6d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:39.449549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cfbb1-6f9d-4453-bdee-0397854ffa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:39.468062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c86cfbb1-6f9d-4453-bdee-0397854ffa6d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:39.469241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c86cfbb1-6f9d-4453-bdee-0397854ffa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:39.526048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1259/2533] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:39.535923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:39.537274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:39.568290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:39.600096 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4db0c-ef7c-4e27-a85e-c66e95c8209d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:39.604162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3d25d-7b26-4181-8591-41de9df692f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:39.604841 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3d25d-7b26-4181-8591-41de9df692f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:39.605240 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3d25d-7b26-4181-8591-41de9df692f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:39.605518 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3d25d-7b26-4181-8591-41de9df692f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:39.615612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3d25d-7b26-4181-8591-41de9df692f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:39.616974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3d25d-7b26-4181-8591-41de9df692f7 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:39.626587 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1275/2534] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:40.061605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cfbb1-6f9d-4453-bdee-0397854ffa6d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:40.063307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c86cfbb1-6f9d-4453-bdee-0397854ffa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:40.079642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cfbb1-6f9d-4453-bdee-0397854ffa6d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:40.083997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:40.084893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:40.085233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:40.085568 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] PATH_INFO: `/v3/projects/aafae0ec3aad415b84fe29502ed87332` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:40.086815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aafae0ec3aad415b84fe29502ed87332)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:40.088990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:40.144685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aafae0ec3aad415b84fe29502ed87332', 'request_id': 'req-70399fb2-7249-4467-9442-879873f7374e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.150963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aafae0ec3aad415b84fe29502ed87332', 'request_id': 'req-70399fb2-7249-4467-9442-879873f7374e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.157289 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aafae0ec3aad415b84fe29502ed87332', 'request_id': 'req-70399fb2-7249-4467-9442-879873f7374e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.179123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] The token cache is being invalidate because project aafae0ec3aad415b84fe29502ed87332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:41:40.179305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.179959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.181983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1260/2535] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:41:40 2022] DELETE /identity/v3/projects/aafae0ec3aad415b84fe29502ed87332 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:40.185729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3d25d-7b26-4181-8591-41de9df692f7 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:40.197196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3d25d-7b26-4181-8591-41de9df692f7 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:40.265069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43932055-ad24-40ae-9fe7-16de7c96c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:40.265718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43932055-ad24-40ae-9fe7-16de7c96c69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:40.265989 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43932055-ad24-40ae-9fe7-16de7c96c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:40.266263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43932055-ad24-40ae-9fe7-16de7c96c69b admin admin] PATH_INFO: `/v3/users/bd4687393a064bab847123ac80cf626d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:40.267481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43932055-ad24-40ae-9fe7-16de7c96c69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4687393a064bab847123ac80cf626d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:40.269934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43932055-ad24-40ae-9fe7-16de7c96c69b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:40.325371 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-43932055-ad24-40ae-9fe7-16de7c96c69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4687393a064bab847123ac80cf626d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.332592 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-43932055-ad24-40ae-9fe7-16de7c96c69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4687393a064bab847123ac80cf626d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.341536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-43932055-ad24-40ae-9fe7-16de7c96c69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4687393a064bab847123ac80cf626d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.342207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-43932055-ad24-40ae-9fe7-16de7c96c69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4687393a064bab847123ac80cf626d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.357273 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-43932055-ad24-40ae-9fe7-16de7c96c69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4687393a064bab847123ac80cf626d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.363853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1276/2536] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:40 2022] DELETE /identity/v3/users/bd4687393a064bab847123ac80cf626d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:40.626662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:40.628596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:40.642354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70399fb2-7249-4467-9442-879873f7374e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:40.652073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:40.702961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c735772-2d0f-4af4-8532-9c0537c64a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:40.703619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735772-2d0f-4af4-8532-9c0537c64a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:40.703894 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735772-2d0f-4af4-8532-9c0537c64a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:40.704163 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735772-2d0f-4af4-8532-9c0537c64a32 admin admin] PATH_INFO: `/v3/projects/4d90cfd35f6944b8a4b54bdedebca941` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:40.705262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c735772-2d0f-4af4-8532-9c0537c64a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d90cfd35f6944b8a4b54bdedebca941)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:40.707861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c735772-2d0f-4af4-8532-9c0537c64a32 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:40.755792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3c735772-2d0f-4af4-8532-9c0537c64a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d90cfd35f6944b8a4b54bdedebca941', 'request_id': 'req-3c735772-2d0f-4af4-8532-9c0537c64a32'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.761698 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3c735772-2d0f-4af4-8532-9c0537c64a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d90cfd35f6944b8a4b54bdedebca941', 'request_id': 'req-3c735772-2d0f-4af4-8532-9c0537c64a32'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.768606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3c735772-2d0f-4af4-8532-9c0537c64a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d90cfd35f6944b8a4b54bdedebca941', 'request_id': 'req-3c735772-2d0f-4af4-8532-9c0537c64a32'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.783147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3c735772-2d0f-4af4-8532-9c0537c64a32 admin admin] The token cache is being invalidate because project 4d90cfd35f6944b8a4b54bdedebca941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:41:40.783434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3c735772-2d0f-4af4-8532-9c0537c64a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.784072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3c735772-2d0f-4af4-8532-9c0537c64a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:40.785700 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1261/2537] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:41:40 2022] DELETE /identity/v3/projects/4d90cfd35f6944b8a4b54bdedebca941 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:40.790907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab69fd0-2de7-4f46-a035-ac74f5a62be0 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:40.791379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab69fd0-2de7-4f46-a035-ac74f5a62be0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:40.791799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab69fd0-2de7-4f46-a035-ac74f5a62be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:40.811102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2ab69fd0-2de7-4f46-a035-ac74f5a62be0 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:40.812391 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2ab69fd0-2de7-4f46-a035-ac74f5a62be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:40.865403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:40.891170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1277/2538] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:40.892833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a881-9944-4fc0-809a-32fa394827af None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:40.896103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a881-9944-4fc0-809a-32fa394827af None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:40.896103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a881-9944-4fc0-809a-32fa394827af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:40.914151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-15a5a881-9944-4fc0-809a-32fa394827af None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:40.915395 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-15a5a881-9944-4fc0-809a-32fa394827af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:40.925483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1262/2539] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:40.929761 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab69fd0-2de7-4f46-a035-ac74f5a62be0 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:40.941060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab69fd0-2de7-4f46-a035-ac74f5a62be0 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:40.945774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d50b7f-b145-4582-ba37-9ad4c00f4af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:40.946452 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d50b7f-b145-4582-ba37-9ad4c00f4af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:40.946824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d50b7f-b145-4582-ba37-9ad4c00f4af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:40.947202 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d50b7f-b145-4582-ba37-9ad4c00f4af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:40.947923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d50b7f-b145-4582-ba37-9ad4c00f4af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:41:40.948294 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d50b7f-b145-4582-ba37-9ad4c00f4af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:40.950096 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d50b7f-b145-4582-ba37-9ad4c00f4af4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:40.963583 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1278/2540] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:41:40.967515 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a881-9944-4fc0-809a-32fa394827af None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:40.976681 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a881-9944-4fc0-809a-32fa394827af None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:40.988299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa44392-eae5-47c5-906f-cb920e4ab9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:40.988921 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa44392-eae5-47c5-906f-cb920e4ab9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:40.989194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa44392-eae5-47c5-906f-cb920e4ab9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:40.989463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa44392-eae5-47c5-906f-cb920e4ab9f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:40.990107 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa44392-eae5-47c5-906f-cb920e4ab9f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:40.992959 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa44392-eae5-47c5-906f-cb920e4ab9f6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:41.021956 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1263/2541] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:40 2022] POST /identity/v3/projects => generated 401 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:41.026127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d50b7f-b145-4582-ba37-9ad4c00f4af4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:41.036551 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d50b7f-b145-4582-ba37-9ad4c00f4af4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:41.090792 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccdb5a-44c4-4e5c-afbf-10034216f44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:41.091409 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccdb5a-44c4-4e5c-afbf-10034216f44e admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.091684 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccdb5a-44c4-4e5c-afbf-10034216f44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.091949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccdb5a-44c4-4e5c-afbf-10034216f44e admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.092547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccdb5a-44c4-4e5c-afbf-10034216f44e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:41.094444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccdb5a-44c4-4e5c-afbf-10034216f44e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:41.114074 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1279/2542] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:41 2022] POST /identity/v3/users => generated 301 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:41:41.118236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa44392-eae5-47c5-906f-cb920e4ab9f6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:41.129140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa44392-eae5-47c5-906f-cb920e4ab9f6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:41.133724 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b7c85-b432-4f78-a4ee-a672930ab2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:41.134305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b7c85-b432-4f78-a4ee-a672930ab2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.134575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b7c85-b432-4f78-a4ee-a672930ab2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.134837 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b7c85-b432-4f78-a4ee-a672930ab2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.135499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b7c85-b432-4f78-a4ee-a672930ab2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:41.137066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b7c85-b432-4f78-a4ee-a672930ab2a1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:41.146670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1264/2543] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:41.150496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccdb5a-44c4-4e5c-afbf-10034216f44e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:41.160802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccdb5a-44c4-4e5c-afbf-10034216f44e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:41.165403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad136537-6942-4700-b593-df22695270f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:41.165988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad136537-6942-4700-b593-df22695270f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.166265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad136537-6942-4700-b593-df22695270f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.166536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad136537-6942-4700-b593-df22695270f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.167210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad136537-6942-4700-b593-df22695270f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:41.168782 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad136537-6942-4700-b593-df22695270f2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:41.180227 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1280/2544] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:41.184352 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b7c85-b432-4f78-a4ee-a672930ab2a1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:41.194735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b7c85-b432-4f78-a4ee-a672930ab2a1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:41.199357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f26021-b1d5-47cb-b0e6-57bc29e69f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:41.199983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26021-b1d5-47cb-b0e6-57bc29e69f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.200255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26021-b1d5-47cb-b0e6-57bc29e69f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.200524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26021-b1d5-47cb-b0e6-57bc29e69f5e admin admin] PATH_INFO: `/v3/projects/c278b682182d4879a356b831fb884ee1/users/09fbe5d371704e9999c6e6f769236737/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.214469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f26021-b1d5-47cb-b0e6-57bc29e69f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c278b682182d4879a356b831fb884ee1, user_id=09fbe5d371704e9999c6e6f769236737, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:41.217045 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f26021-b1d5-47cb-b0e6-57bc29e69f5e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:41.229455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1265/2545] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:41 2022] PUT /identity/v3/projects/c278b682182d4879a356b831fb884ee1/users/09fbe5d371704e9999c6e6f769236737/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:41.240288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201914-d8a4-4ff3-9be6-640bfda6fe30 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.240570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201914-d8a4-4ff3-9be6-640bfda6fe30 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.240839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201914-d8a4-4ff3-9be6-640bfda6fe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.268779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-62201914-d8a4-4ff3-9be6-640bfda6fe30 None None] MFA Rules not processed for user `09fbe5d371704e9999c6e6f769236737`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:41.269965 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-62201914-d8a4-4ff3-9be6-640bfda6fe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:41.347061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1281/2546] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:41 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:41.352545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f26021-b1d5-47cb-b0e6-57bc29e69f5e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:41.405573 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201914-d8a4-4ff3-9be6-640bfda6fe30 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:41.407110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-62201914-d8a4-4ff3-9be6-640bfda6fe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:41.415377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:41.445058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f26021-b1d5-47cb-b0e6-57bc29e69f5e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:41.451214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532df23-1502-4bae-ba02-0cd4406e7b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:41.451823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532df23-1502-4bae-ba02-0cd4406e7b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.452100 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532df23-1502-4bae-ba02-0cd4406e7b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.452367 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532df23-1502-4bae-ba02-0cd4406e7b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.453517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532df23-1502-4bae-ba02-0cd4406e7b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:41.455873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532df23-1502-4bae-ba02-0cd4406e7b41 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:41.459529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:41.480660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201914-d8a4-4ff3-9be6-640bfda6fe30 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:41.484368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e050b91-79ed-4891-931e-7824ef61d16f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:41.484971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e050b91-79ed-4891-931e-7824ef61d16f service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.485247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e050b91-79ed-4891-931e-7824ef61d16f service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.485515 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e050b91-79ed-4891-931e-7824ef61d16f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.489842 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1266/2547] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:41 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:41.489976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9e050b91-79ed-4891-931e-7824ef61d16f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:41.490863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532df23-1502-4bae-ba02-0cd4406e7b41 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:41.500483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e050b91-79ed-4891-931e-7824ef61d16f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:41.501890 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e050b91-79ed-4891-931e-7824ef61d16f service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:41.511664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1282/2548] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:41:41.552690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532df23-1502-4bae-ba02-0cd4406e7b41 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:41.558271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46248fca-3a40-4d46-b22a-9a006646edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:41.558902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46248fca-3a40-4d46-b22a-9a006646edaf admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.559211 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46248fca-3a40-4d46-b22a-9a006646edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.559493 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46248fca-3a40-4d46-b22a-9a006646edaf admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.560096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46248fca-3a40-4d46-b22a-9a006646edaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:41.562021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46248fca-3a40-4d46-b22a-9a006646edaf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:41.585670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1267/2549] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:41 2022] POST /identity/v3/users => generated 306 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:41:41.586926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e050b91-79ed-4891-931e-7824ef61d16f service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:41.597168 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e050b91-79ed-4891-931e-7824ef61d16f service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:41.601888 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9872d-a75a-4e76-91ed-868fb8277a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:41.602474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9872d-a75a-4e76-91ed-868fb8277a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.603114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9872d-a75a-4e76-91ed-868fb8277a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.603114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9872d-a75a-4e76-91ed-868fb8277a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.603644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9872d-a75a-4e76-91ed-868fb8277a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:41.605217 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9872d-a75a-4e76-91ed-868fb8277a9d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:41.618901 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1283/2550] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:41.620405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46248fca-3a40-4d46-b22a-9a006646edaf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:41.630627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46248fca-3a40-4d46-b22a-9a006646edaf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:41.636504 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc30ae-4b79-4101-a43e-6d911a1b83ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:41.637184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc30ae-4b79-4101-a43e-6d911a1b83ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.637463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc30ae-4b79-4101-a43e-6d911a1b83ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.637730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc30ae-4b79-4101-a43e-6d911a1b83ac admin admin] PATH_INFO: `/v3/projects/e3ad520c3b7842baafb64d42d422b2e4/users/a6013e381d1f4646a0113d33269de1ee/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.655840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc30ae-4b79-4101-a43e-6d911a1b83ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ad520c3b7842baafb64d42d422b2e4, user_id=a6013e381d1f4646a0113d33269de1ee, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:41.659315 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc30ae-4b79-4101-a43e-6d911a1b83ac admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:41.672684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1268/2551] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:41 2022] PUT /identity/v3/projects/e3ad520c3b7842baafb64d42d422b2e4/users/a6013e381d1f4646a0113d33269de1ee/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:41.677566 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9872d-a75a-4e76-91ed-868fb8277a9d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:41.688012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9872d-a75a-4e76-91ed-868fb8277a9d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:41.748147 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381dbd1-8e25-4e34-9f9e-b5c34a4e5a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:41.748667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381dbd1-8e25-4e34-9f9e-b5c34a4e5a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.748945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381dbd1-8e25-4e34-9f9e-b5c34a4e5a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.749212 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381dbd1-8e25-4e34-9f9e-b5c34a4e5a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.749851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381dbd1-8e25-4e34-9f9e-b5c34a4e5a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:41.751499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381dbd1-8e25-4e34-9f9e-b5c34a4e5a9a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:41.761310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1284/2552] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:41.765526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc30ae-4b79-4101-a43e-6d911a1b83ac admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:41.776188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc30ae-4b79-4101-a43e-6d911a1b83ac admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:41.780835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4ab40-c00a-49fb-996a-10e76a2d9d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:41.781477 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4ab40-c00a-49fb-996a-10e76a2d9d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.781752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4ab40-c00a-49fb-996a-10e76a2d9d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.782021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4ab40-c00a-49fb-996a-10e76a2d9d44 admin admin] PATH_INFO: `/v3/projects/e3ad520c3b7842baafb64d42d422b2e4/users/a6013e381d1f4646a0113d33269de1ee/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.784835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4ab40-c00a-49fb-996a-10e76a2d9d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ad520c3b7842baafb64d42d422b2e4, user_id=a6013e381d1f4646a0113d33269de1ee, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:41.787491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4ab40-c00a-49fb-996a-10e76a2d9d44 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:41.797619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1269/2553] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:41 2022] PUT /identity/v3/projects/e3ad520c3b7842baafb64d42d422b2e4/users/a6013e381d1f4646a0113d33269de1ee/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:41.808914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cab52-a1f0-4db4-a23f-414257fc861b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.809198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cab52-a1f0-4db4-a23f-414257fc861b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.809467 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cab52-a1f0-4db4-a23f-414257fc861b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:41.839635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-614cab52-a1f0-4db4-a23f-414257fc861b None None] MFA Rules not processed for user `a6013e381d1f4646a0113d33269de1ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:41.840851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-614cab52-a1f0-4db4-a23f-414257fc861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:41.910022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1285/2554] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:41 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:41.921027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4ab40-c00a-49fb-996a-10e76a2d9d44 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:41.923287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-87b4ab40-c00a-49fb-996a-10e76a2d9d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:41.982545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4ab40-c00a-49fb-996a-10e76a2d9d44 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:41.993163 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cef57-401a-4b62-bc28-594c109f4819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:41.993782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cef57-401a-4b62-bc28-594c109f4819 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:41.994056 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cef57-401a-4b62-bc28-594c109f4819 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:41.994325 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cef57-401a-4b62-bc28-594c109f4819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:42.004073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cef57-401a-4b62-bc28-594c109f4819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:42.005483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cef57-401a-4b62-bc28-594c109f4819 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:42.015512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1270/2555] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:42.102055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cab52-a1f0-4db4-a23f-414257fc861b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:42.113141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cab52-a1f0-4db4-a23f-414257fc861b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:42.118699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019aa85a-8122-4740-8152-a2d5b2af2908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:42.119399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aa85a-8122-4740-8152-a2d5b2af2908 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:42.119599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aa85a-8122-4740-8152-a2d5b2af2908 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:42.119862 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aa85a-8122-4740-8152-a2d5b2af2908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:42.182999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:42.185683 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019aa85a-8122-4740-8152-a2d5b2af2908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:42.187397 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019aa85a-8122-4740-8152-a2d5b2af2908 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:42.198199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1286/2556] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:42 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:41:44.696137 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cef57-401a-4b62-bc28-594c109f4819 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:44.697581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-257cef57-401a-4b62-bc28-594c109f4819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:44.719768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:44.775253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cef57-401a-4b62-bc28-594c109f4819 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:44.780718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571690d-9998-48db-bb36-04fc749245f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:44.781499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571690d-9998-48db-bb36-04fc749245f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:44.781823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571690d-9998-48db-bb36-04fc749245f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:44.782185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571690d-9998-48db-bb36-04fc749245f7 admin admin] PATH_INFO: `/v3/users/411b1c674ef24c2bab146208d720c0b4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:44.784400 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571690d-9998-48db-bb36-04fc749245f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=411b1c674ef24c2bab146208d720c0b4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:44.786353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571690d-9998-48db-bb36-04fc749245f7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:44.839005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6571690d-9998-48db-bb36-04fc749245f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411b1c674ef24c2bab146208d720c0b4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:44.846700 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6571690d-9998-48db-bb36-04fc749245f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411b1c674ef24c2bab146208d720c0b4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:44.847463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6571690d-9998-48db-bb36-04fc749245f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411b1c674ef24c2bab146208d720c0b4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:44.848130 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6571690d-9998-48db-bb36-04fc749245f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411b1c674ef24c2bab146208d720c0b4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:44.860960 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6571690d-9998-48db-bb36-04fc749245f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411b1c674ef24c2bab146208d720c0b4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:44.873037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1271/2557] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:44 2022] DELETE /identity/v3/users/411b1c674ef24c2bab146208d720c0b4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:45.052419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019aa85a-8122-4740-8152-a2d5b2af2908 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:45.063881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019aa85a-8122-4740-8152-a2d5b2af2908 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:45.135070 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb414e-d86a-41b0-afde-b59946c5f88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:45.135691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb414e-d86a-41b0-afde-b59946c5f88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:45.135984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb414e-d86a-41b0-afde-b59946c5f88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:45.136437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb414e-d86a-41b0-afde-b59946c5f88a admin admin] PATH_INFO: `/v3/projects/deeb373bbc2f4eb7a0fe70ca05d82552` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:45.137701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb414e-d86a-41b0-afde-b59946c5f88a admin admin] RBAC: Authorizing `identity:delete_project(project_id=deeb373bbc2f4eb7a0fe70ca05d82552)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:45.140487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb414e-d86a-41b0-afde-b59946c5f88a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:45.212982 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-01bb414e-d86a-41b0-afde-b59946c5f88a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deeb373bbc2f4eb7a0fe70ca05d82552', 'request_id': 'req-01bb414e-d86a-41b0-afde-b59946c5f88a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:45.218651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-01bb414e-d86a-41b0-afde-b59946c5f88a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deeb373bbc2f4eb7a0fe70ca05d82552', 'request_id': 'req-01bb414e-d86a-41b0-afde-b59946c5f88a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:45.224811 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-01bb414e-d86a-41b0-afde-b59946c5f88a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deeb373bbc2f4eb7a0fe70ca05d82552', 'request_id': 'req-01bb414e-d86a-41b0-afde-b59946c5f88a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:45.237723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-01bb414e-d86a-41b0-afde-b59946c5f88a admin admin] The token cache is being invalidate because project deeb373bbc2f4eb7a0fe70ca05d82552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:41:45.238014 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-01bb414e-d86a-41b0-afde-b59946c5f88a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:45.238708 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-01bb414e-d86a-41b0-afde-b59946c5f88a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:45.240233 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1287/2558] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:41:45 2022] DELETE /identity/v3/projects/deeb373bbc2f4eb7a0fe70ca05d82552 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:45.245153 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c39b16-4853-44c7-a3cb-813b3cfbdadf None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:45.245436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c39b16-4853-44c7-a3cb-813b3cfbdadf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:45.245736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c39b16-4853-44c7-a3cb-813b3cfbdadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:45.266048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c5c39b16-4853-44c7-a3cb-813b3cfbdadf None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:45.267327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c5c39b16-4853-44c7-a3cb-813b3cfbdadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:45.335384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1272/2559] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:45.344066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02193d-f2b0-40f2-80c6-bfea5c73036a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:45.344352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02193d-f2b0-40f2-80c6-bfea5c73036a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:45.344640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02193d-f2b0-40f2-80c6-bfea5c73036a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:45.366908 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-9f02193d-f2b0-40f2-80c6-bfea5c73036a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:45.368141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9f02193d-f2b0-40f2-80c6-bfea5c73036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:45.376378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1288/2560] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:45.381133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c39b16-4853-44c7-a3cb-813b3cfbdadf None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:45.390788 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c39b16-4853-44c7-a3cb-813b3cfbdadf None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:45.395954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cb8bd-9432-4dbb-8995-a86c186e68e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:45.396544 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cb8bd-9432-4dbb-8995-a86c186e68e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:45.396825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cb8bd-9432-4dbb-8995-a86c186e68e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:45.397093 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cb8bd-9432-4dbb-8995-a86c186e68e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:45.397736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cb8bd-9432-4dbb-8995-a86c186e68e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:41:45.398035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cb8bd-9432-4dbb-8995-a86c186e68e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:45.399652 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cb8bd-9432-4dbb-8995-a86c186e68e5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:45.411271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1273/2561] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:41:45.415378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02193d-f2b0-40f2-80c6-bfea5c73036a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:45.424995 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02193d-f2b0-40f2-80c6-bfea5c73036a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:45.429664 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f98366-fcba-47c7-b9a4-99afbbb3dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:45.430246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f98366-fcba-47c7-b9a4-99afbbb3dbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:45.430521 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f98366-fcba-47c7-b9a4-99afbbb3dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:45.430789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f98366-fcba-47c7-b9a4-99afbbb3dbb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:45.431449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f98366-fcba-47c7-b9a4-99afbbb3dbb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:45.433331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f98366-fcba-47c7-b9a4-99afbbb3dbb4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:45.463024 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1289/2562] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:45 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:41:45.467575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cb8bd-9432-4dbb-8995-a86c186e68e5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:45.478666 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cb8bd-9432-4dbb-8995-a86c186e68e5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:45.498965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:45.536260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9e077-8b85-41f8-bfc6-4d593d9922e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:45.536850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e077-8b85-41f8-bfc6-4d593d9922e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:45.537122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e077-8b85-41f8-bfc6-4d593d9922e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:45.537388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e077-8b85-41f8-bfc6-4d593d9922e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:45.537995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9e077-8b85-41f8-bfc6-4d593d9922e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:45.539945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9e077-8b85-41f8-bfc6-4d593d9922e3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:45.560799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1274/2563] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:45 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:45.565770 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f98366-fcba-47c7-b9a4-99afbbb3dbb4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:45.576114 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f98366-fcba-47c7-b9a4-99afbbb3dbb4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:45.580774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa3dd-6d39-4ddf-ade7-69a68370bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:45.581361 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa3dd-6d39-4ddf-ade7-69a68370bda1 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:45.581637 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa3dd-6d39-4ddf-ade7-69a68370bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:45.581903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa3dd-6d39-4ddf-ade7-69a68370bda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:45.582534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fa3dd-6d39-4ddf-ade7-69a68370bda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:45.584158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fa3dd-6d39-4ddf-ade7-69a68370bda1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:45.593712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1290/2564] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:45.597562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9e077-8b85-41f8-bfc6-4d593d9922e3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:45.607669 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9e077-8b85-41f8-bfc6-4d593d9922e3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:45.612871 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485da4b-d4c7-4b4d-85ba-d60a7626070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:45.613456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485da4b-d4c7-4b4d-85ba-d60a7626070a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:45.613730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485da4b-d4c7-4b4d-85ba-d60a7626070a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:45.614000 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485da4b-d4c7-4b4d-85ba-d60a7626070a admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:45.614632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485da4b-d4c7-4b4d-85ba-d60a7626070a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:45.616242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485da4b-d4c7-4b4d-85ba-d60a7626070a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:45.626565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1275/2565] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:45.631142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa3dd-6d39-4ddf-ade7-69a68370bda1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:45.640762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa3dd-6d39-4ddf-ade7-69a68370bda1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:45.645451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef914a-e41c-40ef-a52b-d50c8bfbf318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:45.646002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef914a-e41c-40ef-a52b-d50c8bfbf318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:45.646278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef914a-e41c-40ef-a52b-d50c8bfbf318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:45.646547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef914a-e41c-40ef-a52b-d50c8bfbf318 admin admin] PATH_INFO: `/v3/projects/f8977fc11c8b49b59b1f6344e94ffb03/users/2f2ead74e50945b4bf293e78dbfa1c11/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:45.660765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef914a-e41c-40ef-a52b-d50c8bfbf318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8977fc11c8b49b59b1f6344e94ffb03, user_id=2f2ead74e50945b4bf293e78dbfa1c11, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:45.663408 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef914a-e41c-40ef-a52b-d50c8bfbf318 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:45.677053 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1291/2566] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:45 2022] PUT /identity/v3/projects/f8977fc11c8b49b59b1f6344e94ffb03/users/2f2ead74e50945b4bf293e78dbfa1c11/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:45.686954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab70a4-c464-4313-b623-54c35de20617 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:45.687274 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab70a4-c464-4313-b623-54c35de20617 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:45.687549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab70a4-c464-4313-b623-54c35de20617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:45.718480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7aab70a4-c464-4313-b623-54c35de20617 None None] MFA Rules not processed for user `2f2ead74e50945b4bf293e78dbfa1c11`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:45.719700 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7aab70a4-c464-4313-b623-54c35de20617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:45.788252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1276/2567] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:45 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:45.792801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef914a-e41c-40ef-a52b-d50c8bfbf318 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:45.829106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:45.868610 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef914a-e41c-40ef-a52b-d50c8bfbf318 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:45.873359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec3c9-2f4c-4771-bc97-18eddb080067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:45.873962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec3c9-2f4c-4771-bc97-18eddb080067 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:45.874239 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec3c9-2f4c-4771-bc97-18eddb080067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:45.874520 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec3c9-2f4c-4771-bc97-18eddb080067 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:45.875250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec3c9-2f4c-4771-bc97-18eddb080067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:45.877140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec3c9-2f4c-4771-bc97-18eddb080067 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:45.904722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1292/2568] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:45 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:45.910037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab70a4-c464-4313-b623-54c35de20617 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:45.920970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab70a4-c464-4313-b623-54c35de20617 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:45.979682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9c53c-21e4-4b30-9f03-5abbc13581f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:45.980405 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9c53c-21e4-4b30-9f03-5abbc13581f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:45.980677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9c53c-21e4-4b30-9f03-5abbc13581f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:45.980949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9c53c-21e4-4b30-9f03-5abbc13581f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:45.981559 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9c53c-21e4-4b30-9f03-5abbc13581f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:45.983486 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9c53c-21e4-4b30-9f03-5abbc13581f3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:46.012766 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1277/2569] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:45 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:46.014123 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec3c9-2f4c-4771-bc97-18eddb080067 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:46.025714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec3c9-2f4c-4771-bc97-18eddb080067 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:46.030745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b459c4-c4a2-4c25-a25e-23556729ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:46.031380 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b459c4-c4a2-4c25-a25e-23556729ece5 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:46.031651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b459c4-c4a2-4c25-a25e-23556729ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:46.031920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b459c4-c4a2-4c25-a25e-23556729ece5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:46.032557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b459c4-c4a2-4c25-a25e-23556729ece5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:46.034898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b459c4-c4a2-4c25-a25e-23556729ece5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:46.047346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1293/2570] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:46.052158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9c53c-21e4-4b30-9f03-5abbc13581f3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:46.062398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9c53c-21e4-4b30-9f03-5abbc13581f3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:46.067557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bc82e-936d-4586-aa06-c627fe6ed1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:46.068221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bc82e-936d-4586-aa06-c627fe6ed1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:46.068521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bc82e-936d-4586-aa06-c627fe6ed1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:46.068813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bc82e-936d-4586-aa06-c627fe6ed1e2 admin admin] PATH_INFO: `/v3/projects/d3848c275c7745c7b650f678b1de0ee7/users/dd91c518713c43e39683dcdfffe7f835/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:46.087245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bc82e-936d-4586-aa06-c627fe6ed1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3848c275c7745c7b650f678b1de0ee7, user_id=dd91c518713c43e39683dcdfffe7f835, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:46.089881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bc82e-936d-4586-aa06-c627fe6ed1e2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:46.098969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:46.105472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1278/2571] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:46 2022] PUT /identity/v3/projects/d3848c275c7745c7b650f678b1de0ee7/users/dd91c518713c43e39683dcdfffe7f835/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:46.109541 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b459c4-c4a2-4c25-a25e-23556729ece5 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:46.120609 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b459c4-c4a2-4c25-a25e-23556729ece5 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:46.178942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f56aa-87ba-4efb-a901-55a99b8d956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:46.179579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f56aa-87ba-4efb-a901-55a99b8d956c admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:46.179844 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f56aa-87ba-4efb-a901-55a99b8d956c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:46.180161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f56aa-87ba-4efb-a901-55a99b8d956c admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:46.180749 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f56aa-87ba-4efb-a901-55a99b8d956c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:46.182424 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f56aa-87ba-4efb-a901-55a99b8d956c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:46.193109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1294/2572] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:46.197257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bc82e-936d-4586-aa06-c627fe6ed1e2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:46.208442 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bc82e-936d-4586-aa06-c627fe6ed1e2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:46.214138 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab4334-c869-4d53-aa68-98bf8e2d3e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:46.215068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab4334-c869-4d53-aa68-98bf8e2d3e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:46.215377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab4334-c869-4d53-aa68-98bf8e2d3e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:46.215647 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab4334-c869-4d53-aa68-98bf8e2d3e94 admin admin] PATH_INFO: `/v3/projects/d3848c275c7745c7b650f678b1de0ee7/users/dd91c518713c43e39683dcdfffe7f835/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:46.217635 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab4334-c869-4d53-aa68-98bf8e2d3e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3848c275c7745c7b650f678b1de0ee7, user_id=dd91c518713c43e39683dcdfffe7f835, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:46.220483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab4334-c869-4d53-aa68-98bf8e2d3e94 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:46.233510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1279/2573] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:46 2022] PUT /identity/v3/projects/d3848c275c7745c7b650f678b1de0ee7/users/dd91c518713c43e39683dcdfffe7f835/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:46.244185 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21a002-db86-4f52-8018-6ed7a3f37264 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:46.244493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21a002-db86-4f52-8018-6ed7a3f37264 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:46.244741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21a002-db86-4f52-8018-6ed7a3f37264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:46.281345 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8d21a002-db86-4f52-8018-6ed7a3f37264 None None] MFA Rules not processed for user `dd91c518713c43e39683dcdfffe7f835`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:46.282763 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8d21a002-db86-4f52-8018-6ed7a3f37264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:46.368423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1295/2574] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:46.393697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab4334-c869-4d53-aa68-98bf8e2d3e94 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:46.395518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-30ab4334-c869-4d53-aa68-98bf8e2d3e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:46.454739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab4334-c869-4d53-aa68-98bf8e2d3e94 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:46.458979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd78cd-2648-4d24-b370-6051979d5b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:46.459610 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd78cd-2648-4d24-b370-6051979d5b5c service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:46.459888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd78cd-2648-4d24-b370-6051979d5b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:46.460158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd78cd-2648-4d24-b370-6051979d5b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:46.469819 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd78cd-2648-4d24-b370-6051979d5b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:46.471957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd78cd-2648-4d24-b370-6051979d5b5c service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:46.481781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1280/2575] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:46 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:46.527635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21a002-db86-4f52-8018-6ed7a3f37264 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:46.529148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8d21a002-db86-4f52-8018-6ed7a3f37264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:46.557595 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:46.608270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21a002-db86-4f52-8018-6ed7a3f37264 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:46.613223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f581d1a-8a45-4e29-9b54-6e8924a217f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:46.613953 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f581d1a-8a45-4e29-9b54-6e8924a217f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:46.614306 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f581d1a-8a45-4e29-9b54-6e8924a217f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:46.614649 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f581d1a-8a45-4e29-9b54-6e8924a217f1 admin admin] PATH_INFO: `/v3/users/09fbe5d371704e9999c6e6f769236737` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:46.615848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f581d1a-8a45-4e29-9b54-6e8924a217f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09fbe5d371704e9999c6e6f769236737)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:46.617755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f581d1a-8a45-4e29-9b54-6e8924a217f1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:46.642364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd78cd-2648-4d24-b370-6051979d5b5c service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:46.653828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd78cd-2648-4d24-b370-6051979d5b5c service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:46.658753 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7f964-35d3-40b0-9082-0e43ad2af0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:46.659385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7f964-35d3-40b0-9082-0e43ad2af0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:46.659667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7f964-35d3-40b0-9082-0e43ad2af0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:46.659951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7f964-35d3-40b0-9082-0e43ad2af0f4 admin admin] PATH_INFO: `/v3/users/2f2ead74e50945b4bf293e78dbfa1c11` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:46.661222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7f964-35d3-40b0-9082-0e43ad2af0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f2ead74e50945b4bf293e78dbfa1c11)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:46.663296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7f964-35d3-40b0-9082-0e43ad2af0f4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:46.667235 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3f581d1a-8a45-4e29-9b54-6e8924a217f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09fbe5d371704e9999c6e6f769236737'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:46.674717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3f581d1a-8a45-4e29-9b54-6e8924a217f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09fbe5d371704e9999c6e6f769236737'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:46.682443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3f581d1a-8a45-4e29-9b54-6e8924a217f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09fbe5d371704e9999c6e6f769236737'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:46.683164 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3f581d1a-8a45-4e29-9b54-6e8924a217f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09fbe5d371704e9999c6e6f769236737'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:46.697081 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3f581d1a-8a45-4e29-9b54-6e8924a217f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09fbe5d371704e9999c6e6f769236737'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:46.703378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1296/2576] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:46 2022] DELETE /identity/v3/users/09fbe5d371704e9999c6e6f769236737 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:46.710205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f99eb7-7007-4b6c-b273-9ff865f656ed None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:46.710486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f99eb7-7007-4b6c-b273-9ff865f656ed None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:46.710831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f99eb7-7007-4b6c-b273-9ff865f656ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:46.712384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-63e7f964-35d3-40b0-9082-0e43ad2af0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2ead74e50945b4bf293e78dbfa1c11'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:46.720073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-63e7f964-35d3-40b0-9082-0e43ad2af0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2ead74e50945b4bf293e78dbfa1c11'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:46.720879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-63e7f964-35d3-40b0-9082-0e43ad2af0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2ead74e50945b4bf293e78dbfa1c11'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:46.721628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-63e7f964-35d3-40b0-9082-0e43ad2af0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2ead74e50945b4bf293e78dbfa1c11'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:46.730207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f9f99eb7-7007-4b6c-b273-9ff865f656ed None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:46.731441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f9f99eb7-7007-4b6c-b273-9ff865f656ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:46.733931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-63e7f964-35d3-40b0-9082-0e43ad2af0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2ead74e50945b4bf293e78dbfa1c11'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:46.746401 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1281/2577] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:46 2022] DELETE /identity/v3/users/2f2ead74e50945b4bf293e78dbfa1c11 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:46.750717 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ab980-b791-468a-9c36-814e54aa417b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:46.750993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ab980-b791-468a-9c36-814e54aa417b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:46.751307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ab980-b791-468a-9c36-814e54aa417b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:46.771072 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d35ab980-b791-468a-9c36-814e54aa417b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:46.772330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d35ab980-b791-468a-9c36-814e54aa417b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:46.790831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1297/2578] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:46.800501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f99eb7-7007-4b6c-b273-9ff865f656ed None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:46.801889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f9f99eb7-7007-4b6c-b273-9ff865f656ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:46.825248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:46.837545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1282/2579] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:46.845836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:46.846365 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ab980-b791-468a-9c36-814e54aa417b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:46.847887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d35ab980-b791-468a-9c36-814e54aa417b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:46.862293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f99eb7-7007-4b6c-b273-9ff865f656ed None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:46.905507 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ab980-b791-468a-9c36-814e54aa417b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:46.909512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9217a-1b7f-4585-baad-19f92befc73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:46.910117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9217a-1b7f-4585-baad-19f92befc73f service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:46.910396 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9217a-1b7f-4585-baad-19f92befc73f service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:46.910666 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9217a-1b7f-4585-baad-19f92befc73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:46.911251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dc217-4799-479b-80a4-c9cea97eb5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:46.911848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dc217-4799-479b-80a4-c9cea97eb5ba service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:46.912124 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dc217-4799-479b-80a4-c9cea97eb5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:46.912395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dc217-4799-479b-80a4-c9cea97eb5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:46.919648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9217a-1b7f-4585-baad-19f92befc73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:46.921126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9217a-1b7f-4585-baad-19f92befc73f service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:46.921250 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3dc217-4799-479b-80a4-c9cea97eb5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:46.922639 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3dc217-4799-479b-80a4-c9cea97eb5ba service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:46.930524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1283/2580] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:41:46.932021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1298/2581] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:47.399175 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9217a-1b7f-4585-baad-19f92befc73f service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:47.401080 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-61f9217a-1b7f-4585-baad-19f92befc73f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:47.411862 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dc217-4799-479b-80a4-c9cea97eb5ba service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:47.413355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-af3dc217-4799-479b-80a4-c9cea97eb5ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:47.428483 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9217a-1b7f-4585-baad-19f92befc73f service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:47.432139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dc217-4799-479b-80a4-c9cea97eb5ba service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:47.433643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:47.434486 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:47.435197 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:47.436213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] PATH_INFO: `/v3/projects/c278b682182d4879a356b831fb884ee1` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:47.437146 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:47.437298 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c278b682182d4879a356b831fb884ee1)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:47.438211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:47.438211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:47.438382 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] PATH_INFO: `/v3/projects/f8977fc11c8b49b59b1f6344e94ffb03` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:47.439241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:47.439582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8977fc11c8b49b59b1f6344e94ffb03)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:47.441914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:47.492188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c278b682182d4879a356b831fb884ee1', 'request_id': 'req-4b72f29a-bf47-4def-9de3-63b411aa89fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.492683 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8977fc11c8b49b59b1f6344e94ffb03', 'request_id': 'req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.497877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c278b682182d4879a356b831fb884ee1', 'request_id': 'req-4b72f29a-bf47-4def-9de3-63b411aa89fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.498280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8977fc11c8b49b59b1f6344e94ffb03', 'request_id': 'req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.503982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c278b682182d4879a356b831fb884ee1', 'request_id': 'req-4b72f29a-bf47-4def-9de3-63b411aa89fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.504508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8977fc11c8b49b59b1f6344e94ffb03', 'request_id': 'req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.517348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] The token cache is being invalidate because project f8977fc11c8b49b59b1f6344e94ffb03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:41:47.517736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.518381 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.519907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1299/2582] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:41:47 2022] DELETE /identity/v3/projects/f8977fc11c8b49b59b1f6344e94ffb03 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:47.520076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] The token cache is being invalidate because project c278b682182d4879a356b831fb884ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:41:47.520359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.523391 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.524032 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:47.525034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1284/2583] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:41:47 2022] DELETE /identity/v3/projects/c278b682182d4879a356b831fb884ee1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:47.525491 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:47.528696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:47.530151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:47.597678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7e3dd-1ea0-49d9-90ae-9307122e4ca4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:47.603891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:47.604709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:47.605089 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:47.605255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72f29a-bf47-4def-9de3-63b411aa89fc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:47.605546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] PATH_INFO: `/v3/users/dd91c518713c43e39683dcdfffe7f835` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:47.606808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd91c518713c43e39683dcdfffe7f835)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:47.609020 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:47.610965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:47.611640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:47.612462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:47.612740 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] PATH_INFO: `/v3/users/a6013e381d1f4646a0113d33269de1ee` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:47.613920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6013e381d1f4646a0113d33269de1ee)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:47.615885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:47.640718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:47.652480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:47.670975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd91c518713c43e39683dcdfffe7f835'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.677632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6013e381d1f4646a0113d33269de1ee'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.678806 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd91c518713c43e39683dcdfffe7f835'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.687971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6013e381d1f4646a0113d33269de1ee'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.688886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6013e381d1f4646a0113d33269de1ee'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.689738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6013e381d1f4646a0113d33269de1ee'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.690233 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd91c518713c43e39683dcdfffe7f835'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.690976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd91c518713c43e39683dcdfffe7f835'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.710459 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd91c518713c43e39683dcdfffe7f835'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.714621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6013e381d1f4646a0113d33269de1ee'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:47.717323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1300/2584] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:47 2022] DELETE /identity/v3/users/dd91c518713c43e39683dcdfffe7f835 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:47.729364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1285/2585] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:47 2022] DELETE /identity/v3/users/a6013e381d1f4646a0113d33269de1ee => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:48.090814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.092382 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:48.097471 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.099064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:48.182850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b4f58-51c1-4ed4-9770-5f02cf18f446 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.187949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d3972-da05-45b1-b361-446333d4aede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.188571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d3972-da05-45b1-b361-446333d4aede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.188843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d3972-da05-45b1-b361-446333d4aede admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.189110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d3972-da05-45b1-b361-446333d4aede admin admin] PATH_INFO: `/v3/projects/e3ad520c3b7842baafb64d42d422b2e4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.190809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d3972-da05-45b1-b361-446333d4aede admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ad520c3b7842baafb64d42d422b2e4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.192776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d3972-da05-45b1-b361-446333d4aede admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.196376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308e19e-e208-4864-9716-2f061921fbd4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.200996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bbce5-2368-4e9f-ad34-bda18a633a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.201619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bbce5-2368-4e9f-ad34-bda18a633a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.201896 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bbce5-2368-4e9f-ad34-bda18a633a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.202165 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bbce5-2368-4e9f-ad34-bda18a633a7b admin admin] PATH_INFO: `/v3/projects/d3848c275c7745c7b650f678b1de0ee7` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.203312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bbce5-2368-4e9f-ad34-bda18a633a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3848c275c7745c7b650f678b1de0ee7)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.205205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bbce5-2368-4e9f-ad34-bda18a633a7b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.239858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-791d3972-da05-45b1-b361-446333d4aede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ad520c3b7842baafb64d42d422b2e4', 'request_id': 'req-791d3972-da05-45b1-b361-446333d4aede'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:48.245320 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-791d3972-da05-45b1-b361-446333d4aede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ad520c3b7842baafb64d42d422b2e4', 'request_id': 'req-791d3972-da05-45b1-b361-446333d4aede'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:48.251156 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d29bbce5-2368-4e9f-ad34-bda18a633a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3848c275c7745c7b650f678b1de0ee7', 'request_id': 'req-d29bbce5-2368-4e9f-ad34-bda18a633a7b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:48.251356 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-791d3972-da05-45b1-b361-446333d4aede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ad520c3b7842baafb64d42d422b2e4', 'request_id': 'req-791d3972-da05-45b1-b361-446333d4aede'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:48.257578 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d29bbce5-2368-4e9f-ad34-bda18a633a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3848c275c7745c7b650f678b1de0ee7', 'request_id': 'req-d29bbce5-2368-4e9f-ad34-bda18a633a7b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:48.264756 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d29bbce5-2368-4e9f-ad34-bda18a633a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3848c275c7745c7b650f678b1de0ee7', 'request_id': 'req-d29bbce5-2368-4e9f-ad34-bda18a633a7b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:48.265006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-791d3972-da05-45b1-b361-446333d4aede admin admin] The token cache is being invalidate because project e3ad520c3b7842baafb64d42d422b2e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:41:48.265297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-791d3972-da05-45b1-b361-446333d4aede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:48.265914 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-791d3972-da05-45b1-b361-446333d4aede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:48.267583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1286/2586] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:41:48 2022] DELETE /identity/v3/projects/e3ad520c3b7842baafb64d42d422b2e4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:48.272822 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c0a70-135d-482e-b429-752063b70e57 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.273113 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c0a70-135d-482e-b429-752063b70e57 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.273387 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c0a70-135d-482e-b429-752063b70e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.281142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d29bbce5-2368-4e9f-ad34-bda18a633a7b admin admin] The token cache is being invalidate because project d3848c275c7745c7b650f678b1de0ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:41:48.281432 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d29bbce5-2368-4e9f-ad34-bda18a633a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:48.282058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d29bbce5-2368-4e9f-ad34-bda18a633a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:48.284348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1301/2587] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:41:48 2022] DELETE /identity/v3/projects/d3848c275c7745c7b650f678b1de0ee7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:48.290112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079876e-bb8e-438b-b9df-0fad2e89e52c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.290507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079876e-bb8e-438b-b9df-0fad2e89e52c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.290855 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079876e-bb8e-438b-b9df-0fad2e89e52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.294742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-962c0a70-135d-482e-b429-752063b70e57 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:48.295979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-962c0a70-135d-482e-b429-752063b70e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:48.310498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1079876e-bb8e-438b-b9df-0fad2e89e52c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:48.311688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1079876e-bb8e-438b-b9df-0fad2e89e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:48.325412 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:48.335535 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:48.363472 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1287/2588] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:48.370784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af5798-0b1d-435e-91f6-dbc61626afea None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.371068 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af5798-0b1d-435e-91f6-dbc61626afea None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.372680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af5798-0b1d-435e-91f6-dbc61626afea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.386171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1302/2589] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:48.395067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83159e4-0d85-4cd4-b6ba-0d582c92d1f4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.395378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83159e4-0d85-4cd4-b6ba-0d582c92d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.395660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83159e4-0d85-4cd4-b6ba-0d582c92d1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.400253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b1af5798-0b1d-435e-91f6-dbc61626afea None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:48.401478 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b1af5798-0b1d-435e-91f6-dbc61626afea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:48.414389 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1288/2590] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:48.419176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af5798-0b1d-435e-91f6-dbc61626afea None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.420421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b83159e4-0d85-4cd4-b6ba-0d582c92d1f4 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:48.421606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b83159e4-0d85-4cd4-b6ba-0d582c92d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:48.430594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af5798-0b1d-435e-91f6-dbc61626afea None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.432412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1303/2591] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:48.436616 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83159e4-0d85-4cd4-b6ba-0d582c92d1f4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.440741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bff58-6594-4555-95c3-9723fc8233ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.441475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bff58-6594-4555-95c3-9723fc8233ed admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.441755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bff58-6594-4555-95c3-9723fc8233ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.442022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bff58-6594-4555-95c3-9723fc8233ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.442863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bff58-6594-4555-95c3-9723fc8233ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:41:48.443336 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bff58-6594-4555-95c3-9723fc8233ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.445354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bff58-6594-4555-95c3-9723fc8233ed admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.451061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83159e4-0d85-4cd4-b6ba-0d582c92d1f4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.457126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e35b51-ed34-4ebf-a856-f053f901e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.457562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1289/2592] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:41:48.457726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e35b51-ed34-4ebf-a856-f053f901e7ff admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.457975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e35b51-ed34-4ebf-a856-f053f901e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.458238 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e35b51-ed34-4ebf-a856-f053f901e7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.458873 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e35b51-ed34-4ebf-a856-f053f901e7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:41:48.459198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e35b51-ed34-4ebf-a856-f053f901e7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.460846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e35b51-ed34-4ebf-a856-f053f901e7ff admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.462102 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bff58-6594-4555-95c3-9723fc8233ed admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.472730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bff58-6594-4555-95c3-9723fc8233ed admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.477157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1304/2593] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:41:48.478349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf091bdc-33a8-46e7-9e61-8b21761d3ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.478508 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e35b51-ed34-4ebf-a856-f053f901e7ff admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.479112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091bdc-33a8-46e7-9e61-8b21761d3ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.479440 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091bdc-33a8-46e7-9e61-8b21761d3ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.479690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091bdc-33a8-46e7-9e61-8b21761d3ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.480351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf091bdc-33a8-46e7-9e61-8b21761d3ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.482381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf091bdc-33a8-46e7-9e61-8b21761d3ac2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.491750 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e35b51-ed34-4ebf-a856-f053f901e7ff admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.497591 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00820d5-2725-4525-b423-ed19a170a53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.498266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00820d5-2725-4525-b423-ed19a170a53e admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.498602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00820d5-2725-4525-b423-ed19a170a53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.498874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00820d5-2725-4525-b423-ed19a170a53e admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.499700 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00820d5-2725-4525-b423-ed19a170a53e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.501734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00820d5-2725-4525-b423-ed19a170a53e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.512212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1290/2594] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:48 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:48.517142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf091bdc-33a8-46e7-9e61-8b21761d3ac2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.532466 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1305/2595] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:48 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:41:48.537962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00820d5-2725-4525-b423-ed19a170a53e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.604949 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf091bdc-33a8-46e7-9e61-8b21761d3ac2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.621465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00820d5-2725-4525-b423-ed19a170a53e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.626175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49284038-66ad-4be1-8dfe-c89e39b839ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.626767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49284038-66ad-4be1-8dfe-c89e39b839ca admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.627040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49284038-66ad-4be1-8dfe-c89e39b839ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.627357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49284038-66ad-4be1-8dfe-c89e39b839ca admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.628002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49284038-66ad-4be1-8dfe-c89e39b839ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.629903 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49284038-66ad-4be1-8dfe-c89e39b839ca admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.655880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1306/2596] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:48 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:41:48.657138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49284038-66ad-4be1-8dfe-c89e39b839ca admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.667947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49284038-66ad-4be1-8dfe-c89e39b839ca admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.668134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43d37b-6935-42eb-8630-286b2eb3dad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.668690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43d37b-6935-42eb-8630-286b2eb3dad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.668915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43d37b-6935-42eb-8630-286b2eb3dad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.669208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43d37b-6935-42eb-8630-286b2eb3dad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.669925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43d37b-6935-42eb-8630-286b2eb3dad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.672003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43d37b-6935-42eb-8630-286b2eb3dad7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.673925 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cf309-24f4-4078-adc2-dca795615fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.674403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cf309-24f4-4078-adc2-dca795615fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.674644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cf309-24f4-4078-adc2-dca795615fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.674900 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cf309-24f4-4078-adc2-dca795615fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.675576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cf309-24f4-4078-adc2-dca795615fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.677190 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cf309-24f4-4078-adc2-dca795615fcf admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.691534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1307/2597] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:41:48.692688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cf309-24f4-4078-adc2-dca795615fcf admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.700685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1291/2598] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:48 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:48.701546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43d37b-6935-42eb-8630-286b2eb3dad7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.702581 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cf309-24f4-4078-adc2-dca795615fcf admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.707777 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79f065-359f-4164-a639-3fe0271ebed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.708510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79f065-359f-4164-a639-3fe0271ebed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.708971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79f065-359f-4164-a639-3fe0271ebed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.709243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79f065-359f-4164-a639-3fe0271ebed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.709875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79f065-359f-4164-a639-3fe0271ebed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.711488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79f065-359f-4164-a639-3fe0271ebed6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.711630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43d37b-6935-42eb-8630-286b2eb3dad7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.716136 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695b5e5-3fdb-44e3-8145-65df8b0ec7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.716714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695b5e5-3fdb-44e3-8145-65df8b0ec7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.716987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695b5e5-3fdb-44e3-8145-65df8b0ec7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.717251 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695b5e5-3fdb-44e3-8145-65df8b0ec7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.717879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695b5e5-3fdb-44e3-8145-65df8b0ec7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.719520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695b5e5-3fdb-44e3-8145-65df8b0ec7ec admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.722419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1308/2599] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:48.723607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceab591-f651-4cd6-a1f8-95d41e33a6fb None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.723886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceab591-f651-4cd6-a1f8-95d41e33a6fb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.724151 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceab591-f651-4cd6-a1f8-95d41e33a6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.732453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1292/2600] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:48.733280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695b5e5-3fdb-44e3-8145-65df8b0ec7ec admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.743265 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695b5e5-3fdb-44e3-8145-65df8b0ec7ec admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.746274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-cceab591-f651-4cd6-a1f8-95d41e33a6fb None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:48.747558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cceab591-f651-4cd6-a1f8-95d41e33a6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:48.748066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebc718-54b2-4887-aca9-4bb23a142fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.748729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebc718-54b2-4887-aca9-4bb23a142fde admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.749002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebc718-54b2-4887-aca9-4bb23a142fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.749270 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebc718-54b2-4887-aca9-4bb23a142fde admin admin] PATH_INFO: `/v3/projects/3ca0b357f8ca45fda8f4558b0a43cea6/users/0807997d949a40949ac1c9aa9ad9551a/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.755443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1309/2601] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 7 22:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:48.756211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceab591-f651-4cd6-a1f8-95d41e33a6fb None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.764290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebc718-54b2-4887-aca9-4bb23a142fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca0b357f8ca45fda8f4558b0a43cea6, user_id=0807997d949a40949ac1c9aa9ad9551a, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.766136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceab591-f651-4cd6-a1f8-95d41e33a6fb None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.766926 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebc718-54b2-4887-aca9-4bb23a142fde admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.771002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:48.773041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b2877-8b9a-4a8a-b1c9-1def49e05f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.773822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b2877-8b9a-4a8a-b1c9-1def49e05f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.774136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b2877-8b9a-4a8a-b1c9-1def49e05f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.774431 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b2877-8b9a-4a8a-b1c9-1def49e05f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.775208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b2877-8b9a-4a8a-b1c9-1def49e05f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.777109 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b2877-8b9a-4a8a-b1c9-1def49e05f6e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.785890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1293/2602] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:48 2022] PUT /identity/v3/projects/3ca0b357f8ca45fda8f4558b0a43cea6/users/0807997d949a40949ac1c9aa9ad9551a/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:48.786995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebc718-54b2-4887-aca9-4bb23a142fde admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.788735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-16ebc718-54b2-4887-aca9-4bb23a142fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:48.793618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1310/2603] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:48.796662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a53a29-ba85-4329-aaf6-b016634bdda7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.797068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a53a29-ba85-4329-aaf6-b016634bdda7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.797624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a53a29-ba85-4329-aaf6-b016634bdda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.825330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-12a53a29-ba85-4329-aaf6-b016634bdda7 None None] MFA Rules not processed for user `0807997d949a40949ac1c9aa9ad9551a`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:48.826606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-12a53a29-ba85-4329-aaf6-b016634bdda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:48.853824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:48.866654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebc718-54b2-4887-aca9-4bb23a142fde admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.872574 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7a117-74de-473d-a183-3e3db20343a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.873176 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7a117-74de-473d-a183-3e3db20343a6 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.873448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7a117-74de-473d-a183-3e3db20343a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.873717 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7a117-74de-473d-a183-3e3db20343a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.895051 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1311/2604] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:48.896016 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a53a29-ba85-4329-aaf6-b016634bdda7 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.939306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7a117-74de-473d-a183-3e3db20343a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.941508 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7a117-74de-473d-a183-3e3db20343a6 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:48.951521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1294/2605] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:48.952243 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7a117-74de-473d-a183-3e3db20343a6 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:48.962165 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7a117-74de-473d-a183-3e3db20343a6 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.963791 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a53a29-ba85-4329-aaf6-b016634bdda7 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:48.966940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0274b-b5e4-4c47-99f3-3074d3473ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.967557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0274b-b5e4-4c47-99f3-3074d3473ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.967826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0274b-b5e4-4c47-99f3-3074d3473ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.968091 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0274b-b5e4-4c47-99f3-3074d3473ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.968794 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0274b-b5e4-4c47-99f3-3074d3473ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:48.968966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603fb64-fbb8-4ea6-95cf-4cb8c60c7bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:48.969614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603fb64-fbb8-4ea6-95cf-4cb8c60c7bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:48.969883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603fb64-fbb8-4ea6-95cf-4cb8c60c7bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:48.970149 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603fb64-fbb8-4ea6-95cf-4cb8c60c7bb3 admin admin] PATH_INFO: `/v3/projects/b07de27ed0dc48b095dd5ad1941cca9f/users/fc3493a5e09b43b7a168c36063ccba6f/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:48.970550 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0274b-b5e4-4c47-99f3-3074d3473ab6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.007762 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1295/2606] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:48 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:49.012006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0274b-b5e4-4c47-99f3-3074d3473ab6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.087214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0274b-b5e4-4c47-99f3-3074d3473ab6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.091908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4830a6-b28f-4f3d-897f-f7c0a503aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.092521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4830a6-b28f-4f3d-897f-f7c0a503aa5a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.092800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4830a6-b28f-4f3d-897f-f7c0a503aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.093066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4830a6-b28f-4f3d-897f-f7c0a503aa5a admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.093834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4830a6-b28f-4f3d-897f-f7c0a503aa5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.095861 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4830a6-b28f-4f3d-897f-f7c0a503aa5a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.108013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:49.111966 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603fb64-fbb8-4ea6-95cf-4cb8c60c7bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07de27ed0dc48b095dd5ad1941cca9f, user_id=fc3493a5e09b43b7a168c36063ccba6f, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.114845 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603fb64-fbb8-4ea6-95cf-4cb8c60c7bb3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.120191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1296/2607] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:49 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:41:49.124392 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4830a6-b28f-4f3d-897f-f7c0a503aa5a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.129128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1312/2608] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:48 2022] PUT /identity/v3/projects/b07de27ed0dc48b095dd5ad1941cca9f/users/fc3493a5e09b43b7a168c36063ccba6f/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:49.134730 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4830a6-b28f-4f3d-897f-f7c0a503aa5a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.139169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2f137-ba74-46d3-bbee-29b0d3462785 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.139473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2f137-ba74-46d3-bbee-29b0d3462785 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.139743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2f137-ba74-46d3-bbee-29b0d3462785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.166943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2db2f137-ba74-46d3-bbee-29b0d3462785 None None] MFA Rules not processed for user `fc3493a5e09b43b7a168c36063ccba6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:49.168627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2db2f137-ba74-46d3-bbee-29b0d3462785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:49.193775 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0b8bd-8a5c-4e73-99e9-b1c0d4644d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.194408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0b8bd-8a5c-4e73-99e9-b1c0d4644d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.194722 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0b8bd-8a5c-4e73-99e9-b1c0d4644d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.194983 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0b8bd-8a5c-4e73-99e9-b1c0d4644d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.195656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0b8bd-8a5c-4e73-99e9-b1c0d4644d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.197290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0b8bd-8a5c-4e73-99e9-b1c0d4644d32 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.207543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1297/2609] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:41:49.211501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0b8bd-8a5c-4e73-99e9-b1c0d4644d32 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.220879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0b8bd-8a5c-4e73-99e9-b1c0d4644d32 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.225903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df48eca-ded8-4e1b-aed0-945b32718019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.226529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df48eca-ded8-4e1b-aed0-945b32718019 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.226852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df48eca-ded8-4e1b-aed0-945b32718019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.227133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df48eca-ded8-4e1b-aed0-945b32718019 admin admin] PATH_INFO: `/v3/projects/c56de0c31e52415fa55639594aea8896/users/70171acfd26f493db2ef60503e2e5806/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.234088 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1313/2610] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:49.239071 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2f137-ba74-46d3-bbee-29b0d3462785 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.242314 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df48eca-ded8-4e1b-aed0-945b32718019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56de0c31e52415fa55639594aea8896, user_id=70171acfd26f493db2ef60503e2e5806, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.245031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df48eca-ded8-4e1b-aed0-945b32718019 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.248922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2f137-ba74-46d3-bbee-29b0d3462785 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.254294 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ab71e-43b0-41b5-adec-98a907783d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.254867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ab71e-43b0-41b5-adec-98a907783d27 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.255173 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ab71e-43b0-41b5-adec-98a907783d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.255497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ab71e-43b0-41b5-adec-98a907783d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.256103 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ab71e-43b0-41b5-adec-98a907783d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.257932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ab71e-43b0-41b5-adec-98a907783d27 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.258497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1298/2611] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:49 2022] PUT /identity/v3/projects/c56de0c31e52415fa55639594aea8896/users/70171acfd26f493db2ef60503e2e5806/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:49.262275 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df48eca-ded8-4e1b-aed0-945b32718019 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.285365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1314/2612] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:49 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:41:49.289347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ab71e-43b0-41b5-adec-98a907783d27 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.307753 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:49.326341 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df48eca-ded8-4e1b-aed0-945b32718019 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.350580 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ab71e-43b0-41b5-adec-98a907783d27 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.355706 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02349769-5058-4fbb-ab46-718c20c31c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.356298 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02349769-5058-4fbb-ab46-718c20c31c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.356569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02349769-5058-4fbb-ab46-718c20c31c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.357169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02349769-5058-4fbb-ab46-718c20c31c87 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.357779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02349769-5058-4fbb-ab46-718c20c31c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.359742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02349769-5058-4fbb-ab46-718c20c31c87 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.385499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1315/2613] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:49 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:41:49.386501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02349769-5058-4fbb-ab46-718c20c31c87 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.387884 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24316a-5639-4dae-a20a-a660ae64d2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.388521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24316a-5639-4dae-a20a-a660ae64d2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.388800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24316a-5639-4dae-a20a-a660ae64d2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.389069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24316a-5639-4dae-a20a-a660ae64d2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.389718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24316a-5639-4dae-a20a-a660ae64d2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.391371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24316a-5639-4dae-a20a-a660ae64d2a7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.397253 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02349769-5058-4fbb-ab46-718c20c31c87 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.401247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1299/2614] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:41:49.404352 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec8497-ef9b-4026-b2d9-77428fe34245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.404706 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec8497-ef9b-4026-b2d9-77428fe34245 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.404984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec8497-ef9b-4026-b2d9-77428fe34245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.405202 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24316a-5639-4dae-a20a-a660ae64d2a7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.405342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec8497-ef9b-4026-b2d9-77428fe34245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.405877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec8497-ef9b-4026-b2d9-77428fe34245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.407482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec8497-ef9b-4026-b2d9-77428fe34245 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.415290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24316a-5639-4dae-a20a-a660ae64d2a7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.418188 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1316/2615] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:49.420919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8651d-4939-4dff-8fab-9093c26070d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.421886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8651d-4939-4dff-8fab-9093c26070d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.422017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec8497-ef9b-4026-b2d9-77428fe34245 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.422451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8651d-4939-4dff-8fab-9093c26070d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.422451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8651d-4939-4dff-8fab-9093c26070d6 admin admin] PATH_INFO: `/v3/projects/c56de0c31e52415fa55639594aea8896/users/70171acfd26f493db2ef60503e2e5806/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.424898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8651d-4939-4dff-8fab-9093c26070d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56de0c31e52415fa55639594aea8896, user_id=70171acfd26f493db2ef60503e2e5806, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.427600 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8651d-4939-4dff-8fab-9093c26070d6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.432083 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec8497-ef9b-4026-b2d9-77428fe34245 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.433220 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:49.439592 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1300/2616] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:49 2022] PUT /identity/v3/projects/c56de0c31e52415fa55639594aea8896/users/70171acfd26f493db2ef60503e2e5806/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:49.451319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d22b9c-fc6c-404c-8b8b-a72d13b844bd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.451606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d22b9c-fc6c-404c-8b8b-a72d13b844bd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.451878 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d22b9c-fc6c-404c-8b8b-a72d13b844bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.479840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-90d22b9c-fc6c-404c-8b8b-a72d13b844bd None None] MFA Rules not processed for user `70171acfd26f493db2ef60503e2e5806`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:49.481050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-90d22b9c-fc6c-404c-8b8b-a72d13b844bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:49.489127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328577f-a8d1-4ad3-bb59-8c1f89b68ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.489725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328577f-a8d1-4ad3-bb59-8c1f89b68ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.489999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328577f-a8d1-4ad3-bb59-8c1f89b68ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.490271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328577f-a8d1-4ad3-bb59-8c1f89b68ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.490899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328577f-a8d1-4ad3-bb59-8c1f89b68ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.492849 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328577f-a8d1-4ad3-bb59-8c1f89b68ee4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.503278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1317/2617] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:41:49.507412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328577f-a8d1-4ad3-bb59-8c1f89b68ee4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.516733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328577f-a8d1-4ad3-bb59-8c1f89b68ee4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.521730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60845ad5-eb87-4329-9a2f-7fdffb75b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.522341 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60845ad5-eb87-4329-9a2f-7fdffb75b33c admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.522644 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60845ad5-eb87-4329-9a2f-7fdffb75b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.523309 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60845ad5-eb87-4329-9a2f-7fdffb75b33c admin admin] PATH_INFO: `/v3/projects/813e3392aea84a84a3baf8578b97233c/users/6427aed378594baea9e6aa5f497f9b30/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.537425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60845ad5-eb87-4329-9a2f-7fdffb75b33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=813e3392aea84a84a3baf8578b97233c, user_id=6427aed378594baea9e6aa5f497f9b30, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.540034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60845ad5-eb87-4329-9a2f-7fdffb75b33c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.553128 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1318/2618] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:49 2022] PUT /identity/v3/projects/813e3392aea84a84a3baf8578b97233c/users/6427aed378594baea9e6aa5f497f9b30/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:49.555542 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1301/2619] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:49.564474 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795db8e-ca8c-4dae-83cf-bb104befae96 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.564746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795db8e-ca8c-4dae-83cf-bb104befae96 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.565554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795db8e-ca8c-4dae-83cf-bb104befae96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.577604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d22b9c-fc6c-404c-8b8b-a72d13b844bd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.580140 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-90d22b9c-fc6c-404c-8b8b-a72d13b844bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:49.596732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3795db8e-ca8c-4dae-83cf-bb104befae96 None None] MFA Rules not processed for user `6427aed378594baea9e6aa5f497f9b30`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:49.597926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3795db8e-ca8c-4dae-83cf-bb104befae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:49.642632 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d22b9c-fc6c-404c-8b8b-a72d13b844bd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.662977 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:49.673911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1319/2620] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:49.675537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795db8e-ca8c-4dae-83cf-bb104befae96 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.692154 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e57ee1-b146-4588-87e9-30d4c2cec8fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.692831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e57ee1-b146-4588-87e9-30d4c2cec8fd service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.693182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e57ee1-b146-4588-87e9-30d4c2cec8fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.693521 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e57ee1-b146-4588-87e9-30d4c2cec8fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.741839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795db8e-ca8c-4dae-83cf-bb104befae96 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.748855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:49.750316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03cca1-f22c-4e49-a1d6-95953bc54d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.751428 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03cca1-f22c-4e49-a1d6-95953bc54d25 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.751762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03cca1-f22c-4e49-a1d6-95953bc54d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.752036 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03cca1-f22c-4e49-a1d6-95953bc54d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.753501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e57ee1-b146-4588-87e9-30d4c2cec8fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.754602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03cca1-f22c-4e49-a1d6-95953bc54d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.755011 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e57ee1-b146-4588-87e9-30d4c2cec8fd service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.756527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03cca1-f22c-4e49-a1d6-95953bc54d25 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.764376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1302/2621] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:49.784992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1320/2622] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:49 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:49.789023 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e57ee1-b146-4588-87e9-30d4c2cec8fd service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.800606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e57ee1-b146-4588-87e9-30d4c2cec8fd service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.858182 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9eae2-75ed-425d-a309-ac5ed8474527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.858781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9eae2-75ed-425d-a309-ac5ed8474527 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.859054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9eae2-75ed-425d-a309-ac5ed8474527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.859359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9eae2-75ed-425d-a309-ac5ed8474527 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.860033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9eae2-75ed-425d-a309-ac5ed8474527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.862393 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9eae2-75ed-425d-a309-ac5ed8474527 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.883246 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1303/2623] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:49 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:49.887249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03cca1-f22c-4e49-a1d6-95953bc54d25 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.897709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03cca1-f22c-4e49-a1d6-95953bc54d25 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.902624 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8241393-0df2-4467-a9a2-85d8c44cbb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.903261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8241393-0df2-4467-a9a2-85d8c44cbb51 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.903709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8241393-0df2-4467-a9a2-85d8c44cbb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.903874 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8241393-0df2-4467-a9a2-85d8c44cbb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.904509 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8241393-0df2-4467-a9a2-85d8c44cbb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.906113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8241393-0df2-4467-a9a2-85d8c44cbb51 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.916668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1321/2624] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:41:49.920897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9eae2-75ed-425d-a309-ac5ed8474527 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.931903 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9eae2-75ed-425d-a309-ac5ed8474527 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:49.936769 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245991e9-b6af-471a-bd16-cdf13fbbfc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:49.937438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245991e9-b6af-471a-bd16-cdf13fbbfc76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:49.937721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245991e9-b6af-471a-bd16-cdf13fbbfc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:49.937993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245991e9-b6af-471a-bd16-cdf13fbbfc76 admin admin] PATH_INFO: `/v3/projects/c20b35e7b73f4861b476cdbc0c72c3d0/users/ed3de8049e734bb7a9ee22e03d15b4aa/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:49.954261 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245991e9-b6af-471a-bd16-cdf13fbbfc76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20b35e7b73f4861b476cdbc0c72c3d0, user_id=ed3de8049e734bb7a9ee22e03d15b4aa, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:49.956979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245991e9-b6af-471a-bd16-cdf13fbbfc76 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:49.971704 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1304/2625] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:49 2022] PUT /identity/v3/projects/c20b35e7b73f4861b476cdbc0c72c3d0/users/ed3de8049e734bb7a9ee22e03d15b4aa/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:49.975705 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8241393-0df2-4467-a9a2-85d8c44cbb51 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:49.988533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8241393-0df2-4467-a9a2-85d8c44cbb51 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:50.052471 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b1b64-4bd2-4fbb-be26-db5c8b7d5344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:50.053069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b1b64-4bd2-4fbb-be26-db5c8b7d5344 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:50.053342 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b1b64-4bd2-4fbb-be26-db5c8b7d5344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:50.053615 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b1b64-4bd2-4fbb-be26-db5c8b7d5344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:50.054246 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b1b64-4bd2-4fbb-be26-db5c8b7d5344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:50.055938 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b1b64-4bd2-4fbb-be26-db5c8b7d5344 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:50.066764 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1322/2626] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:41:50.070755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245991e9-b6af-471a-bd16-cdf13fbbfc76 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:50.087214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245991e9-b6af-471a-bd16-cdf13fbbfc76 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:50.092034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1813f4e-1641-4141-865b-1358b748be6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:50.092691 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1813f4e-1641-4141-865b-1358b748be6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:50.092980 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1813f4e-1641-4141-865b-1358b748be6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:50.093239 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1813f4e-1641-4141-865b-1358b748be6e admin admin] PATH_INFO: `/v3/projects/c20b35e7b73f4861b476cdbc0c72c3d0/users/ed3de8049e734bb7a9ee22e03d15b4aa/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:50.097448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1813f4e-1641-4141-865b-1358b748be6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20b35e7b73f4861b476cdbc0c72c3d0, user_id=ed3de8049e734bb7a9ee22e03d15b4aa, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:50.100195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1813f4e-1641-4141-865b-1358b748be6e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:50.116637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1305/2627] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:50 2022] PUT /identity/v3/projects/c20b35e7b73f4861b476cdbc0c72c3d0/users/ed3de8049e734bb7a9ee22e03d15b4aa/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:50.121868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b26be-5982-4b44-a07d-9f1f9a933ce2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:50.122154 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b26be-5982-4b44-a07d-9f1f9a933ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:50.123151 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b26be-5982-4b44-a07d-9f1f9a933ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:50.152586 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-148b26be-5982-4b44-a07d-9f1f9a933ce2 None None] MFA Rules not processed for user `ed3de8049e734bb7a9ee22e03d15b4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:50.153823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-148b26be-5982-4b44-a07d-9f1f9a933ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:50.214961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:50.227050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1323/2628] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:50.238431 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1813f4e-1641-4141-865b-1358b748be6e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:50.240151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c1813f4e-1641-4141-865b-1358b748be6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:50.297843 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1813f4e-1641-4141-865b-1358b748be6e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:50.301807 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d03dc-b48e-400f-b0c3-89a9ada7cdb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:50.302397 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d03dc-b48e-400f-b0c3-89a9ada7cdb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:50.302672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d03dc-b48e-400f-b0c3-89a9ada7cdb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:50.302967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d03dc-b48e-400f-b0c3-89a9ada7cdb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:50.311750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d03dc-b48e-400f-b0c3-89a9ada7cdb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:50.313162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d03dc-b48e-400f-b0c3-89a9ada7cdb0 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:50.322343 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1306/2629] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:50.363589 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b26be-5982-4b44-a07d-9f1f9a933ce2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:50.373932 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b26be-5982-4b44-a07d-9f1f9a933ce2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:50.378017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7d37b-9c8c-4beb-ac1b-7e1c9775cba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:50.378606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7d37b-9c8c-4beb-ac1b-7e1c9775cba5 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:50.378881 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7d37b-9c8c-4beb-ac1b-7e1c9775cba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:50.379180 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7d37b-9c8c-4beb-ac1b-7e1c9775cba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:50.436896 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7d37b-9c8c-4beb-ac1b-7e1c9775cba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:50.438306 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7d37b-9c8c-4beb-ac1b-7e1c9775cba5 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:50.447656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1324/2630] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:51.982728 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a19cf-2bdc-489a-a25a-67ef168d9e83 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:51.983498 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a19cf-2bdc-489a-a25a-67ef168d9e83 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:51.983952 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a19cf-2bdc-489a-a25a-67ef168d9e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:52.004328 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-826a19cf-2bdc-489a-a25a-67ef168d9e83 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:52.005639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-826a19cf-2bdc-489a-a25a-67ef168d9e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:52.068040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:52.086381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1307/2631] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 7 22:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:52.111040 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7d37b-9c8c-4beb-ac1b-7e1c9775cba5 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:52.112763 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-00b7d37b-9c8c-4beb-ac1b-7e1c9775cba5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:52.191633 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7d37b-9c8c-4beb-ac1b-7e1c9775cba5 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:52.197632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4b2c2-8c47-43c6-92e5-48b71a08d43c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:52.198266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4b2c2-8c47-43c6-92e5-48b71a08d43c service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:52.198538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4b2c2-8c47-43c6-92e5-48b71a08d43c service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:52.198799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4b2c2-8c47-43c6-92e5-48b71a08d43c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:52.208862 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4b2c2-8c47-43c6-92e5-48b71a08d43c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:52.211676 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4b2c2-8c47-43c6-92e5-48b71a08d43c service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:52.225927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1325/2632] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:53.343492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a19cf-2bdc-489a-a25a-67ef168d9e83 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:53.353996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a19cf-2bdc-489a-a25a-67ef168d9e83 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:53.358505 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:53.359139 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:53.359413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:53.359675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] PATH_INFO: `/v3/users/fc3493a5e09b43b7a168c36063ccba6f` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:53.360773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc3493a5e09b43b7a168c36063ccba6f)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:53.362690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:53.413637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc3493a5e09b43b7a168c36063ccba6f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:53.420805 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc3493a5e09b43b7a168c36063ccba6f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:53.421436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc3493a5e09b43b7a168c36063ccba6f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:53.422026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc3493a5e09b43b7a168c36063ccba6f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:53.433721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc3493a5e09b43b7a168c36063ccba6f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:53.446799 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1308/2633] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:53 2022] DELETE /identity/v3/users/fc3493a5e09b43b7a168c36063ccba6f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:53.451248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd1ae7-0574-4464-9f05-8a51d4f3123a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:53.451704 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd1ae7-0574-4464-9f05-8a51d4f3123a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:53.451820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd1ae7-0574-4464-9f05-8a51d4f3123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:53.470742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-19cd1ae7-0574-4464-9f05-8a51d4f3123a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:53.471961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-19cd1ae7-0574-4464-9f05-8a51d4f3123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:53.531338 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1326/2634] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:53.541092 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:53.542499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:53.598879 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcafb8-788b-493d-86b7-857458743854 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:53.602553 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a8478-bdbd-4535-8a51-38ac145ecae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:53.603178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a8478-bdbd-4535-8a51-38ac145ecae9 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:53.603457 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a8478-bdbd-4535-8a51-38ac145ecae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:53.603727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a8478-bdbd-4535-8a51-38ac145ecae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:53.612665 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a8478-bdbd-4535-8a51-38ac145ecae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:53.614084 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a8478-bdbd-4535-8a51-38ac145ecae9 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:53.623548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1309/2635] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:53.907973 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd1ae7-0574-4464-9f05-8a51d4f3123a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:53.909767 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-19cd1ae7-0574-4464-9f05-8a51d4f3123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:53.921959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd1ae7-0574-4464-9f05-8a51d4f3123a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:53.933121 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:53.934101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:53.934613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:53.935473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] PATH_INFO: `/v3/projects/b07de27ed0dc48b095dd5ad1941cca9f` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:53.936683 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07de27ed0dc48b095dd5ad1941cca9f)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:53.938613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:53.951627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:53.985911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a8478-bdbd-4535-8a51-38ac145ecae9 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:53.987910 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3e2a8478-bdbd-4535-8a51-38ac145ecae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:53.990916 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07de27ed0dc48b095dd5ad1941cca9f', 'request_id': 'req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:53.998968 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07de27ed0dc48b095dd5ad1941cca9f', 'request_id': 'req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.005814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07de27ed0dc48b095dd5ad1941cca9f', 'request_id': 'req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.018860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] The token cache is being invalidate because project b07de27ed0dc48b095dd5ad1941cca9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:41:54.024648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.025354 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.026888 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1327/2636] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:41:53 2022] DELETE /identity/v3/projects/b07de27ed0dc48b095dd5ad1941cca9f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:54.030807 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:54.032291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:54.058418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a8478-bdbd-4535-8a51-38ac145ecae9 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:54.076345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:54.112344 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098c3a6-53f1-4e86-960a-b37a46e9ad1a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:54.112911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f46f3-d1f8-4d50-a8da-da600d98b50d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:54.113520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f46f3-d1f8-4d50-a8da-da600d98b50d service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:54.113795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f46f3-d1f8-4d50-a8da-da600d98b50d service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:54.114063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f46f3-d1f8-4d50-a8da-da600d98b50d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:54.119937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:54.120097 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1b6f46f3-d1f8-4d50-a8da-da600d98b50d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:54.120575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:54.121009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:54.121243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] PATH_INFO: `/v3/users/6427aed378594baea9e6aa5f497f9b30` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:54.122395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6427aed378594baea9e6aa5f497f9b30)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:54.125750 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:54.179154 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6427aed378594baea9e6aa5f497f9b30'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.186192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6427aed378594baea9e6aa5f497f9b30'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.194295 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6427aed378594baea9e6aa5f497f9b30'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.194721 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f46f3-d1f8-4d50-a8da-da600d98b50d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:54.195636 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6427aed378594baea9e6aa5f497f9b30'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.196228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f46f3-d1f8-4d50-a8da-da600d98b50d service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:54.206528 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1310/2637] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:41:54.207462 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6427aed378594baea9e6aa5f497f9b30'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.213366 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1328/2638] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:54 2022] DELETE /identity/v3/users/6427aed378594baea9e6aa5f497f9b30 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:54.516305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f46f3-d1f8-4d50-a8da-da600d98b50d service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:54.533156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f46f3-d1f8-4d50-a8da-da600d98b50d service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:54.624185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf40a-17af-4f75-a1db-78b1dc6ccc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:54.625049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf40a-17af-4f75-a1db-78b1dc6ccc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:54.625355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf40a-17af-4f75-a1db-78b1dc6ccc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:54.625631 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf40a-17af-4f75-a1db-78b1dc6ccc98 admin admin] PATH_INFO: `/v3/projects/813e3392aea84a84a3baf8578b97233c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:54.626797 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adf40a-17af-4f75-a1db-78b1dc6ccc98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=813e3392aea84a84a3baf8578b97233c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:54.628834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adf40a-17af-4f75-a1db-78b1dc6ccc98 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:54.682650 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-63adf40a-17af-4f75-a1db-78b1dc6ccc98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813e3392aea84a84a3baf8578b97233c', 'request_id': 'req-63adf40a-17af-4f75-a1db-78b1dc6ccc98'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.689364 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-63adf40a-17af-4f75-a1db-78b1dc6ccc98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813e3392aea84a84a3baf8578b97233c', 'request_id': 'req-63adf40a-17af-4f75-a1db-78b1dc6ccc98'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.696093 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-63adf40a-17af-4f75-a1db-78b1dc6ccc98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813e3392aea84a84a3baf8578b97233c', 'request_id': 'req-63adf40a-17af-4f75-a1db-78b1dc6ccc98'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.704933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:54.709599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-63adf40a-17af-4f75-a1db-78b1dc6ccc98 admin admin] The token cache is being invalidate because project 813e3392aea84a84a3baf8578b97233c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:41:54.709896 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-63adf40a-17af-4f75-a1db-78b1dc6ccc98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.711002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-63adf40a-17af-4f75-a1db-78b1dc6ccc98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.712645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1311/2639] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:41:54 2022] DELETE /identity/v3/projects/813e3392aea84a84a3baf8578b97233c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:54.716694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:54.718374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:54.731758 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf579144-5f2e-4987-8d4b-8c1d6573e46f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:54.747415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:54.788943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:54.789554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:54.789825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:54.790089 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] PATH_INFO: `/v3/users/ed3de8049e734bb7a9ee22e03d15b4aa` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:54.791244 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3de8049e734bb7a9ee22e03d15b4aa)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:54.793121 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:54.838871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3de8049e734bb7a9ee22e03d15b4aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.845805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3de8049e734bb7a9ee22e03d15b4aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.853763 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3de8049e734bb7a9ee22e03d15b4aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.854443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3de8049e734bb7a9ee22e03d15b4aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.866069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3de8049e734bb7a9ee22e03d15b4aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:54.871833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1329/2640] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:54 2022] DELETE /identity/v3/users/ed3de8049e734bb7a9ee22e03d15b4aa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:55.085228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d94f5-ea2c-4504-857f-66f56745b759 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.085510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d94f5-ea2c-4504-857f-66f56745b759 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.085832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d94f5-ea2c-4504-857f-66f56745b759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.105526 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-800d94f5-ea2c-4504-857f-66f56745b759 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:55.106738 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-800d94f5-ea2c-4504-857f-66f56745b759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:55.152524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:55.154062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:55.174801 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1312/2641] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 7 22:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:55.213704 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d94f5-ea2c-4504-857f-66f56745b759 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:55.215599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-800d94f5-ea2c-4504-857f-66f56745b759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:55.238122 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d915713-c943-4fa7-8fc2-5c84516e6b0a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:55.242851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71457749-a8d6-407b-8711-74b6c0fb8d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:55.243515 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71457749-a8d6-407b-8711-74b6c0fb8d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.243805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71457749-a8d6-407b-8711-74b6c0fb8d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.244075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71457749-a8d6-407b-8711-74b6c0fb8d8e admin admin] PATH_INFO: `/v3/projects/c20b35e7b73f4861b476cdbc0c72c3d0` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.245674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71457749-a8d6-407b-8711-74b6c0fb8d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20b35e7b73f4861b476cdbc0c72c3d0)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:55.248069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71457749-a8d6-407b-8711-74b6c0fb8d8e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:55.289597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:55.295105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d94f5-ea2c-4504-857f-66f56745b759 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:55.297321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-71457749-a8d6-407b-8711-74b6c0fb8d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20b35e7b73f4861b476cdbc0c72c3d0', 'request_id': 'req-71457749-a8d6-407b-8711-74b6c0fb8d8e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:55.304351 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-71457749-a8d6-407b-8711-74b6c0fb8d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20b35e7b73f4861b476cdbc0c72c3d0', 'request_id': 'req-71457749-a8d6-407b-8711-74b6c0fb8d8e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:55.310753 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-71457749-a8d6-407b-8711-74b6c0fb8d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20b35e7b73f4861b476cdbc0c72c3d0', 'request_id': 'req-71457749-a8d6-407b-8711-74b6c0fb8d8e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:55.324678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-71457749-a8d6-407b-8711-74b6c0fb8d8e admin admin] The token cache is being invalidate because project c20b35e7b73f4861b476cdbc0c72c3d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:41:55.324961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-71457749-a8d6-407b-8711-74b6c0fb8d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:55.325599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-71457749-a8d6-407b-8711-74b6c0fb8d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:55.327067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1330/2642] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:41:55 2022] DELETE /identity/v3/projects/c20b35e7b73f4861b476cdbc0c72c3d0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:55.333393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17978-3dae-4ce3-8736-2513cb925834 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.333672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17978-3dae-4ce3-8736-2513cb925834 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.333939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17978-3dae-4ce3-8736-2513cb925834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.353506 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-39f17978-3dae-4ce3-8736-2513cb925834 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:55.354681 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-39f17978-3dae-4ce3-8736-2513cb925834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:55.360158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32280fe0-c4eb-465c-a7ce-a04b8d5d66c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:55.360763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32280fe0-c4eb-465c-a7ce-a04b8d5d66c5 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.361039 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32280fe0-c4eb-465c-a7ce-a04b8d5d66c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.361335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32280fe0-c4eb-465c-a7ce-a04b8d5d66c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.363706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-32280fe0-c4eb-465c-a7ce-a04b8d5d66c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:55.400906 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:55.415496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1331/2643] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:55.424682 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ba47-cf28-448c-aaab-75c2c12c6d6c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.424961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ba47-cf28-448c-aaab-75c2c12c6d6c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.425229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ba47-cf28-448c-aaab-75c2c12c6d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.430847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32280fe0-c4eb-465c-a7ce-a04b8d5d66c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:55.432413 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32280fe0-c4eb-465c-a7ce-a04b8d5d66c5 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:55.442074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1313/2644] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:41:55.443959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0967ba47-cf28-448c-aaab-75c2c12c6d6c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:55.445174 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0967ba47-cf28-448c-aaab-75c2c12c6d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:55.453429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1332/2645] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:55.458266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32280fe0-c4eb-465c-a7ce-a04b8d5d66c5 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:55.467885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32280fe0-c4eb-465c-a7ce-a04b8d5d66c5 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:55.472998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36a829-2014-4334-b8a7-537f5aec2474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:55.473592 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36a829-2014-4334-b8a7-537f5aec2474 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.473867 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36a829-2014-4334-b8a7-537f5aec2474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.474135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36a829-2014-4334-b8a7-537f5aec2474 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.474804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36a829-2014-4334-b8a7-537f5aec2474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:41:55.475124 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36a829-2014-4334-b8a7-537f5aec2474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:55.476719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36a829-2014-4334-b8a7-537f5aec2474 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:55.488385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1314/2646] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:41:55.492941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967ba47-cf28-448c-aaab-75c2c12c6d6c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:55.502298 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967ba47-cf28-448c-aaab-75c2c12c6d6c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:55.506911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b926ad-caa3-48c2-9044-009bf5a84a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:55.507604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b926ad-caa3-48c2-9044-009bf5a84a09 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.507875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b926ad-caa3-48c2-9044-009bf5a84a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.508136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b926ad-caa3-48c2-9044-009bf5a84a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.508742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b926ad-caa3-48c2-9044-009bf5a84a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:55.511810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b926ad-caa3-48c2-9044-009bf5a84a09 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:55.543513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1333/2647] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:55 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:41:55.547863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36a829-2014-4334-b8a7-537f5aec2474 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:55.561281 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36a829-2014-4334-b8a7-537f5aec2474 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:55.618136 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dc9ca-ded1-410c-8bfb-c361bdf4d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:55.618848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dc9ca-ded1-410c-8bfb-c361bdf4d231 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.619228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dc9ca-ded1-410c-8bfb-c361bdf4d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.619501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dc9ca-ded1-410c-8bfb-c361bdf4d231 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.620111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dc9ca-ded1-410c-8bfb-c361bdf4d231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:55.622002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dc9ca-ded1-410c-8bfb-c361bdf4d231 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:55.643945 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1315/2648] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:55 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:55.648406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b926ad-caa3-48c2-9044-009bf5a84a09 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:55.658927 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b926ad-caa3-48c2-9044-009bf5a84a09 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:55.663473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa871ef-ce42-471e-93ae-491d056f44cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:55.664049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa871ef-ce42-471e-93ae-491d056f44cf admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.664321 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa871ef-ce42-471e-93ae-491d056f44cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.664613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa871ef-ce42-471e-93ae-491d056f44cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.665244 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa871ef-ce42-471e-93ae-491d056f44cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:55.666802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa871ef-ce42-471e-93ae-491d056f44cf admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:55.677101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1334/2649] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:55.681217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dc9ca-ded1-410c-8bfb-c361bdf4d231 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:55.691931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dc9ca-ded1-410c-8bfb-c361bdf4d231 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:55.696771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dd776-8b0f-4423-9295-dc4160848ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:55.697453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dd776-8b0f-4423-9295-dc4160848ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.697666 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dd776-8b0f-4423-9295-dc4160848ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.697940 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dd776-8b0f-4423-9295-dc4160848ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.698578 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579dd776-8b0f-4423-9295-dc4160848ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:55.700267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579dd776-8b0f-4423-9295-dc4160848ac8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:55.712661 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1316/2650] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:41:55.717805 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa871ef-ce42-471e-93ae-491d056f44cf admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:55.728690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa871ef-ce42-471e-93ae-491d056f44cf admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:55.733824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1818cc1-22a5-4317-abca-f1a421245a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:55.734507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1818cc1-22a5-4317-abca-f1a421245a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.734779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1818cc1-22a5-4317-abca-f1a421245a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.735069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1818cc1-22a5-4317-abca-f1a421245a0b admin admin] PATH_INFO: `/v3/projects/212249e6db03409594061ed59abddc6b/users/4d82178581034cf8b22c49761f4333bb/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.750197 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1818cc1-22a5-4317-abca-f1a421245a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=212249e6db03409594061ed59abddc6b, user_id=4d82178581034cf8b22c49761f4333bb, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:55.753561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1818cc1-22a5-4317-abca-f1a421245a0b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:55.767430 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1335/2651] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:55 2022] PUT /identity/v3/projects/212249e6db03409594061ed59abddc6b/users/4d82178581034cf8b22c49761f4333bb/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:41:55.773433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e98229-23a4-4310-84a0-a7b448c1b78d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.773795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e98229-23a4-4310-84a0-a7b448c1b78d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.774148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e98229-23a4-4310-84a0-a7b448c1b78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.797973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c1e98229-23a4-4310-84a0-a7b448c1b78d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:55.799454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c1e98229-23a4-4310-84a0-a7b448c1b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:55.863017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1317/2652] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:55.873034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1818cc1-22a5-4317-abca-f1a421245a0b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:55.875029 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a1818cc1-22a5-4317-abca-f1a421245a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:55.930754 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1818cc1-22a5-4317-abca-f1a421245a0b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:55.934729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b3af5-06f8-4589-81a3-fb85c8d3675a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:55.935372 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b3af5-06f8-4589-81a3-fb85c8d3675a service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:55.935643 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b3af5-06f8-4589-81a3-fb85c8d3675a service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:55.935906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b3af5-06f8-4589-81a3-fb85c8d3675a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:55.945446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b3af5-06f8-4589-81a3-fb85c8d3675a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:55.947601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b3af5-06f8-4589-81a3-fb85c8d3675a service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:55.957934 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1336/2653] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:56.588598 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce11040-d1a6-49d8-88cb-31b58e960818 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:56.589131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce11040-d1a6-49d8-88cb-31b58e960818 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:56.589229 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce11040-d1a6-49d8-88cb-31b58e960818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:56.617612 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7ce11040-d1a6-49d8-88cb-31b58e960818 None None] MFA Rules not processed for user `4d82178581034cf8b22c49761f4333bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:56.618840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7ce11040-d1a6-49d8-88cb-31b58e960818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:56.645411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:56.687835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1318/2654] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:56.692511 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b3af5-06f8-4589-81a3-fb85c8d3675a service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:56.702209 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b3af5-06f8-4589-81a3-fb85c8d3675a service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:56.706765 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47addd9b-daee-465c-98eb-a576327f29e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:56.707413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47addd9b-daee-465c-98eb-a576327f29e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:56.707670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47addd9b-daee-465c-98eb-a576327f29e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:56.707945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47addd9b-daee-465c-98eb-a576327f29e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:56.708548 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47addd9b-daee-465c-98eb-a576327f29e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:56.710448 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47addd9b-daee-465c-98eb-a576327f29e8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:56.715998 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:56.743106 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1337/2655] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:41:56 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:41:56.747109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce11040-d1a6-49d8-88cb-31b58e960818 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:56.757798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce11040-d1a6-49d8-88cb-31b58e960818 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:56.813430 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700e314-add9-44d3-969f-a7514fbb7cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:56.814022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700e314-add9-44d3-969f-a7514fbb7cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:56.814296 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700e314-add9-44d3-969f-a7514fbb7cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:56.814560 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700e314-add9-44d3-969f-a7514fbb7cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:56.815235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700e314-add9-44d3-969f-a7514fbb7cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:56.817161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700e314-add9-44d3-969f-a7514fbb7cb0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:56.839546 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1319/2656] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:41:56 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:41:56.843800 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47addd9b-daee-465c-98eb-a576327f29e8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:56.854951 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47addd9b-daee-465c-98eb-a576327f29e8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:56.859525 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbaca5-0ea5-49ad-bd34-8f9430eae93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:56.860111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbaca5-0ea5-49ad-bd34-8f9430eae93e admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:56.860384 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbaca5-0ea5-49ad-bd34-8f9430eae93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:56.860650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbaca5-0ea5-49ad-bd34-8f9430eae93e admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:56.861282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbaca5-0ea5-49ad-bd34-8f9430eae93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:56.865909 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbaca5-0ea5-49ad-bd34-8f9430eae93e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:56.877003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1338/2657] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:56.881160 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700e314-add9-44d3-969f-a7514fbb7cb0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:56.891431 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700e314-add9-44d3-969f-a7514fbb7cb0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:56.897450 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965990b6-1bf6-42dc-9bda-fed1f60ef7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:56.898101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965990b6-1bf6-42dc-9bda-fed1f60ef7e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:56.898381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965990b6-1bf6-42dc-9bda-fed1f60ef7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:56.899260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965990b6-1bf6-42dc-9bda-fed1f60ef7e6 admin admin] PATH_INFO: `/v3/projects/6695c78da05d4d36a7ab37175052ae3a/users/cc39d785aeb34dc7a38e945dab273934/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:56.915996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965990b6-1bf6-42dc-9bda-fed1f60ef7e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6695c78da05d4d36a7ab37175052ae3a, user_id=cc39d785aeb34dc7a38e945dab273934, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:56.918822 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965990b6-1bf6-42dc-9bda-fed1f60ef7e6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:56.934115 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1320/2658] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:56 2022] PUT /identity/v3/projects/6695c78da05d4d36a7ab37175052ae3a/users/cc39d785aeb34dc7a38e945dab273934/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:56.938060 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbaca5-0ea5-49ad-bd34-8f9430eae93e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:56.948693 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbaca5-0ea5-49ad-bd34-8f9430eae93e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:57.010937 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc2edc-7dac-4ea3-aa21-9111eb81aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:57.011557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc2edc-7dac-4ea3-aa21-9111eb81aeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:57.011828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc2edc-7dac-4ea3-aa21-9111eb81aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:57.012094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc2edc-7dac-4ea3-aa21-9111eb81aeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:57.012718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc2edc-7dac-4ea3-aa21-9111eb81aeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:57.014271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc2edc-7dac-4ea3-aa21-9111eb81aeb8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:57.024089 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1339/2659] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:41:57.028538 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965990b6-1bf6-42dc-9bda-fed1f60ef7e6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:57.039674 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965990b6-1bf6-42dc-9bda-fed1f60ef7e6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:57.044318 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178717a-a787-42bd-ae5d-cdbd572d00ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:57.044961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178717a-a787-42bd-ae5d-cdbd572d00ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:57.045255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178717a-a787-42bd-ae5d-cdbd572d00ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:57.045531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178717a-a787-42bd-ae5d-cdbd572d00ab admin admin] PATH_INFO: `/v3/projects/6695c78da05d4d36a7ab37175052ae3a/users/cc39d785aeb34dc7a38e945dab273934/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:57.047517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178717a-a787-42bd-ae5d-cdbd572d00ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6695c78da05d4d36a7ab37175052ae3a, user_id=cc39d785aeb34dc7a38e945dab273934, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:57.050150 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178717a-a787-42bd-ae5d-cdbd572d00ab admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:57.060573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1321/2660] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:41:57 2022] PUT /identity/v3/projects/6695c78da05d4d36a7ab37175052ae3a/users/cc39d785aeb34dc7a38e945dab273934/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:57.725235 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a753fce-2050-43b0-bbcf-445c2546947f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:57.725750 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a753fce-2050-43b0-bbcf-445c2546947f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:57.726107 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a753fce-2050-43b0-bbcf-445c2546947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:57.754010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5a753fce-2050-43b0-bbcf-445c2546947f None None] MFA Rules not processed for user `cc39d785aeb34dc7a38e945dab273934`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:57.755254 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5a753fce-2050-43b0-bbcf-445c2546947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:57.827043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1340/2661] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:57.839533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa89f-6e78-4553-bb6e-6d4ec4dad8b2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:57.840019 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa89f-6e78-4553-bb6e-6d4ec4dad8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:57.840132 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa89f-6e78-4553-bb6e-6d4ec4dad8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:57.860543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-066aa89f-6e78-4553-bb6e-6d4ec4dad8b2 None None] MFA Rules not processed for user `4d82178581034cf8b22c49761f4333bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:57.861674 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-066aa89f-6e78-4553-bb6e-6d4ec4dad8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:57.922217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1322/2662] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:57.935843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a753fce-2050-43b0-bbcf-445c2546947f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:57.937628 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5a753fce-2050-43b0-bbcf-445c2546947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:58.011140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:58.035756 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a753fce-2050-43b0-bbcf-445c2546947f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:58.046662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7baa5-c86e-4611-9b91-2c0cda1f0040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:58.047303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7baa5-c86e-4611-9b91-2c0cda1f0040 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:58.047585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7baa5-c86e-4611-9b91-2c0cda1f0040 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:58.047848 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7baa5-c86e-4611-9b91-2c0cda1f0040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:58.058413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7baa5-c86e-4611-9b91-2c0cda1f0040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:58.060195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7baa5-c86e-4611-9b91-2c0cda1f0040 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:58.074942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1341/2663] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:41:59.154711 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aa89f-6e78-4553-bb6e-6d4ec4dad8b2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:59.156161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-066aa89f-6e78-4553-bb6e-6d4ec4dad8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:59.188590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:59.232917 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aa89f-6e78-4553-bb6e-6d4ec4dad8b2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:59.239868 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92913e-6ae6-4352-9d46-346b307ef23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:59.240491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92913e-6ae6-4352-9d46-346b307ef23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:59.240763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92913e-6ae6-4352-9d46-346b307ef23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:59.241029 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92913e-6ae6-4352-9d46-346b307ef23f admin admin] PATH_INFO: `/v3/users/0807997d949a40949ac1c9aa9ad9551a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:59.242141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92913e-6ae6-4352-9d46-346b307ef23f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0807997d949a40949ac1c9aa9ad9551a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:59.244083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92913e-6ae6-4352-9d46-346b307ef23f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:59.281211 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b1e69-5a03-45e8-bd50-35be6821cea1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:59.281769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b1e69-5a03-45e8-bd50-35be6821cea1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:59.281997 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b1e69-5a03-45e8-bd50-35be6821cea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:59.304891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-343b1e69-5a03-45e8-bd50-35be6821cea1 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:59.306205 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-343b1e69-5a03-45e8-bd50-35be6821cea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:59.312996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb92913e-6ae6-4352-9d46-346b307ef23f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0807997d949a40949ac1c9aa9ad9551a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:59.317041 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1342/2664] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 7 22:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:41:59.327588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb92913e-6ae6-4352-9d46-346b307ef23f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0807997d949a40949ac1c9aa9ad9551a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:59.328213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb92913e-6ae6-4352-9d46-346b307ef23f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0807997d949a40949ac1c9aa9ad9551a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:59.328862 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb92913e-6ae6-4352-9d46-346b307ef23f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0807997d949a40949ac1c9aa9ad9551a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:59.339251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b1e69-5a03-45e8-bd50-35be6821cea1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:59.353042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b1e69-5a03-45e8-bd50-35be6821cea1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:59.354133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb92913e-6ae6-4352-9d46-346b307ef23f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0807997d949a40949ac1c9aa9ad9551a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:41:59.366494 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57ac6-0f46-43c0-b418-9100ebd9bb71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:59.367547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57ac6-0f46-43c0-b418-9100ebd9bb71 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:59.367853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57ac6-0f46-43c0-b418-9100ebd9bb71 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:59.368140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57ac6-0f46-43c0-b418-9100ebd9bb71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:59.370877 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-70f57ac6-0f46-43c0-b418-9100ebd9bb71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:59.374286 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1323/2665] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:41:59 2022] DELETE /identity/v3/users/0807997d949a40949ac1c9aa9ad9551a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:41:59.380636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cb73a-4ef9-4560-9a95-4735a537bdab None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:59.380923 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cb73a-4ef9-4560-9a95-4735a537bdab None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:59.381199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cb73a-4ef9-4560-9a95-4735a537bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:59.396306 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f57ac6-0f46-43c0-b418-9100ebd9bb71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:59.397883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f57ac6-0f46-43c0-b418-9100ebd9bb71 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:59.400000 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7c8cb73a-4ef9-4560-9a95-4735a537bdab None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:41:59.401204 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7c8cb73a-4ef9-4560-9a95-4735a537bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:59.407834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1343/2666] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:41:59.466825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1324/2667] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:41:59.477855 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57ac6-0f46-43c0-b418-9100ebd9bb71 service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:41:59.479299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-70f57ac6-0f46-43c0-b418-9100ebd9bb71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:41:59.539094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57ac6-0f46-43c0-b418-9100ebd9bb71 service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:41:59.608815 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed881c4-648c-44ab-87e6-0839939d8f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:41:59.609407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed881c4-648c-44ab-87e6-0839939d8f11 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:41:59.611701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed881c4-648c-44ab-87e6-0839939d8f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:41:59.611701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed881c4-648c-44ab-87e6-0839939d8f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:41:59.622285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed881c4-648c-44ab-87e6-0839939d8f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:41:59.624006 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed881c4-648c-44ab-87e6-0839939d8f11 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:41:59.646723 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1344/2668] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:00.025378 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cb73a-4ef9-4560-9a95-4735a537bdab None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:00.027247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7c8cb73a-4ef9-4560-9a95-4735a537bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:00.046284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cb73a-4ef9-4560-9a95-4735a537bdab None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:00.051763 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:00.052337 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:00.052618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:00.052890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] PATH_INFO: `/v3/projects/3ca0b357f8ca45fda8f4558b0a43cea6` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:00.054022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca0b357f8ca45fda8f4558b0a43cea6)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:00.055972 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:00.095788 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:00.105304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca0b357f8ca45fda8f4558b0a43cea6', 'request_id': 'req-909de2bf-373a-42d1-880b-d6314602110f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.111015 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca0b357f8ca45fda8f4558b0a43cea6', 'request_id': 'req-909de2bf-373a-42d1-880b-d6314602110f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.117547 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca0b357f8ca45fda8f4558b0a43cea6', 'request_id': 'req-909de2bf-373a-42d1-880b-d6314602110f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.130022 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] The token cache is being invalidate because project 3ca0b357f8ca45fda8f4558b0a43cea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:00.130305 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.130914 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.132433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1325/2669] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:00 2022] DELETE /identity/v3/projects/3ca0b357f8ca45fda8f4558b0a43cea6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:00.136426 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed881c4-648c-44ab-87e6-0839939d8f11 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:00.145993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed881c4-648c-44ab-87e6-0839939d8f11 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:00.201534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bf4a3-e833-4d70-be93-bb0733101206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:00.202181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bf4a3-e833-4d70-be93-bb0733101206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:00.202457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bf4a3-e833-4d70-be93-bb0733101206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:00.202725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bf4a3-e833-4d70-be93-bb0733101206 admin admin] PATH_INFO: `/v3/users/70171acfd26f493db2ef60503e2e5806` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:00.203893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bf4a3-e833-4d70-be93-bb0733101206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70171acfd26f493db2ef60503e2e5806)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:00.205825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bf4a3-e833-4d70-be93-bb0733101206 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:00.228399 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:00.250971 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ca8bf4a3-e833-4d70-be93-bb0733101206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70171acfd26f493db2ef60503e2e5806'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.257596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ca8bf4a3-e833-4d70-be93-bb0733101206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70171acfd26f493db2ef60503e2e5806'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.265733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ca8bf4a3-e833-4d70-be93-bb0733101206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70171acfd26f493db2ef60503e2e5806'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.266333 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ca8bf4a3-e833-4d70-be93-bb0733101206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70171acfd26f493db2ef60503e2e5806'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.279496 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ca8bf4a3-e833-4d70-be93-bb0733101206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70171acfd26f493db2ef60503e2e5806'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.286550 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1345/2670] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:00 2022] DELETE /identity/v3/users/70171acfd26f493db2ef60503e2e5806 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:00.582661 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:00.584154 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:00.598392 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909de2bf-373a-42d1-880b-d6314602110f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:00.667306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8e8a1-ce1b-4842-af60-df688432f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:00.668271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8e8a1-ce1b-4842-af60-df688432f146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:00.669335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8e8a1-ce1b-4842-af60-df688432f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:00.669958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8e8a1-ce1b-4842-af60-df688432f146 admin admin] PATH_INFO: `/v3/projects/c56de0c31e52415fa55639594aea8896` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:00.671474 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8e8a1-ce1b-4842-af60-df688432f146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56de0c31e52415fa55639594aea8896)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:00.673581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8e8a1-ce1b-4842-af60-df688432f146 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:00.740447 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-41d8e8a1-ce1b-4842-af60-df688432f146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56de0c31e52415fa55639594aea8896', 'request_id': 'req-41d8e8a1-ce1b-4842-af60-df688432f146'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.745982 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-41d8e8a1-ce1b-4842-af60-df688432f146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56de0c31e52415fa55639594aea8896', 'request_id': 'req-41d8e8a1-ce1b-4842-af60-df688432f146'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.752421 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-41d8e8a1-ce1b-4842-af60-df688432f146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56de0c31e52415fa55639594aea8896', 'request_id': 'req-41d8e8a1-ce1b-4842-af60-df688432f146'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.765552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-41d8e8a1-ce1b-4842-af60-df688432f146 admin admin] The token cache is being invalidate because project c56de0c31e52415fa55639594aea8896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:00.765841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-41d8e8a1-ce1b-4842-af60-df688432f146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.766487 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-41d8e8a1-ce1b-4842-af60-df688432f146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:00.768042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1326/2671] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:00 2022] DELETE /identity/v3/projects/c56de0c31e52415fa55639594aea8896 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:00.774662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a4eb-7a34-41e7-8cdb-f4ff8dd17b03 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:00.774967 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a4eb-7a34-41e7-8cdb-f4ff8dd17b03 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:00.775278 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a4eb-7a34-41e7-8cdb-f4ff8dd17b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:00.797713 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e4f9a4eb-7a34-41e7-8cdb-f4ff8dd17b03 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:00.798930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e4f9a4eb-7a34-41e7-8cdb-f4ff8dd17b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:00.874405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1346/2672] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:00.883727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a7f90-10b7-4072-8ab5-2f7bbd64134f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:00.884006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a7f90-10b7-4072-8ab5-2f7bbd64134f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:00.884277 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a7f90-10b7-4072-8ab5-2f7bbd64134f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:00.906319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f96a7f90-10b7-4072-8ab5-2f7bbd64134f None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:00.907615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f96a7f90-10b7-4072-8ab5-2f7bbd64134f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:00.916377 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1327/2673] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:00.922864 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a4eb-7a34-41e7-8cdb-f4ff8dd17b03 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:00.934144 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a4eb-7a34-41e7-8cdb-f4ff8dd17b03 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:00.938895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737b9be-a778-4bc8-826d-1f2c97a20fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:00.939606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737b9be-a778-4bc8-826d-1f2c97a20fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:00.939949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737b9be-a778-4bc8-826d-1f2c97a20fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:00.940803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737b9be-a778-4bc8-826d-1f2c97a20fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:00.941523 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737b9be-a778-4bc8-826d-1f2c97a20fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:42:00.941915 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737b9be-a778-4bc8-826d-1f2c97a20fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:00.943719 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737b9be-a778-4bc8-826d-1f2c97a20fc9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:00.957305 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1347/2674] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:42:00.961915 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a7f90-10b7-4072-8ab5-2f7bbd64134f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:00.971653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a7f90-10b7-4072-8ab5-2f7bbd64134f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:00.976497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf2e72-1ec1-4ccf-9f61-8f062996c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:00.977158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf2e72-1ec1-4ccf-9f61-8f062996c38f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:00.977418 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf2e72-1ec1-4ccf-9f61-8f062996c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:00.977687 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf2e72-1ec1-4ccf-9f61-8f062996c38f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:00.978353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf2e72-1ec1-4ccf-9f61-8f062996c38f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:00.980307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf2e72-1ec1-4ccf-9f61-8f062996c38f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:01.013573 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1328/2675] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:42:00 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:42:01.014803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737b9be-a778-4bc8-826d-1f2c97a20fc9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:01.025656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737b9be-a778-4bc8-826d-1f2c97a20fc9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:01.093355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013ae6-61af-4da7-a7d9-c0f03afa8a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:01.093962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013ae6-61af-4da7-a7d9-c0f03afa8a7b admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:01.094234 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013ae6-61af-4da7-a7d9-c0f03afa8a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:01.094499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013ae6-61af-4da7-a7d9-c0f03afa8a7b admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:01.095138 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed013ae6-61af-4da7-a7d9-c0f03afa8a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:01.097062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed013ae6-61af-4da7-a7d9-c0f03afa8a7b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:01.118688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1348/2676] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:42:01 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:01.122873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf2e72-1ec1-4ccf-9f61-8f062996c38f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:01.133953 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf2e72-1ec1-4ccf-9f61-8f062996c38f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:01.138583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c32653-1e90-4757-8898-b1c5b41d07a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:01.139221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c32653-1e90-4757-8898-b1c5b41d07a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:01.139505 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c32653-1e90-4757-8898-b1c5b41d07a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:01.139777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c32653-1e90-4757-8898-b1c5b41d07a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:01.140428 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c32653-1e90-4757-8898-b1c5b41d07a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:01.142014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c32653-1e90-4757-8898-b1c5b41d07a7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:01.153010 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1329/2677] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:01.156596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013ae6-61af-4da7-a7d9-c0f03afa8a7b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:01.167545 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013ae6-61af-4da7-a7d9-c0f03afa8a7b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:01.172441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472947c-20ca-467d-9ada-1ff9c038442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:01.173037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472947c-20ca-467d-9ada-1ff9c038442a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:01.173313 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472947c-20ca-467d-9ada-1ff9c038442a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:01.173582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472947c-20ca-467d-9ada-1ff9c038442a admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:01.174230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472947c-20ca-467d-9ada-1ff9c038442a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:01.175846 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472947c-20ca-467d-9ada-1ff9c038442a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:01.187355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1349/2678] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:01.192830 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c32653-1e90-4757-8898-b1c5b41d07a7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:01.203627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c32653-1e90-4757-8898-b1c5b41d07a7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:01.209611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d8e4f-86bc-4240-bbfb-24e6a9e05fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:01.210475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d8e4f-86bc-4240-bbfb-24e6a9e05fea admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:01.210761 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d8e4f-86bc-4240-bbfb-24e6a9e05fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:01.211276 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d8e4f-86bc-4240-bbfb-24e6a9e05fea admin admin] PATH_INFO: `/v3/projects/510a73e489024490940d96b25d9c1115/users/1605a48bbf08444fabcfcab74636b77f/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:01.227453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d8e4f-86bc-4240-bbfb-24e6a9e05fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=510a73e489024490940d96b25d9c1115, user_id=1605a48bbf08444fabcfcab74636b77f, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:01.230109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d8e4f-86bc-4240-bbfb-24e6a9e05fea admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:01.232358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:01.246680 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1330/2679] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:01 2022] PUT /identity/v3/projects/510a73e489024490940d96b25d9c1115/users/1605a48bbf08444fabcfcab74636b77f/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:01.258555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf88975-ab03-40d3-9849-81d306e0eaca None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:01.258771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf88975-ab03-40d3-9849-81d306e0eaca None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:01.259042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf88975-ab03-40d3-9849-81d306e0eaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:01.273110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:01.290825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2bf88975-ab03-40d3-9849-81d306e0eaca None None] MFA Rules not processed for user `1605a48bbf08444fabcfcab74636b77f`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:01.292083 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2bf88975-ab03-40d3-9849-81d306e0eaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:01.360018 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1350/2680] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:01.374191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d8e4f-86bc-4240-bbfb-24e6a9e05fea admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:01.376909 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ff3d8e4f-86bc-4240-bbfb-24e6a9e05fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:01.439077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d8e4f-86bc-4240-bbfb-24e6a9e05fea admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:01.443651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b8952-00dd-4b4b-a8e3-407b9ff46782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:01.444260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b8952-00dd-4b4b-a8e3-407b9ff46782 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:01.444541 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b8952-00dd-4b4b-a8e3-407b9ff46782 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:01.444813 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b8952-00dd-4b4b-a8e3-407b9ff46782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:01.453359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b8952-00dd-4b4b-a8e3-407b9ff46782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:01.454791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b8952-00dd-4b4b-a8e3-407b9ff46782 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:01.463780 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1331/2681] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:01.490092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf88975-ab03-40d3-9849-81d306e0eaca None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:01.562808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf88975-ab03-40d3-9849-81d306e0eaca None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:01.568267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:01.568898 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:01.569177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:01.569448 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] PATH_INFO: `/v3/users/1605a48bbf08444fabcfcab74636b77f` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:01.570580 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1605a48bbf08444fabcfcab74636b77f)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:01.572710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:01.626543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1605a48bbf08444fabcfcab74636b77f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:01.634712 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1605a48bbf08444fabcfcab74636b77f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:01.643561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1605a48bbf08444fabcfcab74636b77f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:01.644274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1605a48bbf08444fabcfcab74636b77f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:01.661943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1605a48bbf08444fabcfcab74636b77f'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:01.669038 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1351/2682] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:01 2022] DELETE /identity/v3/users/1605a48bbf08444fabcfcab74636b77f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:01.673558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458f5ed-a3ac-4f17-90f3-c2d97f101272 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:01.674025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458f5ed-a3ac-4f17-90f3-c2d97f101272 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:01.674126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458f5ed-a3ac-4f17-90f3-c2d97f101272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:01.693706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f458f5ed-a3ac-4f17-90f3-c2d97f101272 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:01.694893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f458f5ed-a3ac-4f17-90f3-c2d97f101272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:01.756840 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1332/2683] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:01.766381 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:01.767729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:01.787151 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:01.830055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cf86e-983f-4e36-a701-a701006e90b7 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:01.833842 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2391-3770-4405-b1b2-83867e598736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:01.834445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2391-3770-4405-b1b2-83867e598736 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:01.834717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2391-3770-4405-b1b2-83867e598736 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:01.834988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2391-3770-4405-b1b2-83867e598736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:01.844502 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2391-3770-4405-b1b2-83867e598736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:01.845913 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2391-3770-4405-b1b2-83867e598736 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:01.855638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1352/2684] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:02.127664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458f5ed-a3ac-4f17-90f3-c2d97f101272 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:02.129111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f458f5ed-a3ac-4f17-90f3-c2d97f101272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:02.162594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458f5ed-a3ac-4f17-90f3-c2d97f101272 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:02.168774 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:02.169419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:02.169695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:02.169962 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8 admin admin] PATH_INFO: `/v3/projects/510a73e489024490940d96b25d9c1115` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:02.171278 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510a73e489024490940d96b25d9c1115)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:02.173178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:02.224637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510a73e489024490940d96b25d9c1115', 'request_id': 'req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:02.230146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510a73e489024490940d96b25d9c1115', 'request_id': 'req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:02.236511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510a73e489024490940d96b25d9c1115', 'request_id': 'req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:02.248827 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8 admin admin] The token cache is being invalidate because project 510a73e489024490940d96b25d9c1115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:02.249109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:02.249720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-000fe5a8-fa10-4c6b-8210-fd9d3ca084d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:02.251848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1333/2685] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:02 2022] DELETE /identity/v3/projects/510a73e489024490940d96b25d9c1115 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:02.256546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb283-16e2-4d00-932a-7227f8328d42 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:02.256821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb283-16e2-4d00-932a-7227f8328d42 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:02.257152 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb283-16e2-4d00-932a-7227f8328d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:02.278567 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-828bb283-16e2-4d00-932a-7227f8328d42 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:02.279949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-828bb283-16e2-4d00-932a-7227f8328d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:02.348381 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1353/2686] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:02.351429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef2108-816a-4f2c-a615-db2f856d8164 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:02.351839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef2108-816a-4f2c-a615-db2f856d8164 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:02.352187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef2108-816a-4f2c-a615-db2f856d8164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:02.371987 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dbef2108-816a-4f2c-a615-db2f856d8164 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:02.373235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dbef2108-816a-4f2c-a615-db2f856d8164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:02.381693 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1334/2687] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:02.386260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bb283-16e2-4d00-932a-7227f8328d42 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:02.397309 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bb283-16e2-4d00-932a-7227f8328d42 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:02.401990 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e40ee4-fcce-4d2a-b0bc-deb4fab4bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:02.402607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e40ee4-fcce-4d2a-b0bc-deb4fab4bcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:02.402886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e40ee4-fcce-4d2a-b0bc-deb4fab4bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:02.403189 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e40ee4-fcce-4d2a-b0bc-deb4fab4bcb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:02.403833 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e40ee4-fcce-4d2a-b0bc-deb4fab4bcb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:42:02.404133 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e40ee4-fcce-4d2a-b0bc-deb4fab4bcb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:02.405702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e40ee4-fcce-4d2a-b0bc-deb4fab4bcb4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:02.418062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1354/2688] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:42:02.422427 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef2108-816a-4f2c-a615-db2f856d8164 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:02.431714 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef2108-816a-4f2c-a615-db2f856d8164 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:02.436463 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532327da-e43f-4e45-81eb-5d6f7e47c1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:02.437126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532327da-e43f-4e45-81eb-5d6f7e47c1cb admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:02.437542 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532327da-e43f-4e45-81eb-5d6f7e47c1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:02.437870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532327da-e43f-4e45-81eb-5d6f7e47c1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:02.438558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532327da-e43f-4e45-81eb-5d6f7e47c1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:02.441216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532327da-e43f-4e45-81eb-5d6f7e47c1cb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:02.454334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:02.476003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1335/2689] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:42:02 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:02.477169 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e40ee4-fcce-4d2a-b0bc-deb4fab4bcb4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:02.488589 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e40ee4-fcce-4d2a-b0bc-deb4fab4bcb4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:02.545540 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da9437-8823-44bf-b16b-456058745233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:02.546160 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da9437-8823-44bf-b16b-456058745233 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:02.546547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da9437-8823-44bf-b16b-456058745233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:02.546818 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da9437-8823-44bf-b16b-456058745233 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:02.547485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da9437-8823-44bf-b16b-456058745233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:02.549378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da9437-8823-44bf-b16b-456058745233 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:02.571678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1355/2690] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:42:02 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:02.576078 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532327da-e43f-4e45-81eb-5d6f7e47c1cb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:02.588096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532327da-e43f-4e45-81eb-5d6f7e47c1cb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:02.593082 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925267a1-a750-4e49-9ef8-0f9c028badc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:02.593902 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925267a1-a750-4e49-9ef8-0f9c028badc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:02.594233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925267a1-a750-4e49-9ef8-0f9c028badc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:02.594690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925267a1-a750-4e49-9ef8-0f9c028badc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:02.595485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925267a1-a750-4e49-9ef8-0f9c028badc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:02.597216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925267a1-a750-4e49-9ef8-0f9c028badc3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:02.608420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1336/2691] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:02.612627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da9437-8823-44bf-b16b-456058745233 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:02.623603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da9437-8823-44bf-b16b-456058745233 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:02.628776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb87a6-fb1e-4e98-992b-f5288de3cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:02.629395 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb87a6-fb1e-4e98-992b-f5288de3cd40 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:02.629672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb87a6-fb1e-4e98-992b-f5288de3cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:02.629943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb87a6-fb1e-4e98-992b-f5288de3cd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:02.630718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb87a6-fb1e-4e98-992b-f5288de3cd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:02.632445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb87a6-fb1e-4e98-992b-f5288de3cd40 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:02.644386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1356/2692] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:02.649461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925267a1-a750-4e49-9ef8-0f9c028badc3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:02.660003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925267a1-a750-4e49-9ef8-0f9c028badc3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:02.665146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03041322-49f7-498c-b3f0-32451bac9e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:02.665855 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03041322-49f7-498c-b3f0-32451bac9e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:02.666135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03041322-49f7-498c-b3f0-32451bac9e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:02.667025 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03041322-49f7-498c-b3f0-32451bac9e74 admin admin] PATH_INFO: `/v3/projects/a1f8c8b7ea8e4d0ca9242db68f605b77/users/a0e2f4c0cf3448ea8db6f8dc08081502/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:02.682468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03041322-49f7-498c-b3f0-32451bac9e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f8c8b7ea8e4d0ca9242db68f605b77, user_id=a0e2f4c0cf3448ea8db6f8dc08081502, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:02.685331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03041322-49f7-498c-b3f0-32451bac9e74 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:02.699969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1337/2693] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:02 2022] PUT /identity/v3/projects/a1f8c8b7ea8e4d0ca9242db68f605b77/users/a0e2f4c0cf3448ea8db6f8dc08081502/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:42:02.711141 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0241270-a06b-40e4-8b79-475985e32a09 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:02.711444 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0241270-a06b-40e4-8b79-475985e32a09 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:02.711961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0241270-a06b-40e4-8b79-475985e32a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:02.741662 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f0241270-a06b-40e4-8b79-475985e32a09 None None] MFA Rules not processed for user `a0e2f4c0cf3448ea8db6f8dc08081502`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:02.742886 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f0241270-a06b-40e4-8b79-475985e32a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:02.756236 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:02.816958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1357/2694] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:02.831841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03041322-49f7-498c-b3f0-32451bac9e74 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:02.833773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-03041322-49f7-498c-b3f0-32451bac9e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:02.894361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03041322-49f7-498c-b3f0-32451bac9e74 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:02.898007 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8a053-dbd8-400a-a2d3-fed2da543436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:02.898605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8a053-dbd8-400a-a2d3-fed2da543436 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:02.898878 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8a053-dbd8-400a-a2d3-fed2da543436 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:02.899241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8a053-dbd8-400a-a2d3-fed2da543436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:02.907595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8a053-dbd8-400a-a2d3-fed2da543436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:02.909294 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8a053-dbd8-400a-a2d3-fed2da543436 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:02.918623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1338/2695] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:02.941170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0241270-a06b-40e4-8b79-475985e32a09 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:03.005751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0241270-a06b-40e4-8b79-475985e32a09 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:03.010373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:03.011477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:03.011924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:03.012204 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] PATH_INFO: `/v3/users/a0e2f4c0cf3448ea8db6f8dc08081502` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:03.013390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e2f4c0cf3448ea8db6f8dc08081502)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:03.015745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:03.071669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e2f4c0cf3448ea8db6f8dc08081502'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:03.079582 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e2f4c0cf3448ea8db6f8dc08081502'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:03.092331 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e2f4c0cf3448ea8db6f8dc08081502'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:03.093198 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e2f4c0cf3448ea8db6f8dc08081502'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:03.110125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e2f4c0cf3448ea8db6f8dc08081502'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:03.116647 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1358/2696] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:02 2022] DELETE /identity/v3/users/a0e2f4c0cf3448ea8db6f8dc08081502 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:03.121178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d3a6b-ddb1-4b7a-af21-22ba15b2a3e7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:03.121570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d3a6b-ddb1-4b7a-af21-22ba15b2a3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:03.121909 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d3a6b-ddb1-4b7a-af21-22ba15b2a3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:03.141638 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e37d3a6b-ddb1-4b7a-af21-22ba15b2a3e7 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:03.142920 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e37d3a6b-ddb1-4b7a-af21-22ba15b2a3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:03.202275 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1339/2697] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:03.211989 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:03.213417 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:03.250981 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:03.278781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc23a4-4927-41a0-8d34-8dc2975da95d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:03.282470 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32e2b8-342e-4c00-8514-3ee03e12c325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:03.283068 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32e2b8-342e-4c00-8514-3ee03e12c325 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:03.283377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32e2b8-342e-4c00-8514-3ee03e12c325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:03.283648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32e2b8-342e-4c00-8514-3ee03e12c325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:03.293315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32e2b8-342e-4c00-8514-3ee03e12c325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:03.294732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32e2b8-342e-4c00-8514-3ee03e12c325 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:03.304734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1359/2698] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:03.514408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fa03b-6c08-4f5e-b84b-2a7f8fa335cd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:03.514744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fa03b-6c08-4f5e-b84b-2a7f8fa335cd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:03.515034 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fa03b-6c08-4f5e-b84b-2a7f8fa335cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:03.537743 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-515fa03b-6c08-4f5e-b84b-2a7f8fa335cd None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:03.539055 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-515fa03b-6c08-4f5e-b84b-2a7f8fa335cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:03.548335 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1340/2699] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 7 22:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:03.571752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32e2b8-342e-4c00-8514-3ee03e12c325 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:03.573268 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8b32e2b8-342e-4c00-8514-3ee03e12c325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:03.635462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fa03b-6c08-4f5e-b84b-2a7f8fa335cd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:03.637435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-515fa03b-6c08-4f5e-b84b-2a7f8fa335cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:03.657643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fa03b-6c08-4f5e-b84b-2a7f8fa335cd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:03.672411 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:03.673040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:03.673313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:03.673584 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece admin admin] PATH_INFO: `/v3/projects/a1f8c8b7ea8e4d0ca9242db68f605b77` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:03.674748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f8c8b7ea8e4d0ca9242db68f605b77)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:03.676768 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:03.681191 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32e2b8-342e-4c00-8514-3ee03e12c325 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:03.691825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815eca6-fdf0-4dab-84fa-f03c9a54942c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:03.692431 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815eca6-fdf0-4dab-84fa-f03c9a54942c service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:03.692709 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815eca6-fdf0-4dab-84fa-f03c9a54942c service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:03.692979 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815eca6-fdf0-4dab-84fa-f03c9a54942c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:03.701743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815eca6-fdf0-4dab-84fa-f03c9a54942c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:03.703409 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815eca6-fdf0-4dab-84fa-f03c9a54942c service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:03.714030 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1360/2700] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:03.734933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:03.736548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f8c8b7ea8e4d0ca9242db68f605b77', 'request_id': 'req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:03.743316 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f8c8b7ea8e4d0ca9242db68f605b77', 'request_id': 'req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:03.750146 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f8c8b7ea8e4d0ca9242db68f605b77', 'request_id': 'req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:03.763970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece admin admin] The token cache is being invalidate because project a1f8c8b7ea8e4d0ca9242db68f605b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:03.764260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:03.765003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4f8b42b2-324d-41bc-81ce-4d38d8e85ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:03.767319 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1341/2701] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:03 2022] DELETE /identity/v3/projects/a1f8c8b7ea8e4d0ca9242db68f605b77 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:03.774638 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bed6b1-b287-41ad-a74a-081c0ecb89f4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:03.774918 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bed6b1-b287-41ad-a74a-081c0ecb89f4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:03.775225 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bed6b1-b287-41ad-a74a-081c0ecb89f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:03.797111 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d2bed6b1-b287-41ad-a74a-081c0ecb89f4 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:03.798285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d2bed6b1-b287-41ad-a74a-081c0ecb89f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:03.857801 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1361/2702] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:03.865618 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd4b9-254e-4b74-bd7e-4e1d451ba07e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:03.865899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd4b9-254e-4b74-bd7e-4e1d451ba07e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:03.866164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd4b9-254e-4b74-bd7e-4e1d451ba07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:03.885834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e54fd4b9-254e-4b74-bd7e-4e1d451ba07e None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:03.886938 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e54fd4b9-254e-4b74-bd7e-4e1d451ba07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:03.895307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1342/2703] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:03.899393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bed6b1-b287-41ad-a74a-081c0ecb89f4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:03.908675 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bed6b1-b287-41ad-a74a-081c0ecb89f4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:03.913431 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0da0c-3c47-4df5-a925-108c690a1776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:03.914009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0da0c-3c47-4df5-a925-108c690a1776 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:03.914277 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0da0c-3c47-4df5-a925-108c690a1776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:03.914542 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0da0c-3c47-4df5-a925-108c690a1776 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:03.915199 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0da0c-3c47-4df5-a925-108c690a1776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:42:03.915498 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0da0c-3c47-4df5-a925-108c690a1776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:03.917055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0da0c-3c47-4df5-a925-108c690a1776 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:03.928002 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1362/2704] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:42:03.932136 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fd4b9-254e-4b74-bd7e-4e1d451ba07e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:03.941773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fd4b9-254e-4b74-bd7e-4e1d451ba07e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:03.946382 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d0dbc-9f20-4ffe-9e76-8db36c954656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:03.946961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d0dbc-9f20-4ffe-9e76-8db36c954656 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:03.947272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d0dbc-9f20-4ffe-9e76-8db36c954656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:03.947543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d0dbc-9f20-4ffe-9e76-8db36c954656 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:03.948155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d0dbc-9f20-4ffe-9e76-8db36c954656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:03.950047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d0dbc-9f20-4ffe-9e76-8db36c954656 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:03.979316 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1343/2705] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:42:03 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:03.983355 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0da0c-3c47-4df5-a925-108c690a1776 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:03.994785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0da0c-3c47-4df5-a925-108c690a1776 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:04.038315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:04.050860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca4e4b-d569-4c48-8b5c-a0ed004c82d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:04.051488 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca4e4b-d569-4c48-8b5c-a0ed004c82d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:04.051764 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca4e4b-d569-4c48-8b5c-a0ed004c82d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:04.052033 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca4e4b-d569-4c48-8b5c-a0ed004c82d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:04.052652 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca4e4b-d569-4c48-8b5c-a0ed004c82d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:04.054667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca4e4b-d569-4c48-8b5c-a0ed004c82d1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:04.076287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1363/2706] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:42:03 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:42:04.080501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d0dbc-9f20-4ffe-9e76-8db36c954656 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:04.091605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d0dbc-9f20-4ffe-9e76-8db36c954656 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:04.096109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfda9f-1bd8-40e3-b0a9-bbf05d642660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:04.096699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfda9f-1bd8-40e3-b0a9-bbf05d642660 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:04.096971 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfda9f-1bd8-40e3-b0a9-bbf05d642660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:04.097237 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfda9f-1bd8-40e3-b0a9-bbf05d642660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:04.097869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfda9f-1bd8-40e3-b0a9-bbf05d642660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:04.099489 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfda9f-1bd8-40e3-b0a9-bbf05d642660 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:04.109462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1344/2707] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:04.113258 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca4e4b-d569-4c48-8b5c-a0ed004c82d1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:04.123151 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca4e4b-d569-4c48-8b5c-a0ed004c82d1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:04.128171 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4e0c7-f9ac-408b-b66b-59b392575ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:04.128766 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4e0c7-f9ac-408b-b66b-59b392575ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:04.129022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4e0c7-f9ac-408b-b66b-59b392575ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:04.129287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4e0c7-f9ac-408b-b66b-59b392575ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:04.129914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4e0c7-f9ac-408b-b66b-59b392575ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:04.131522 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4e0c7-f9ac-408b-b66b-59b392575ca1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:04.141714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1364/2708] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:04.146181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfda9f-1bd8-40e3-b0a9-bbf05d642660 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:04.155863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfda9f-1bd8-40e3-b0a9-bbf05d642660 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:04.160731 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc15a6-04cd-4ef3-8bb2-e582e126bc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:04.161366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc15a6-04cd-4ef3-8bb2-e582e126bc82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:04.161640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc15a6-04cd-4ef3-8bb2-e582e126bc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:04.161906 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc15a6-04cd-4ef3-8bb2-e582e126bc82 admin admin] PATH_INFO: `/v3/projects/af92c2812e404a33b12cb1e765a1a590/users/63c4da6df6b74ea982e7e0635650f366/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:04.175846 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc15a6-04cd-4ef3-8bb2-e582e126bc82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af92c2812e404a33b12cb1e765a1a590, user_id=63c4da6df6b74ea982e7e0635650f366, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:04.178466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc15a6-04cd-4ef3-8bb2-e582e126bc82 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:04.191802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1345/2709] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:04 2022] PUT /identity/v3/projects/af92c2812e404a33b12cb1e765a1a590/users/63c4da6df6b74ea982e7e0635650f366/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:04.202572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475a53-19bf-4ff6-865c-019cf1b76ffc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:04.202858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475a53-19bf-4ff6-865c-019cf1b76ffc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:04.203158 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475a53-19bf-4ff6-865c-019cf1b76ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:04.230745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-40475a53-19bf-4ff6-865c-019cf1b76ffc None None] MFA Rules not processed for user `63c4da6df6b74ea982e7e0635650f366`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:04.231976 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-40475a53-19bf-4ff6-865c-019cf1b76ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:04.294707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1365/2710] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:04.306614 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc15a6-04cd-4ef3-8bb2-e582e126bc82 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:04.308359 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-18cc15a6-04cd-4ef3-8bb2-e582e126bc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:04.365699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc15a6-04cd-4ef3-8bb2-e582e126bc82 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:04.369363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff2da-3256-4f34-aeb0-6c1998888574 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6639f15880c4c718f41cd84cb79c750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:04.369978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff2da-3256-4f34-aeb0-6c1998888574 service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:04.370248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff2da-3256-4f34-aeb0-6c1998888574 service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:04.370510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff2da-3256-4f34-aeb0-6c1998888574 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:04.379385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cff2da-3256-4f34-aeb0-6c1998888574 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:04.380892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cff2da-3256-4f34-aeb0-6c1998888574 service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:04.389745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1346/2711] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:13.727663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40475a53-19bf-4ff6-865c-019cf1b76ffc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:13.729276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-40475a53-19bf-4ff6-865c-019cf1b76ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:13.788974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40475a53-19bf-4ff6-865c-019cf1b76ffc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:13.792646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da285542-1c85-41f9-bdbe-61de5a053108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:13.793322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da285542-1c85-41f9-bdbe-61de5a053108 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:13.793676 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da285542-1c85-41f9-bdbe-61de5a053108 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:13.794007 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da285542-1c85-41f9-bdbe-61de5a053108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:13.795888 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-da285542-1c85-41f9-bdbe-61de5a053108 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:13.863908 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da285542-1c85-41f9-bdbe-61de5a053108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:13.865350 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da285542-1c85-41f9-bdbe-61de5a053108 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:13.875822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1366/2712] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:14.385637 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=60,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:23.871534 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:28.010395 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff2da-3256-4f34-aeb0-6c1998888574 service glance] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:28.011798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-86cff2da-3256-4f34-aeb0-6c1998888574 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:28.069007 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff2da-3256-4f34-aeb0-6c1998888574 service glance] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:28.072469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c908a0-33a6-4c92-b3a7-9c245b57a636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:28.073058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c908a0-33a6-4c92-b3a7-9c245b57a636 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:28.073330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c908a0-33a6-4c92-b3a7-9c245b57a636 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:28.073594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c908a0-33a6-4c92-b3a7-9c245b57a636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:28.075473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f5c908a0-33a6-4c92-b3a7-9c245b57a636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:28.137256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c908a0-33a6-4c92-b3a7-9c245b57a636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:28.138863 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c908a0-33a6-4c92-b3a7-9c245b57a636 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:28.149002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1347/2713] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:31.532912 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da285542-1c85-41f9-bdbe-61de5a053108 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:31.534356 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-da285542-1c85-41f9-bdbe-61de5a053108 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:31.550789 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da285542-1c85-41f9-bdbe-61de5a053108 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:31.556555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c392e5-c825-4ae7-b95d-d54fbdc5d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:31.557286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c392e5-c825-4ae7-b95d-d54fbdc5d3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:31.557666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c392e5-c825-4ae7-b95d-d54fbdc5d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:31.558288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c392e5-c825-4ae7-b95d-d54fbdc5d3bf admin admin] PATH_INFO: `/v3/users/aff5308e6cb94622853075a723d54a67` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:31.559748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c392e5-c825-4ae7-b95d-d54fbdc5d3bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff5308e6cb94622853075a723d54a67)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:31.561702 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c392e5-c825-4ae7-b95d-d54fbdc5d3bf admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:31.616663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-40c392e5-c825-4ae7-b95d-d54fbdc5d3bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff5308e6cb94622853075a723d54a67'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:31.628752 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-40c392e5-c825-4ae7-b95d-d54fbdc5d3bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff5308e6cb94622853075a723d54a67'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:31.637401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-40c392e5-c825-4ae7-b95d-d54fbdc5d3bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff5308e6cb94622853075a723d54a67'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:31.638228 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-40c392e5-c825-4ae7-b95d-d54fbdc5d3bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff5308e6cb94622853075a723d54a67'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:31.650940 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-40c392e5-c825-4ae7-b95d-d54fbdc5d3bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff5308e6cb94622853075a723d54a67'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:31.657462 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1367/2714] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:31 2022] DELETE /identity/v3/users/aff5308e6cb94622853075a723d54a67 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:31.856158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c908a0-33a6-4c92-b3a7-9c245b57a636 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:31.867340 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c908a0-33a6-4c92-b3a7-9c245b57a636 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:31.926105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb06810-347c-4cc9-8ce6-b1b4afafb096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:31.926746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb06810-347c-4cc9-8ce6-b1b4afafb096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:31.927017 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb06810-347c-4cc9-8ce6-b1b4afafb096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:31.927311 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb06810-347c-4cc9-8ce6-b1b4afafb096 admin admin] PATH_INFO: `/v3/projects/8ff1353007e0474c923cb4e3bf93ba43` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:31.929043 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb06810-347c-4cc9-8ce6-b1b4afafb096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff1353007e0474c923cb4e3bf93ba43)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:31.930918 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb06810-347c-4cc9-8ce6-b1b4afafb096 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:31.975795 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3bb06810-347c-4cc9-8ce6-b1b4afafb096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff1353007e0474c923cb4e3bf93ba43', 'request_id': 'req-3bb06810-347c-4cc9-8ce6-b1b4afafb096'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:31.977588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:31.982197 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3bb06810-347c-4cc9-8ce6-b1b4afafb096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff1353007e0474c923cb4e3bf93ba43', 'request_id': 'req-3bb06810-347c-4cc9-8ce6-b1b4afafb096'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:31.989322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3bb06810-347c-4cc9-8ce6-b1b4afafb096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff1353007e0474c923cb4e3bf93ba43', 'request_id': 'req-3bb06810-347c-4cc9-8ce6-b1b4afafb096'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:32.002154 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3bb06810-347c-4cc9-8ce6-b1b4afafb096 admin admin] The token cache is being invalidate because project 8ff1353007e0474c923cb4e3bf93ba43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:32.002441 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3bb06810-347c-4cc9-8ce6-b1b4afafb096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:32.003047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3bb06810-347c-4cc9-8ce6-b1b4afafb096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:32.004588 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1348/2715] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:31 2022] DELETE /identity/v3/projects/8ff1353007e0474c923cb4e3bf93ba43 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:32.009443 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a35847-b8fb-41a5-af94-0ed1cabc64d5 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:32.009726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a35847-b8fb-41a5-af94-0ed1cabc64d5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:32.010000 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a35847-b8fb-41a5-af94-0ed1cabc64d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:32.029707 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a9a35847-b8fb-41a5-af94-0ed1cabc64d5 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:32.030931 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a9a35847-b8fb-41a5-af94-0ed1cabc64d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:32.090275 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1368/2716] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:32.098135 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9cb06-2089-4922-b039-7ff12355e54a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:32.098421 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9cb06-2089-4922-b039-7ff12355e54a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:32.098697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9cb06-2089-4922-b039-7ff12355e54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:32.118596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f0f9cb06-2089-4922-b039-7ff12355e54a None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:32.119812 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f0f9cb06-2089-4922-b039-7ff12355e54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:32.127673 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1349/2717] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:32.131757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a35847-b8fb-41a5-af94-0ed1cabc64d5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:32.141368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a35847-b8fb-41a5-af94-0ed1cabc64d5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:32.146427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273905c4-1335-45a2-9b28-df8ed1bff0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:32.147164 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273905c4-1335-45a2-9b28-df8ed1bff0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:32.148115 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273905c4-1335-45a2-9b28-df8ed1bff0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:32.148386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273905c4-1335-45a2-9b28-df8ed1bff0bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:32.149080 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273905c4-1335-45a2-9b28-df8ed1bff0bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:42:32.149375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273905c4-1335-45a2-9b28-df8ed1bff0bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:32.151394 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273905c4-1335-45a2-9b28-df8ed1bff0bb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:32.164538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1369/2718] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 22:42:32.168804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9cb06-2089-4922-b039-7ff12355e54a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:32.177899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9cb06-2089-4922-b039-7ff12355e54a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:32.182531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756643a-adf8-4791-b807-379c364426d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:32.183145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756643a-adf8-4791-b807-379c364426d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:32.183419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756643a-adf8-4791-b807-379c364426d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:32.184003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756643a-adf8-4791-b807-379c364426d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:32.184651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756643a-adf8-4791-b807-379c364426d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:32.186590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756643a-adf8-4791-b807-379c364426d9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:32.215148 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1350/2719] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:42:32 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:32.219376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273905c4-1335-45a2-9b28-df8ed1bff0bb admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:32.229830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273905c4-1335-45a2-9b28-df8ed1bff0bb admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:32.283706 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cdd2e-223c-4b86-a795-4cdbeb13f7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:32.284285 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cdd2e-223c-4b86-a795-4cdbeb13f7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:32.284556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cdd2e-223c-4b86-a795-4cdbeb13f7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:32.284819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cdd2e-223c-4b86-a795-4cdbeb13f7f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:32.285680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cdd2e-223c-4b86-a795-4cdbeb13f7f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:32.287588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cdd2e-223c-4b86-a795-4cdbeb13f7f5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:32.295710 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:32.310022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1370/2720] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:42:32 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:32.314219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756643a-adf8-4791-b807-379c364426d9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:32.325031 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756643a-adf8-4791-b807-379c364426d9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:32.329655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e727-30e5-46a7-8c80-1fd0ccbc6327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:32.330241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e727-30e5-46a7-8c80-1fd0ccbc6327 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:32.330510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e727-30e5-46a7-8c80-1fd0ccbc6327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:32.330781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e727-30e5-46a7-8c80-1fd0ccbc6327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:32.331448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8e727-30e5-46a7-8c80-1fd0ccbc6327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:32.333047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8e727-30e5-46a7-8c80-1fd0ccbc6327 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:32.346682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1351/2721] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:32.347875 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cdd2e-223c-4b86-a795-4cdbeb13f7f5 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:32.357514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cdd2e-223c-4b86-a795-4cdbeb13f7f5 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:32.365104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bb666-ef36-40bc-8a3d-03c52f47f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:32.365692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bb666-ef36-40bc-8a3d-03c52f47f035 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:32.365965 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bb666-ef36-40bc-8a3d-03c52f47f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:32.366230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bb666-ef36-40bc-8a3d-03c52f47f035 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:32.366858 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bb666-ef36-40bc-8a3d-03c52f47f035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:32.368489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bb666-ef36-40bc-8a3d-03c52f47f035 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:32.379911 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1371/2722] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:32.384782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e727-30e5-46a7-8c80-1fd0ccbc6327 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:32.394942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e727-30e5-46a7-8c80-1fd0ccbc6327 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:32.400595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf821ce-d3c8-4cf1-b38b-76767eae1270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:32.401251 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf821ce-d3c8-4cf1-b38b-76767eae1270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:32.401530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf821ce-d3c8-4cf1-b38b-76767eae1270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:32.401802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf821ce-d3c8-4cf1-b38b-76767eae1270 admin admin] PATH_INFO: `/v3/projects/16e792f082a142d4a6e8d920bb746bc8/users/d8e63a5c1ada41519b572d355bc8b942/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:32.424195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf821ce-d3c8-4cf1-b38b-76767eae1270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e792f082a142d4a6e8d920bb746bc8, user_id=d8e63a5c1ada41519b572d355bc8b942, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:32.426844 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf821ce-d3c8-4cf1-b38b-76767eae1270 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:32.441692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1352/2723] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:32 2022] PUT /identity/v3/projects/16e792f082a142d4a6e8d920bb746bc8/users/d8e63a5c1ada41519b572d355bc8b942/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:32.453042 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f1e38-4172-49ad-a24a-28ed3d3c5a22 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:32.453358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f1e38-4172-49ad-a24a-28ed3d3c5a22 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:32.453706 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f1e38-4172-49ad-a24a-28ed3d3c5a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:32.484907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-9d1f1e38-4172-49ad-a24a-28ed3d3c5a22 None None] MFA Rules not processed for user `d8e63a5c1ada41519b572d355bc8b942`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:32.486018 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9d1f1e38-4172-49ad-a24a-28ed3d3c5a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:32.549437 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1372/2724] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:32.560765 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf821ce-d3c8-4cf1-b38b-76767eae1270 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:32.562569 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2bf821ce-d3c8-4cf1-b38b-76767eae1270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:32.644517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf821ce-d3c8-4cf1-b38b-76767eae1270 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:32.651755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a3796-5740-4f37-a53a-7f54e013fa2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:32.652343 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a3796-5740-4f37-a53a-7f54e013fa2e service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:32.652619 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a3796-5740-4f37-a53a-7f54e013fa2e service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:32.652916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a3796-5740-4f37-a53a-7f54e013fa2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:32.662615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a3796-5740-4f37-a53a-7f54e013fa2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:32.664334 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a3796-5740-4f37-a53a-7f54e013fa2e service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:32.673808 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1353/2725] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:42:33.503357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f1e38-4172-49ad-a24a-28ed3d3c5a22 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:33.504774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9d1f1e38-4172-49ad-a24a-28ed3d3c5a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:33.568603 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f1e38-4172-49ad-a24a-28ed3d3c5a22 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:33.573153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:33.573768 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:33.574049 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:33.574318 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] PATH_INFO: `/v3/users/63c4da6df6b74ea982e7e0635650f366` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:33.575458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c4da6df6b74ea982e7e0635650f366)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:33.577333 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:33.622037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c4da6df6b74ea982e7e0635650f366'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:33.628676 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c4da6df6b74ea982e7e0635650f366'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:33.636136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c4da6df6b74ea982e7e0635650f366'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:33.636942 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c4da6df6b74ea982e7e0635650f366'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:33.642179 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:33.650727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c4da6df6b74ea982e7e0635650f366'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:33.657255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1373/2726] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:33 2022] DELETE /identity/v3/users/63c4da6df6b74ea982e7e0635650f366 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:33.661942 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f2a54-2c2b-43b1-8d58-c5cc07fe051c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:33.662444 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f2a54-2c2b-43b1-8d58-c5cc07fe051c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:33.662548 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f2a54-2c2b-43b1-8d58-c5cc07fe051c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:33.681557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0f0f2a54-2c2b-43b1-8d58-c5cc07fe051c None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:33.682754 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0f0f2a54-2c2b-43b1-8d58-c5cc07fe051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:33.747897 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1354/2727] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:42:33.757743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:33.759208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:33.815229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384085d-e7ca-4c7e-8a9d-287f92393fc4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:33.818771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ec4d8-80fa-4101-a25d-16f66c43db2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:33.819893 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ec4d8-80fa-4101-a25d-16f66c43db2f service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:33.820161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ec4d8-80fa-4101-a25d-16f66c43db2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:33.820423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ec4d8-80fa-4101-a25d-16f66c43db2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:33.829653 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ec4d8-80fa-4101-a25d-16f66c43db2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:33.831489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ec4d8-80fa-4101-a25d-16f66c43db2f service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:33.841820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1374/2728] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:34.150901 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f2a54-2c2b-43b1-8d58-c5cc07fe051c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:34.153058 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0f0f2a54-2c2b-43b1-8d58-c5cc07fe051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:34.163137 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:34.171131 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f2a54-2c2b-43b1-8d58-c5cc07fe051c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:34.177040 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4814717-a5b9-433e-b426-e61245ebaa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:34.177833 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814717-a5b9-433e-b426-e61245ebaa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:34.178118 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814717-a5b9-433e-b426-e61245ebaa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:34.186354 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814717-a5b9-433e-b426-e61245ebaa36 admin admin] PATH_INFO: `/v3/projects/af92c2812e404a33b12cb1e765a1a590` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:34.187678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4814717-a5b9-433e-b426-e61245ebaa36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af92c2812e404a33b12cb1e765a1a590)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:34.189852 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4814717-a5b9-433e-b426-e61245ebaa36 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:34.253742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a4814717-a5b9-433e-b426-e61245ebaa36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af92c2812e404a33b12cb1e765a1a590', 'request_id': 'req-a4814717-a5b9-433e-b426-e61245ebaa36'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:34.261042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a4814717-a5b9-433e-b426-e61245ebaa36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af92c2812e404a33b12cb1e765a1a590', 'request_id': 'req-a4814717-a5b9-433e-b426-e61245ebaa36'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:34.267950 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a4814717-a5b9-433e-b426-e61245ebaa36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af92c2812e404a33b12cb1e765a1a590', 'request_id': 'req-a4814717-a5b9-433e-b426-e61245ebaa36'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:34.282438 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a4814717-a5b9-433e-b426-e61245ebaa36 admin admin] The token cache is being invalidate because project af92c2812e404a33b12cb1e765a1a590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:34.282656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a4814717-a5b9-433e-b426-e61245ebaa36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:34.283429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a4814717-a5b9-433e-b426-e61245ebaa36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:34.285042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1355/2729] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:34 2022] DELETE /identity/v3/projects/af92c2812e404a33b12cb1e765a1a590 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:37.973383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ec4d8-80fa-4101-a25d-16f66c43db2f service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:37.973831 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-849ec4d8-80fa-4101-a25d-16f66c43db2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:37.986118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ec4d8-80fa-4101-a25d-16f66c43db2f service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:38.040924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:38.041537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:38.041810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:38.042075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] PATH_INFO: `/v3/users/d8e63a5c1ada41519b572d355bc8b942` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:38.043213 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e63a5c1ada41519b572d355bc8b942)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:38.045089 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:38.092477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e63a5c1ada41519b572d355bc8b942'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:38.099720 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e63a5c1ada41519b572d355bc8b942'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:38.107507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e63a5c1ada41519b572d355bc8b942'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:38.108177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e63a5c1ada41519b572d355bc8b942'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:38.125773 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e63a5c1ada41519b572d355bc8b942'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:38.131223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1375/2730] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:37 2022] DELETE /identity/v3/users/d8e63a5c1ada41519b572d355bc8b942 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:38.137106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65644305-afd6-49c5-8065-43706344a8cb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:38.137511 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65644305-afd6-49c5-8065-43706344a8cb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:38.137648 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65644305-afd6-49c5-8065-43706344a8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:38.167806 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-65644305-afd6-49c5-8065-43706344a8cb None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:38.169108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-65644305-afd6-49c5-8065-43706344a8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:38.371228 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1356/2731] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:42:38.382388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:38.383816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:38.394667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:38.452803 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a500ef-086c-4c82-9bb5-b7bb131f54f6 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:38.456568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af1289-d62f-40ce-851a-3a2948600c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:38.457159 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af1289-d62f-40ce-851a-3a2948600c28 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:38.457435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af1289-d62f-40ce-851a-3a2948600c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:38.457703 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af1289-d62f-40ce-851a-3a2948600c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:38.466588 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af1289-d62f-40ce-851a-3a2948600c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:38.468046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af1289-d62f-40ce-851a-3a2948600c28 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:38.477816 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1376/2732] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:38.743470 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65644305-afd6-49c5-8065-43706344a8cb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:38.746954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-65644305-afd6-49c5-8065-43706344a8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:38.762543 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65644305-afd6-49c5-8065-43706344a8cb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:38.771746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731b3d-4370-49d4-b233-e89e18242787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:38.773190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731b3d-4370-49d4-b233-e89e18242787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:38.773190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731b3d-4370-49d4-b233-e89e18242787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:38.773190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731b3d-4370-49d4-b233-e89e18242787 admin admin] PATH_INFO: `/v3/projects/16e792f082a142d4a6e8d920bb746bc8` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:38.776694 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31731b3d-4370-49d4-b233-e89e18242787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e792f082a142d4a6e8d920bb746bc8)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:38.778657 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31731b3d-4370-49d4-b233-e89e18242787 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:38.831299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-31731b3d-4370-49d4-b233-e89e18242787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e792f082a142d4a6e8d920bb746bc8', 'request_id': 'req-31731b3d-4370-49d4-b233-e89e18242787'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:38.839734 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-31731b3d-4370-49d4-b233-e89e18242787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e792f082a142d4a6e8d920bb746bc8', 'request_id': 'req-31731b3d-4370-49d4-b233-e89e18242787'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:38.847052 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-31731b3d-4370-49d4-b233-e89e18242787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e792f082a142d4a6e8d920bb746bc8', 'request_id': 'req-31731b3d-4370-49d4-b233-e89e18242787'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:38.861329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-31731b3d-4370-49d4-b233-e89e18242787 admin admin] The token cache is being invalidate because project 16e792f082a142d4a6e8d920bb746bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:38.861623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-31731b3d-4370-49d4-b233-e89e18242787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:38.862280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-31731b3d-4370-49d4-b233-e89e18242787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:38.864128 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1357/2733] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:38 2022] DELETE /identity/v3/projects/16e792f082a142d4a6e8d920bb746bc8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:38.869896 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d256610-4f05-4ab3-bae1-c1e91815a149 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:38.870420 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d256610-4f05-4ab3-bae1-c1e91815a149 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:38.870863 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d256610-4f05-4ab3-bae1-c1e91815a149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:38.900690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2d256610-4f05-4ab3-bae1-c1e91815a149 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:38.901872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2d256610-4f05-4ab3-bae1-c1e91815a149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:38.960353 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1377/2734] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:38.969809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d40808-ef33-4180-b88c-2c1dace47572 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:38.970106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d40808-ef33-4180-b88c-2c1dace47572 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:38.970373 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d40808-ef33-4180-b88c-2c1dace47572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:38.989875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e0d40808-ef33-4180-b88c-2c1dace47572 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:38.991000 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e0d40808-ef33-4180-b88c-2c1dace47572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:38.999209 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1358/2735] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:39.003531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d256610-4f05-4ab3-bae1-c1e91815a149 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:39.013611 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d256610-4f05-4ab3-bae1-c1e91815a149 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:39.018287 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0753b7-c2b9-4d2a-81bd-a02c9789c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:39.018885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0753b7-c2b9-4d2a-81bd-a02c9789c1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.019223 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0753b7-c2b9-4d2a-81bd-a02c9789c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.019493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0753b7-c2b9-4d2a-81bd-a02c9789c1ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.020192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0753b7-c2b9-4d2a-81bd-a02c9789c1ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:42:39.020532 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0753b7-c2b9-4d2a-81bd-a02c9789c1ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:39.022116 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0753b7-c2b9-4d2a-81bd-a02c9789c1ca admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:39.034157 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1378/2736] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:42:39.038592 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d40808-ef33-4180-b88c-2c1dace47572 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:39.043453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:39.049597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d40808-ef33-4180-b88c-2c1dace47572 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:39.055617 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb25a3f-2695-4b75-9ddb-888561988fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:39.056198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb25a3f-2695-4b75-9ddb-888561988fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.056466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb25a3f-2695-4b75-9ddb-888561988fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.056729 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb25a3f-2695-4b75-9ddb-888561988fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.057344 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb25a3f-2695-4b75-9ddb-888561988fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:39.059247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb25a3f-2695-4b75-9ddb-888561988fcd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:39.084321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1359/2737] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:42:39 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:39.088577 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0753b7-c2b9-4d2a-81bd-a02c9789c1ca admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:39.098415 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0753b7-c2b9-4d2a-81bd-a02c9789c1ca admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:39.159404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c350a7-210e-49fc-8330-8eaab9f4e956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:39.160043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c350a7-210e-49fc-8330-8eaab9f4e956 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.160289 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c350a7-210e-49fc-8330-8eaab9f4e956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.160808 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c350a7-210e-49fc-8330-8eaab9f4e956 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.161422 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c350a7-210e-49fc-8330-8eaab9f4e956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:39.163327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c350a7-210e-49fc-8330-8eaab9f4e956 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:39.183667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1379/2738] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:42:39 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:42:39.187934 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb25a3f-2695-4b75-9ddb-888561988fcd admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:39.197968 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb25a3f-2695-4b75-9ddb-888561988fcd admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:39.202468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0d4c4-e7a2-47fd-815c-eeec35347e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:39.203048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0d4c4-e7a2-47fd-815c-eeec35347e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.203368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0d4c4-e7a2-47fd-815c-eeec35347e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.203636 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0d4c4-e7a2-47fd-815c-eeec35347e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.204272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0d4c4-e7a2-47fd-815c-eeec35347e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:39.205875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0d4c4-e7a2-47fd-815c-eeec35347e9f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:39.215539 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1360/2739] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:39.219349 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c350a7-210e-49fc-8330-8eaab9f4e956 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:39.229648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c350a7-210e-49fc-8330-8eaab9f4e956 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:39.234178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7981a-8681-4d90-8e71-c609a2c58b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:39.234762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7981a-8681-4d90-8e71-c609a2c58b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.235055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7981a-8681-4d90-8e71-c609a2c58b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.235326 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7981a-8681-4d90-8e71-c609a2c58b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.235959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7981a-8681-4d90-8e71-c609a2c58b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:39.237519 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7981a-8681-4d90-8e71-c609a2c58b5f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:39.248953 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1380/2740] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:39.252933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0d4c4-e7a2-47fd-815c-eeec35347e9f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:39.263112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0d4c4-e7a2-47fd-815c-eeec35347e9f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:39.267761 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c26fe1-5792-42f3-935c-4696e6064e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:39.268439 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c26fe1-5792-42f3-935c-4696e6064e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.268707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c26fe1-5792-42f3-935c-4696e6064e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.268972 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c26fe1-5792-42f3-935c-4696e6064e66 admin admin] PATH_INFO: `/v3/projects/f47006c24239413e9da3b459c0871044/users/95d78a22ba214982845200d86ad71cf0/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.285269 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c26fe1-5792-42f3-935c-4696e6064e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47006c24239413e9da3b459c0871044, user_id=95d78a22ba214982845200d86ad71cf0, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:39.288234 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c26fe1-5792-42f3-935c-4696e6064e66 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:39.303353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1361/2741] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:39 2022] PUT /identity/v3/projects/f47006c24239413e9da3b459c0871044/users/95d78a22ba214982845200d86ad71cf0/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:39.314717 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a125e-e4d1-4580-82e7-bc2fc4705ed5 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.315046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a125e-e4d1-4580-82e7-bc2fc4705ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.315362 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a125e-e4d1-4580-82e7-bc2fc4705ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.345053 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-9e1a125e-e4d1-4580-82e7-bc2fc4705ed5 None None] MFA Rules not processed for user `95d78a22ba214982845200d86ad71cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:39.346449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9e1a125e-e4d1-4580-82e7-bc2fc4705ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:39.352512 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:39.415763 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1381/2742] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:39.420307 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c26fe1-5792-42f3-935c-4696e6064e66 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:39.490662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c26fe1-5792-42f3-935c-4696e6064e66 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:39.495367 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5355fb7-aa7e-41f2-a2e7-cd9ecce3755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:39.495960 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5355fb7-aa7e-41f2-a2e7-cd9ecce3755f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.496233 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5355fb7-aa7e-41f2-a2e7-cd9ecce3755f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.496499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5355fb7-aa7e-41f2-a2e7-cd9ecce3755f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.497104 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5355fb7-aa7e-41f2-a2e7-cd9ecce3755f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:39.499096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5355fb7-aa7e-41f2-a2e7-cd9ecce3755f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:39.528272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1362/2743] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:42:39 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:39.532257 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a125e-e4d1-4580-82e7-bc2fc4705ed5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:39.543692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a125e-e4d1-4580-82e7-bc2fc4705ed5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:39.614061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f8a43-0128-4582-996e-2f8396f2dc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:39.614823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f8a43-0128-4582-996e-2f8396f2dc21 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.615117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f8a43-0128-4582-996e-2f8396f2dc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.615396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f8a43-0128-4582-996e-2f8396f2dc21 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.616020 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f8a43-0128-4582-996e-2f8396f2dc21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:39.618005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f8a43-0128-4582-996e-2f8396f2dc21 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:39.639599 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1382/2744] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:42:39 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:39.643592 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5355fb7-aa7e-41f2-a2e7-cd9ecce3755f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:39.654996 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5355fb7-aa7e-41f2-a2e7-cd9ecce3755f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:39.659692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97e596-e389-4b1b-acd6-d7bc991e1069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:39.660291 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97e596-e389-4b1b-acd6-d7bc991e1069 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.660823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97e596-e389-4b1b-acd6-d7bc991e1069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.661095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97e596-e389-4b1b-acd6-d7bc991e1069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.661739 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97e596-e389-4b1b-acd6-d7bc991e1069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:39.663370 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97e596-e389-4b1b-acd6-d7bc991e1069 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:39.673931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1363/2745] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:42:39.678089 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f8a43-0128-4582-996e-2f8396f2dc21 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:39.688047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f8a43-0128-4582-996e-2f8396f2dc21 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:39.692614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ca4b2-2262-47ed-a089-39db55df2dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:39.693252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ca4b2-2262-47ed-a089-39db55df2dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.693529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ca4b2-2262-47ed-a089-39db55df2dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.693798 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ca4b2-2262-47ed-a089-39db55df2dd3 admin admin] PATH_INFO: `/v3/projects/da8605197ab54e7b8d59cfa8fb5d958e/users/7691b34f15a0439981dbe554cd4822e5/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.708666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ca4b2-2262-47ed-a089-39db55df2dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8605197ab54e7b8d59cfa8fb5d958e, user_id=7691b34f15a0439981dbe554cd4822e5, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:39.711954 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ca4b2-2262-47ed-a089-39db55df2dd3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:39.727718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1383/2746] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:39 2022] PUT /identity/v3/projects/da8605197ab54e7b8d59cfa8fb5d958e/users/7691b34f15a0439981dbe554cd4822e5/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:39.732069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97e596-e389-4b1b-acd6-d7bc991e1069 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:39.745308 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97e596-e389-4b1b-acd6-d7bc991e1069 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:39.811645 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e17329-1d06-4288-b381-e0cab845cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:39.812828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e17329-1d06-4288-b381-e0cab845cce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.813179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e17329-1d06-4288-b381-e0cab845cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.813433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e17329-1d06-4288-b381-e0cab845cce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.814070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e17329-1d06-4288-b381-e0cab845cce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:39.815718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e17329-1d06-4288-b381-e0cab845cce8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:39.826403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1364/2747] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:39.831301 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ca4b2-2262-47ed-a089-39db55df2dd3 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:39.845085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ca4b2-2262-47ed-a089-39db55df2dd3 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:39.850563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544add3-f90e-401d-810b-127b26609722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:39.851737 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544add3-f90e-401d-810b-127b26609722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.852043 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544add3-f90e-401d-810b-127b26609722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.852249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544add3-f90e-401d-810b-127b26609722 admin admin] PATH_INFO: `/v3/projects/da8605197ab54e7b8d59cfa8fb5d958e/users/7691b34f15a0439981dbe554cd4822e5/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.854552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544add3-f90e-401d-810b-127b26609722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8605197ab54e7b8d59cfa8fb5d958e, user_id=7691b34f15a0439981dbe554cd4822e5, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:39.858161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544add3-f90e-401d-810b-127b26609722 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:39.881830 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1384/2748] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:39 2022] PUT /identity/v3/projects/da8605197ab54e7b8d59cfa8fb5d958e/users/7691b34f15a0439981dbe554cd4822e5/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:39.884654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860688ff-b6a5-42d2-8b45-2889e089bb7e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:39.884654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860688ff-b6a5-42d2-8b45-2889e089bb7e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:39.884654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860688ff-b6a5-42d2-8b45-2889e089bb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:39.915909 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-860688ff-b6a5-42d2-8b45-2889e089bb7e None None] MFA Rules not processed for user `7691b34f15a0439981dbe554cd4822e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:39.917275 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-860688ff-b6a5-42d2-8b45-2889e089bb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:39.922581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:40.008967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1365/2749] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:42:40.022021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544add3-f90e-401d-810b-127b26609722 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:40.025334 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6544add3-f90e-401d-810b-127b26609722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:40.090711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544add3-f90e-401d-810b-127b26609722 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:40.094579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042dc9-f20c-46dc-bc4a-4b457fa82471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:40.095379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042dc9-f20c-46dc-bc4a-4b457fa82471 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:40.095860 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042dc9-f20c-46dc-bc4a-4b457fa82471 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:40.096229 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042dc9-f20c-46dc-bc4a-4b457fa82471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:40.111501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:40.161274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd042dc9-f20c-46dc-bc4a-4b457fa82471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:40.162757 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd042dc9-f20c-46dc-bc4a-4b457fa82471 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:40.172423 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1385/2750] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:40.409096 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860688ff-b6a5-42d2-8b45-2889e089bb7e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:40.411869 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-860688ff-b6a5-42d2-8b45-2889e089bb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:40.487351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860688ff-b6a5-42d2-8b45-2889e089bb7e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:40.491960 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:40.493134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:40.493435 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:40.493672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] PATH_INFO: `/v3/users/4d82178581034cf8b22c49761f4333bb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:40.494805 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d82178581034cf8b22c49761f4333bb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:40.497347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:40.544523 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d82178581034cf8b22c49761f4333bb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:40.552015 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d82178581034cf8b22c49761f4333bb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:40.552709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d82178581034cf8b22c49761f4333bb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:40.553300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d82178581034cf8b22c49761f4333bb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:40.566190 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d82178581034cf8b22c49761f4333bb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:40.578156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1366/2751] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:40 2022] DELETE /identity/v3/users/4d82178581034cf8b22c49761f4333bb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:40.753473 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042dc9-f20c-46dc-bc4a-4b457fa82471 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:40.766245 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042dc9-f20c-46dc-bc4a-4b457fa82471 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:40.831374 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:40.832034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:40.832314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:40.832696 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] PATH_INFO: `/v3/projects/212249e6db03409594061ed59abddc6b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:40.833832 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=212249e6db03409594061ed59abddc6b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:40.835713 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:40.880975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212249e6db03409594061ed59abddc6b', 'request_id': 'req-4119e094-17ff-4244-b11e-0c4bbb83dba3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:40.886265 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212249e6db03409594061ed59abddc6b', 'request_id': 'req-4119e094-17ff-4244-b11e-0c4bbb83dba3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:40.892162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212249e6db03409594061ed59abddc6b', 'request_id': 'req-4119e094-17ff-4244-b11e-0c4bbb83dba3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:40.904769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] The token cache is being invalidate because project 212249e6db03409594061ed59abddc6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:40.905056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:40.905674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:40.907206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1386/2752] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:40 2022] DELETE /identity/v3/projects/212249e6db03409594061ed59abddc6b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:40.911429 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:40.912899 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:40.926455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18917a-c711-46e2-af29-b4b8af77fb8d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:40.942112 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:40.983874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fc879-8bc0-48e5-abf3-b3254e8ffccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:40.984501 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fc879-8bc0-48e5-abf3-b3254e8ffccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:40.984772 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fc879-8bc0-48e5-abf3-b3254e8ffccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:40.985039 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fc879-8bc0-48e5-abf3-b3254e8ffccb admin admin] PATH_INFO: `/v3/users/cc39d785aeb34dc7a38e945dab273934` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:40.986178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fc879-8bc0-48e5-abf3-b3254e8ffccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc39d785aeb34dc7a38e945dab273934)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:40.988127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fc879-8bc0-48e5-abf3-b3254e8ffccb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:41.034999 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-745fc879-8bc0-48e5-abf3-b3254e8ffccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc39d785aeb34dc7a38e945dab273934'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:41.043303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-745fc879-8bc0-48e5-abf3-b3254e8ffccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc39d785aeb34dc7a38e945dab273934'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:41.044154 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-745fc879-8bc0-48e5-abf3-b3254e8ffccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc39d785aeb34dc7a38e945dab273934'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:41.044858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-745fc879-8bc0-48e5-abf3-b3254e8ffccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc39d785aeb34dc7a38e945dab273934'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:41.059832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-745fc879-8bc0-48e5-abf3-b3254e8ffccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc39d785aeb34dc7a38e945dab273934'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:41.073608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1367/2753] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:40 2022] DELETE /identity/v3/users/cc39d785aeb34dc7a38e945dab273934 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:41.256299 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:41.259167 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:41.273312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119e094-17ff-4244-b11e-0c4bbb83dba3 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:41.322390 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:41.343396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c8b69-e924-49bc-9591-104251c63728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:41.343975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c8b69-e924-49bc-9591-104251c63728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:41.344280 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c8b69-e924-49bc-9591-104251c63728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:41.344579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c8b69-e924-49bc-9591-104251c63728 admin admin] PATH_INFO: `/v3/projects/6695c78da05d4d36a7ab37175052ae3a` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:41.345721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c8b69-e924-49bc-9591-104251c63728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6695c78da05d4d36a7ab37175052ae3a)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:41.347690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c8b69-e924-49bc-9591-104251c63728 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:41.394513 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-925c8b69-e924-49bc-9591-104251c63728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6695c78da05d4d36a7ab37175052ae3a', 'request_id': 'req-925c8b69-e924-49bc-9591-104251c63728'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:41.400563 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-925c8b69-e924-49bc-9591-104251c63728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6695c78da05d4d36a7ab37175052ae3a', 'request_id': 'req-925c8b69-e924-49bc-9591-104251c63728'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:41.406604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-925c8b69-e924-49bc-9591-104251c63728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6695c78da05d4d36a7ab37175052ae3a', 'request_id': 'req-925c8b69-e924-49bc-9591-104251c63728'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:41.419836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-925c8b69-e924-49bc-9591-104251c63728 admin admin] The token cache is being invalidate because project 6695c78da05d4d36a7ab37175052ae3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:41.420117 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-925c8b69-e924-49bc-9591-104251c63728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:41.420733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-925c8b69-e924-49bc-9591-104251c63728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:41.422215 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1387/2754] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:41 2022] DELETE /identity/v3/projects/6695c78da05d4d36a7ab37175052ae3a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:41.429315 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b8ce-b644-4896-9bb6-f2fd31fe63a0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:41.430361 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b8ce-b644-4896-9bb6-f2fd31fe63a0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:41.430469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b8ce-b644-4896-9bb6-f2fd31fe63a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:41.449651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bc51b8ce-b644-4896-9bb6-f2fd31fe63a0 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:41.451218 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bc51b8ce-b644-4896-9bb6-f2fd31fe63a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:41.523675 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1368/2755] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:42:41.531872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f734a0-6fb1-46ab-9b86-12ad1ae2669d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:41.532333 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f734a0-6fb1-46ab-9b86-12ad1ae2669d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:41.532609 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f734a0-6fb1-46ab-9b86-12ad1ae2669d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:41.554047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c0f734a0-6fb1-46ab-9b86-12ad1ae2669d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:41.556242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c0f734a0-6fb1-46ab-9b86-12ad1ae2669d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:41.566178 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1388/2756] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:41.570953 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51b8ce-b644-4896-9bb6-f2fd31fe63a0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:41.581331 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51b8ce-b644-4896-9bb6-f2fd31fe63a0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:41.586090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5a760-958d-4f51-96ad-90210bdeaa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:41.586681 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5a760-958d-4f51-96ad-90210bdeaa3e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:41.586957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5a760-958d-4f51-96ad-90210bdeaa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:41.587321 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5a760-958d-4f51-96ad-90210bdeaa3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:41.587965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5a760-958d-4f51-96ad-90210bdeaa3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:42:41.588263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5a760-958d-4f51-96ad-90210bdeaa3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:41.589829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5a760-958d-4f51-96ad-90210bdeaa3e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:41.605330 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1369/2757] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:42:41.606414 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f734a0-6fb1-46ab-9b86-12ad1ae2669d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:41.616581 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f734a0-6fb1-46ab-9b86-12ad1ae2669d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:41.622928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364c6b-4d57-4b25-acd1-6bce9b685065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:41.623556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364c6b-4d57-4b25-acd1-6bce9b685065 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:41.623867 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364c6b-4d57-4b25-acd1-6bce9b685065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:41.624156 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364c6b-4d57-4b25-acd1-6bce9b685065 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:41.624991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e364c6b-4d57-4b25-acd1-6bce9b685065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:41.627113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e364c6b-4d57-4b25-acd1-6bce9b685065 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:41.659034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1389/2758] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:42:41 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:42:41.663527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5a760-958d-4f51-96ad-90210bdeaa3e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:41.674214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5a760-958d-4f51-96ad-90210bdeaa3e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:41.701356 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:41.746141 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72c826-a620-4fd1-ad53-322f49a3a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:41.746978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72c826-a620-4fd1-ad53-322f49a3a2ee admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:41.747375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72c826-a620-4fd1-ad53-322f49a3a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:41.747798 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72c826-a620-4fd1-ad53-322f49a3a2ee admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:41.749081 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72c826-a620-4fd1-ad53-322f49a3a2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:41.751035 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72c826-a620-4fd1-ad53-322f49a3a2ee admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:41.772919 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1370/2759] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:42:41 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:41.777666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364c6b-4d57-4b25-acd1-6bce9b685065 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:41.788247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364c6b-4d57-4b25-acd1-6bce9b685065 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:41.793440 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571b44-e7bf-4dd7-8e58-3bd9acf813ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:41.794021 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571b44-e7bf-4dd7-8e58-3bd9acf813ec admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:41.794291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571b44-e7bf-4dd7-8e58-3bd9acf813ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:41.794557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571b44-e7bf-4dd7-8e58-3bd9acf813ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:41.795221 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03571b44-e7bf-4dd7-8e58-3bd9acf813ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:41.796775 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03571b44-e7bf-4dd7-8e58-3bd9acf813ec admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:41.806795 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1390/2760] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:42:41.810502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72c826-a620-4fd1-ad53-322f49a3a2ee admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:41.820514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72c826-a620-4fd1-ad53-322f49a3a2ee admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:41.824976 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503cf05-34c3-4461-8ab9-aa9bed5ed5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:41.825562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503cf05-34c3-4461-8ab9-aa9bed5ed5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:41.825828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503cf05-34c3-4461-8ab9-aa9bed5ed5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:41.826104 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503cf05-34c3-4461-8ab9-aa9bed5ed5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:41.826836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503cf05-34c3-4461-8ab9-aa9bed5ed5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:41.828750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503cf05-34c3-4461-8ab9-aa9bed5ed5a1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:41.839394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1371/2761] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:41.843435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571b44-e7bf-4dd7-8e58-3bd9acf813ec admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:41.853917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571b44-e7bf-4dd7-8e58-3bd9acf813ec admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:41.858974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0678f5-3130-46e3-b3e5-72e0f90e7c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:41.859657 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0678f5-3130-46e3-b3e5-72e0f90e7c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:41.859933 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0678f5-3130-46e3-b3e5-72e0f90e7c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:41.860203 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0678f5-3130-46e3-b3e5-72e0f90e7c30 admin admin] PATH_INFO: `/v3/projects/77bd6b83c5684be8b54ba8c658f0c0d5/users/19dc1ff3f00f4c92a9490b0fe847f86e/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:41.876004 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0678f5-3130-46e3-b3e5-72e0f90e7c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bd6b83c5684be8b54ba8c658f0c0d5, user_id=19dc1ff3f00f4c92a9490b0fe847f86e, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:41.878648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0678f5-3130-46e3-b3e5-72e0f90e7c30 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:41.893668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1391/2762] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:41 2022] PUT /identity/v3/projects/77bd6b83c5684be8b54ba8c658f0c0d5/users/19dc1ff3f00f4c92a9490b0fe847f86e/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:41.958295 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad2371-620b-4ecf-86f1-9a11f7f5bb02 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:41.958575 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad2371-620b-4ecf-86f1-9a11f7f5bb02 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:41.958847 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad2371-620b-4ecf-86f1-9a11f7f5bb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:41.987780 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-27ad2371-620b-4ecf-86f1-9a11f7f5bb02 None None] MFA Rules not processed for user `19dc1ff3f00f4c92a9490b0fe847f86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:41.988664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-27ad2371-620b-4ecf-86f1-9a11f7f5bb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:42.051969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1372/2763] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:42.064799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0678f5-3130-46e3-b3e5-72e0f90e7c30 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:42.066579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ba0678f5-3130-46e3-b3e5-72e0f90e7c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:42.124050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0678f5-3130-46e3-b3e5-72e0f90e7c30 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:42.127605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258a4f8-80f1-42ed-9958-c7e291b90fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:42.128195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258a4f8-80f1-42ed-9958-c7e291b90fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:42.128467 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258a4f8-80f1-42ed-9958-c7e291b90fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:42.128734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258a4f8-80f1-42ed-9958-c7e291b90fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:42.136876 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258a4f8-80f1-42ed-9958-c7e291b90fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:42.138292 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258a4f8-80f1-42ed-9958-c7e291b90fb7 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:42.146958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1392/2764] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:42 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:42:42.776461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad2371-620b-4ecf-86f1-9a11f7f5bb02 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:42.786110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad2371-620b-4ecf-86f1-9a11f7f5bb02 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:42.789597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7486382-98c8-4d70-b4ce-a37411bdeda5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:42.790178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486382-98c8-4d70-b4ce-a37411bdeda5 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:42.790454 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486382-98c8-4d70-b4ce-a37411bdeda5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:42.790718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486382-98c8-4d70-b4ce-a37411bdeda5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:42.792609 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c7486382-98c8-4d70-b4ce-a37411bdeda5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:42.857871 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7486382-98c8-4d70-b4ce-a37411bdeda5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:42.859502 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7486382-98c8-4d70-b4ce-a37411bdeda5 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:42.868925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1373/2765] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:44.045530 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258a4f8-80f1-42ed-9958-c7e291b90fb7 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:44.047139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8258a4f8-80f1-42ed-9958-c7e291b90fb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:44.062502 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:44.113679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258a4f8-80f1-42ed-9958-c7e291b90fb7 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:44.118364 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:44.118987 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:44.119314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:44.119608 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] PATH_INFO: `/v3/users/ba27cac397e449c2bba4ed5ecd6be0aa` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:44.120738 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba27cac397e449c2bba4ed5ecd6be0aa)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:44.122643 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:44.175447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba27cac397e449c2bba4ed5ecd6be0aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:44.184176 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba27cac397e449c2bba4ed5ecd6be0aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:44.193906 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba27cac397e449c2bba4ed5ecd6be0aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:44.194524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba27cac397e449c2bba4ed5ecd6be0aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:44.212797 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba27cac397e449c2bba4ed5ecd6be0aa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:44.219737 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1393/2766] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:44 2022] DELETE /identity/v3/users/ba27cac397e449c2bba4ed5ecd6be0aa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:44.402516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7486382-98c8-4d70-b4ce-a37411bdeda5 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:44.414256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7486382-98c8-4d70-b4ce-a37411bdeda5 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:44.441494 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:44.473434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb36af-468e-4345-824a-e8f64121c7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:44.474073 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb36af-468e-4345-824a-e8f64121c7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:44.474349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb36af-468e-4345-824a-e8f64121c7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:44.474616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb36af-468e-4345-824a-e8f64121c7b8 admin admin] PATH_INFO: `/v3/projects/30350f7212254bb3a5069d5f653f9625` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:44.475749 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb36af-468e-4345-824a-e8f64121c7b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30350f7212254bb3a5069d5f653f9625)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:44.477633 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb36af-468e-4345-824a-e8f64121c7b8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:44.522653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bddb36af-468e-4345-824a-e8f64121c7b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30350f7212254bb3a5069d5f653f9625', 'request_id': 'req-bddb36af-468e-4345-824a-e8f64121c7b8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:44.528559 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bddb36af-468e-4345-824a-e8f64121c7b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30350f7212254bb3a5069d5f653f9625', 'request_id': 'req-bddb36af-468e-4345-824a-e8f64121c7b8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:44.534338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bddb36af-468e-4345-824a-e8f64121c7b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30350f7212254bb3a5069d5f653f9625', 'request_id': 'req-bddb36af-468e-4345-824a-e8f64121c7b8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:44.547171 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bddb36af-468e-4345-824a-e8f64121c7b8 admin admin] The token cache is being invalidate because project 30350f7212254bb3a5069d5f653f9625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:44.547466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bddb36af-468e-4345-824a-e8f64121c7b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:44.548047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bddb36af-468e-4345-824a-e8f64121c7b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:44.549480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1374/2767] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:44 2022] DELETE /identity/v3/projects/30350f7212254bb3a5069d5f653f9625 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:42:47.145560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:47.146955 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:47.160294 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b9bb4-7c6f-46de-a544-492a7909fa1c admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:47.216210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:47.216823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:47.217098 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:47.217370 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] PATH_INFO: `/v3/users/19dc1ff3f00f4c92a9490b0fe847f86e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:47.218489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19dc1ff3f00f4c92a9490b0fe847f86e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:47.220401 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:47.266161 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:47.276464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19dc1ff3f00f4c92a9490b0fe847f86e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:47.284464 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19dc1ff3f00f4c92a9490b0fe847f86e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:47.291984 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19dc1ff3f00f4c92a9490b0fe847f86e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:47.292596 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19dc1ff3f00f4c92a9490b0fe847f86e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:47.304142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19dc1ff3f00f4c92a9490b0fe847f86e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:47.310485 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1394/2768] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:47 2022] DELETE /identity/v3/users/19dc1ff3f00f4c92a9490b0fe847f86e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:47.314887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4549e-8512-4741-a0fb-021addc00dc8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:47.315417 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4549e-8512-4741-a0fb-021addc00dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:47.315545 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4549e-8512-4741-a0fb-021addc00dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:47.333395 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7ed4549e-8512-4741-a0fb-021addc00dc8 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:47.334559 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7ed4549e-8512-4741-a0fb-021addc00dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:47.392300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1375/2769] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:47.402046 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:47.403441 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:47.459461 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789ebe-5933-40d1-aa8f-b912f6e3c11c admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:47.463044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143965c-a167-4b27-aa71-3879ec269c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:47.463654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143965c-a167-4b27-aa71-3879ec269c88 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:47.463924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143965c-a167-4b27-aa71-3879ec269c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:47.464187 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143965c-a167-4b27-aa71-3879ec269c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:47.472904 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143965c-a167-4b27-aa71-3879ec269c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:47.474302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143965c-a167-4b27-aa71-3879ec269c88 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:47.484286 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1395/2770] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:47.753839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4549e-8512-4741-a0fb-021addc00dc8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:47.755785 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7ed4549e-8512-4741-a0fb-021addc00dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:47.768033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4549e-8512-4741-a0fb-021addc00dc8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:47.772605 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624f855-9650-4edd-8393-6966b1f0c10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:47.773925 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624f855-9650-4edd-8393-6966b1f0c10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:47.774263 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624f855-9650-4edd-8393-6966b1f0c10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:47.774535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624f855-9650-4edd-8393-6966b1f0c10c admin admin] PATH_INFO: `/v3/projects/77bd6b83c5684be8b54ba8c658f0c0d5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:47.775658 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624f855-9650-4edd-8393-6966b1f0c10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77bd6b83c5684be8b54ba8c658f0c0d5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:47.777540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624f855-9650-4edd-8393-6966b1f0c10c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:47.823781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f624f855-9650-4edd-8393-6966b1f0c10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77bd6b83c5684be8b54ba8c658f0c0d5', 'request_id': 'req-f624f855-9650-4edd-8393-6966b1f0c10c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:47.829466 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:47.835510 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f624f855-9650-4edd-8393-6966b1f0c10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77bd6b83c5684be8b54ba8c658f0c0d5', 'request_id': 'req-f624f855-9650-4edd-8393-6966b1f0c10c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:47.843216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f624f855-9650-4edd-8393-6966b1f0c10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77bd6b83c5684be8b54ba8c658f0c0d5', 'request_id': 'req-f624f855-9650-4edd-8393-6966b1f0c10c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:47.857806 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f624f855-9650-4edd-8393-6966b1f0c10c admin admin] The token cache is being invalidate because project 77bd6b83c5684be8b54ba8c658f0c0d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:47.858164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f624f855-9650-4edd-8393-6966b1f0c10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:47.858948 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f624f855-9650-4edd-8393-6966b1f0c10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:47.860469 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1376/2771] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:47 2022] DELETE /identity/v3/projects/77bd6b83c5684be8b54ba8c658f0c0d5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:55.336360 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143965c-a167-4b27-aa71-3879ec269c88 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:55.338214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0143965c-a167-4b27-aa71-3879ec269c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:55.350645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143965c-a167-4b27-aa71-3879ec269c88 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:55.405854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:55.406469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:55.406742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:55.407010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] PATH_INFO: `/v3/users/95d78a22ba214982845200d86ad71cf0` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:55.408142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d78a22ba214982845200d86ad71cf0)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:55.410031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:55.455339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d78a22ba214982845200d86ad71cf0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:55.461943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d78a22ba214982845200d86ad71cf0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:55.464090 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:55.469555 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d78a22ba214982845200d86ad71cf0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:55.470320 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d78a22ba214982845200d86ad71cf0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:55.483571 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d78a22ba214982845200d86ad71cf0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:55.489261 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1396/2772] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:55 2022] DELETE /identity/v3/users/95d78a22ba214982845200d86ad71cf0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:55.493707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666bc40-3cef-47c2-a524-1715f3754f59 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:55.494235 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666bc40-3cef-47c2-a524-1715f3754f59 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:55.494349 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666bc40-3cef-47c2-a524-1715f3754f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:55.512892 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9666bc40-3cef-47c2-a524-1715f3754f59 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:55.514086 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9666bc40-3cef-47c2-a524-1715f3754f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:55.571643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1377/2773] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:55.581654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:55.583067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:55.640083 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced00166-7218-4cf4-9a88-37378f222417 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:55.643691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3b7f1-f328-4e35-92f5-6bbdb85c2a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:55.644282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3b7f1-f328-4e35-92f5-6bbdb85c2a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:55.644556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3b7f1-f328-4e35-92f5-6bbdb85c2a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:55.644823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3b7f1-f328-4e35-92f5-6bbdb85c2a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:55.654132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3b7f1-f328-4e35-92f5-6bbdb85c2a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:55.655585 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3b7f1-f328-4e35-92f5-6bbdb85c2a32 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:55.665044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1397/2774] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:42:55.926551 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666bc40-3cef-47c2-a524-1715f3754f59 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:55.928044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9666bc40-3cef-47c2-a524-1715f3754f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:55.940436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666bc40-3cef-47c2-a524-1715f3754f59 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:55.945257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:55.945877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:55.946151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:55.946416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] PATH_INFO: `/v3/projects/f47006c24239413e9da3b459c0871044` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:55.948198 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47006c24239413e9da3b459c0871044)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:55.950080 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:55.997030 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47006c24239413e9da3b459c0871044', 'request_id': 'req-ad98c64e-5dc4-41b9-9772-8431fecddda5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.002408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47006c24239413e9da3b459c0871044', 'request_id': 'req-ad98c64e-5dc4-41b9-9772-8431fecddda5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.008443 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47006c24239413e9da3b459c0871044', 'request_id': 'req-ad98c64e-5dc4-41b9-9772-8431fecddda5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.021583 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] The token cache is being invalidate because project f47006c24239413e9da3b459c0871044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:56.021862 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.022461 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.023946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1378/2775] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:55 2022] DELETE /identity/v3/projects/f47006c24239413e9da3b459c0871044 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:42:56.027926 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3b7f1-f328-4e35-92f5-6bbdb85c2a32 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:56.037620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3b7f1-f328-4e35-92f5-6bbdb85c2a32 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:56.093193 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b742f76-f4b5-4473-a519-083f5a9ab13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:56.093806 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b742f76-f4b5-4473-a519-083f5a9ab13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:56.094077 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b742f76-f4b5-4473-a519-083f5a9ab13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:56.094339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b742f76-f4b5-4473-a519-083f5a9ab13a admin admin] PATH_INFO: `/v3/users/7691b34f15a0439981dbe554cd4822e5` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:56.095466 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b742f76-f4b5-4473-a519-083f5a9ab13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7691b34f15a0439981dbe554cd4822e5)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:56.097348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b742f76-f4b5-4473-a519-083f5a9ab13a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:56.141510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5b742f76-f4b5-4473-a519-083f5a9ab13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7691b34f15a0439981dbe554cd4822e5'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.148035 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5b742f76-f4b5-4473-a519-083f5a9ab13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7691b34f15a0439981dbe554cd4822e5'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.154851 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5b742f76-f4b5-4473-a519-083f5a9ab13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7691b34f15a0439981dbe554cd4822e5'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.155465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5b742f76-f4b5-4473-a519-083f5a9ab13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7691b34f15a0439981dbe554cd4822e5'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.166379 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:56.167640 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5b742f76-f4b5-4473-a519-083f5a9ab13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7691b34f15a0439981dbe554cd4822e5'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.174693 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1398/2776] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:56 2022] DELETE /identity/v3/users/7691b34f15a0439981dbe554cd4822e5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:56.437688 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:56.439369 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:56.452492 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98c64e-5dc4-41b9-9772-8431fecddda5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:56.511563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:56.512297 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:56.512579 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:56.512870 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a admin admin] PATH_INFO: `/v3/projects/da8605197ab54e7b8d59cfa8fb5d958e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:56.514024 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da8605197ab54e7b8d59cfa8fb5d958e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:56.515935 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:56.523960 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:56.562582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8605197ab54e7b8d59cfa8fb5d958e', 'request_id': 'req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.568590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8605197ab54e7b8d59cfa8fb5d958e', 'request_id': 'req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.574467 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8605197ab54e7b8d59cfa8fb5d958e', 'request_id': 'req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.587053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a admin admin] The token cache is being invalidate because project da8605197ab54e7b8d59cfa8fb5d958e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:56.587371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.588503 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8ff867f9-08fb-4bd5-ae7e-9843da112b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:56.589946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1379/2777] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:56 2022] DELETE /identity/v3/projects/da8605197ab54e7b8d59cfa8fb5d958e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:56.594809 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d186-00cb-4cc8-afc0-9e0043a16a44 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:56.595359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d186-00cb-4cc8-afc0-9e0043a16a44 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:56.595359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d186-00cb-4cc8-afc0-9e0043a16a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:56.614944 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a2b8d186-00cb-4cc8-afc0-9e0043a16a44 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:56.616163 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a2b8d186-00cb-4cc8-afc0-9e0043a16a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:56.673294 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1399/2778] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:56.681290 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3e253-a924-485e-9a96-e95e6a79964b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:56.681565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3e253-a924-485e-9a96-e95e6a79964b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:56.681841 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3e253-a924-485e-9a96-e95e6a79964b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:56.701241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-60d3e253-a924-485e-9a96-e95e6a79964b None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:56.702432 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-60d3e253-a924-485e-9a96-e95e6a79964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:56.710304 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1380/2779] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:56.714949 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8d186-00cb-4cc8-afc0-9e0043a16a44 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:56.724497 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8d186-00cb-4cc8-afc0-9e0043a16a44 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:56.729817 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bf4d3-1a14-40df-b419-fee1f58233dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:56.730400 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bf4d3-1a14-40df-b419-fee1f58233dd admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:56.730678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bf4d3-1a14-40df-b419-fee1f58233dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:56.730950 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bf4d3-1a14-40df-b419-fee1f58233dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:56.731630 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bf4d3-1a14-40df-b419-fee1f58233dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:42:56.731931 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bf4d3-1a14-40df-b419-fee1f58233dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:56.733504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bf4d3-1a14-40df-b419-fee1f58233dd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:56.744779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1400/2780] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:42:56.748853 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3e253-a924-485e-9a96-e95e6a79964b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:56.758036 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3e253-a924-485e-9a96-e95e6a79964b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:56.762641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db3236-0c0b-490a-b3af-92c8294fa305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:56.763256 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3236-0c0b-490a-b3af-92c8294fa305 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:56.763531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3236-0c0b-490a-b3af-92c8294fa305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:56.763796 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3236-0c0b-490a-b3af-92c8294fa305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:56.764414 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db3236-0c0b-490a-b3af-92c8294fa305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:56.766327 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db3236-0c0b-490a-b3af-92c8294fa305 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:56.802556 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1381/2781] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:42:56 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:56.806654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bf4d3-1a14-40df-b419-fee1f58233dd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:56.816486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bf4d3-1a14-40df-b419-fee1f58233dd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:56.871551 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ba593-f775-438c-a6ef-d7f827958e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:56.872208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ba593-f775-438c-a6ef-d7f827958e04 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:56.872547 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ba593-f775-438c-a6ef-d7f827958e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:56.872823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ba593-f775-438c-a6ef-d7f827958e04 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:56.873486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ba593-f775-438c-a6ef-d7f827958e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:56.875378 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ba593-f775-438c-a6ef-d7f827958e04 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:56.895866 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1401/2782] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:42:56 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:56.899977 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db3236-0c0b-490a-b3af-92c8294fa305 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:56.910858 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db3236-0c0b-490a-b3af-92c8294fa305 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:56.916434 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f6e11-8b77-46f9-beb9-d75ef34609f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:56.918016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f6e11-8b77-46f9-beb9-d75ef34609f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:56.918016 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f6e11-8b77-46f9-beb9-d75ef34609f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:56.918246 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f6e11-8b77-46f9-beb9-d75ef34609f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:56.918682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f6e11-8b77-46f9-beb9-d75ef34609f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:56.920292 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f6e11-8b77-46f9-beb9-d75ef34609f5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:56.930021 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1382/2783] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:56.934059 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ba593-f775-438c-a6ef-d7f827958e04 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:56.943825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ba593-f775-438c-a6ef-d7f827958e04 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:56.948620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91288402-ff35-42f7-b16b-fe26c7f668e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:56.949206 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91288402-ff35-42f7-b16b-fe26c7f668e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:56.949487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91288402-ff35-42f7-b16b-fe26c7f668e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:56.949759 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91288402-ff35-42f7-b16b-fe26c7f668e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:56.950442 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91288402-ff35-42f7-b16b-fe26c7f668e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:56.952073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91288402-ff35-42f7-b16b-fe26c7f668e2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:56.962400 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1402/2784] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:56.966802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f6e11-8b77-46f9-beb9-d75ef34609f5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:56.977004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f6e11-8b77-46f9-beb9-d75ef34609f5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:56.982257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4d0e6-15c0-45a0-9582-a23ead5b94f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:56.982891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4d0e6-15c0-45a0-9582-a23ead5b94f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:56.983220 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4d0e6-15c0-45a0-9582-a23ead5b94f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:56.988420 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4d0e6-15c0-45a0-9582-a23ead5b94f0 admin admin] PATH_INFO: `/v3/projects/05d5cfbbf70a4b108032cb4610210a73/users/4cc90b605d7b4b7da22af08ccd816ebe/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:56.998214 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4d0e6-15c0-45a0-9582-a23ead5b94f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d5cfbbf70a4b108032cb4610210a73, user_id=4cc90b605d7b4b7da22af08ccd816ebe, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:57.000904 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4d0e6-15c0-45a0-9582-a23ead5b94f0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:57.014049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1383/2785] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:56 2022] PUT /identity/v3/projects/05d5cfbbf70a4b108032cb4610210a73/users/4cc90b605d7b4b7da22af08ccd816ebe/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:57.024454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a237d-14ef-4846-a3d7-c57d30be1237 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:57.024756 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a237d-14ef-4846-a3d7-c57d30be1237 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:57.025010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a237d-14ef-4846-a3d7-c57d30be1237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:57.052260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-822a237d-14ef-4846-a3d7-c57d30be1237 None None] MFA Rules not processed for user `4cc90b605d7b4b7da22af08ccd816ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:57.053446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-822a237d-14ef-4846-a3d7-c57d30be1237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:57.100010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:57.117235 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1403/2786] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:57.122006 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4d0e6-15c0-45a0-9582-a23ead5b94f0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:57.183686 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4d0e6-15c0-45a0-9582-a23ead5b94f0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:57.188343 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f2328-0ba2-45ae-bf7c-d846bcaf412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:57.188874 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f2328-0ba2-45ae-bf7c-d846bcaf412a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:57.189151 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f2328-0ba2-45ae-bf7c-d846bcaf412a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:57.189419 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f2328-0ba2-45ae-bf7c-d846bcaf412a admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:57.190037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f2328-0ba2-45ae-bf7c-d846bcaf412a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:57.191992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f2328-0ba2-45ae-bf7c-d846bcaf412a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:57.218219 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1384/2787] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:42:57 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:57.222343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a237d-14ef-4846-a3d7-c57d30be1237 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:57.232952 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a237d-14ef-4846-a3d7-c57d30be1237 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:57.288359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf819a54-ec45-45c8-b19c-80c0c84b79c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:57.288947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf819a54-ec45-45c8-b19c-80c0c84b79c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:57.289218 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf819a54-ec45-45c8-b19c-80c0c84b79c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:57.289482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf819a54-ec45-45c8-b19c-80c0c84b79c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:57.290083 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf819a54-ec45-45c8-b19c-80c0c84b79c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:57.292003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf819a54-ec45-45c8-b19c-80c0c84b79c8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:57.311960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1404/2788] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:42:57 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:57.315985 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f2328-0ba2-45ae-bf7c-d846bcaf412a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:57.326682 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f2328-0ba2-45ae-bf7c-d846bcaf412a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:57.331400 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026b1f7-5c80-46e0-aae0-a37606256068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:57.331986 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026b1f7-5c80-46e0-aae0-a37606256068 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:57.332260 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026b1f7-5c80-46e0-aae0-a37606256068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:57.332531 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026b1f7-5c80-46e0-aae0-a37606256068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:57.333168 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026b1f7-5c80-46e0-aae0-a37606256068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:57.334745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026b1f7-5c80-46e0-aae0-a37606256068 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:57.336784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:57.347181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1385/2789] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:57.350792 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf819a54-ec45-45c8-b19c-80c0c84b79c8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:57.360593 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf819a54-ec45-45c8-b19c-80c0c84b79c8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:57.365745 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a79407-c666-4000-b1e0-dc85e9837353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:57.366429 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a79407-c666-4000-b1e0-dc85e9837353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:57.366730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a79407-c666-4000-b1e0-dc85e9837353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:57.367028 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a79407-c666-4000-b1e0-dc85e9837353 admin admin] PATH_INFO: `/v3/projects/9691e898da0c41f5ab62d479e0f9f183/users/665aabf95e8d48b687eab4481bcd614b/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:57.382094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a79407-c666-4000-b1e0-dc85e9837353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9691e898da0c41f5ab62d479e0f9f183, user_id=665aabf95e8d48b687eab4481bcd614b, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:57.385492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a79407-c666-4000-b1e0-dc85e9837353 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:57.398260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1405/2790] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:57 2022] PUT /identity/v3/projects/9691e898da0c41f5ab62d479e0f9f183/users/665aabf95e8d48b687eab4481bcd614b/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:57.402272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026b1f7-5c80-46e0-aae0-a37606256068 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:57.412513 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026b1f7-5c80-46e0-aae0-a37606256068 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:57.468646 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98add95-7548-4c4b-a841-80f33f612b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:57.469075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98add95-7548-4c4b-a841-80f33f612b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:57.469353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98add95-7548-4c4b-a841-80f33f612b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:57.469623 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98add95-7548-4c4b-a841-80f33f612b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:57.470266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98add95-7548-4c4b-a841-80f33f612b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:57.471886 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98add95-7548-4c4b-a841-80f33f612b3e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:57.481586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1386/2791] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:57.485778 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a79407-c666-4000-b1e0-dc85e9837353 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:57.496891 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a79407-c666-4000-b1e0-dc85e9837353 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:57.501490 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e2740-70ae-47f1-a2ab-4da92870f94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:57.502127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e2740-70ae-47f1-a2ab-4da92870f94c admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:57.502406 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e2740-70ae-47f1-a2ab-4da92870f94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:57.502680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e2740-70ae-47f1-a2ab-4da92870f94c admin admin] PATH_INFO: `/v3/projects/9691e898da0c41f5ab62d479e0f9f183/users/665aabf95e8d48b687eab4481bcd614b/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:57.504656 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e2740-70ae-47f1-a2ab-4da92870f94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9691e898da0c41f5ab62d479e0f9f183, user_id=665aabf95e8d48b687eab4481bcd614b, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:57.507316 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e2740-70ae-47f1-a2ab-4da92870f94c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:57.517914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1406/2792] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:57 2022] PUT /identity/v3/projects/9691e898da0c41f5ab62d479e0f9f183/users/665aabf95e8d48b687eab4481bcd614b/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:57.529123 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62c71-c89f-4a3f-b2ac-555c5c1854a4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:57.529596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62c71-c89f-4a3f-b2ac-555c5c1854a4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:57.529692 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62c71-c89f-4a3f-b2ac-555c5c1854a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:57.557742 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-20c62c71-c89f-4a3f-b2ac-555c5c1854a4 None None] MFA Rules not processed for user `665aabf95e8d48b687eab4481bcd614b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:57.558964 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-20c62c71-c89f-4a3f-b2ac-555c5c1854a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:57.625027 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1387/2793] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:57.636794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e2740-70ae-47f1-a2ab-4da92870f94c admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:57.638556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8b4e2740-70ae-47f1-a2ab-4da92870f94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:57.695507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e2740-70ae-47f1-a2ab-4da92870f94c admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:57.699726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce4dcb-71d7-4715-a8a0-e875cce63f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:57.700308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce4dcb-71d7-4715-a8a0-e875cce63f9a service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:57.700583 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce4dcb-71d7-4715-a8a0-e875cce63f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:57.700850 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce4dcb-71d7-4715-a8a0-e875cce63f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:57.709556 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce4dcb-71d7-4715-a8a0-e875cce63f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:57.710953 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce4dcb-71d7-4715-a8a0-e875cce63f9a service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:57.720454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1407/2794] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:57.784473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c62c71-c89f-4a3f-b2ac-555c5c1854a4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:57.845784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c62c71-c89f-4a3f-b2ac-555c5c1854a4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:57.850213 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:57.850822 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:57.851108 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:57.851384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] PATH_INFO: `/v3/users/4cc90b605d7b4b7da22af08ccd816ebe` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:57.852488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc90b605d7b4b7da22af08ccd816ebe)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:57.854873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:57.876272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:57.899727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc90b605d7b4b7da22af08ccd816ebe'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:57.906556 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc90b605d7b4b7da22af08ccd816ebe'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:57.907191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc90b605d7b4b7da22af08ccd816ebe'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:57.907784 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc90b605d7b4b7da22af08ccd816ebe'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:57.920347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc90b605d7b4b7da22af08ccd816ebe'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:57.933194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1388/2795] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:57 2022] DELETE /identity/v3/users/4cc90b605d7b4b7da22af08ccd816ebe => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:57.937784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eedbe-dc0e-477c-87b5-1df2994cebc5 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:57.938066 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eedbe-dc0e-477c-87b5-1df2994cebc5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:57.938337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eedbe-dc0e-477c-87b5-1df2994cebc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:57.956606 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c17eedbe-dc0e-477c-87b5-1df2994cebc5 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:57.957787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c17eedbe-dc0e-477c-87b5-1df2994cebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:58.000323 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:58.018409 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1408/2796] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:58.028313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:58.029699 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:58.085989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517ffca-b26b-4ca3-ad05-1fda235c33e3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:58.090120 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb45650-7800-4390-bc03-74f4dd884f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:58.090713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb45650-7800-4390-bc03-74f4dd884f3d service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:58.090992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb45650-7800-4390-bc03-74f4dd884f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:58.091300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb45650-7800-4390-bc03-74f4dd884f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:58.100179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb45650-7800-4390-bc03-74f4dd884f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:58.101590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb45650-7800-4390-bc03-74f4dd884f3d service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:58.111555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1389/2797] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:42:58.379136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eedbe-dc0e-477c-87b5-1df2994cebc5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:58.380667 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c17eedbe-dc0e-477c-87b5-1df2994cebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:58.393538 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eedbe-dc0e-477c-87b5-1df2994cebc5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:58.398217 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:58.398841 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:58.399135 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:58.399405 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] PATH_INFO: `/v3/projects/05d5cfbbf70a4b108032cb4610210a73` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:58.401005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d5cfbbf70a4b108032cb4610210a73)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:58.402910 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:58.449192 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d5cfbbf70a4b108032cb4610210a73', 'request_id': 'req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:58.454499 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d5cfbbf70a4b108032cb4610210a73', 'request_id': 'req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:58.460533 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d5cfbbf70a4b108032cb4610210a73', 'request_id': 'req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:58.473092 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] The token cache is being invalidate because project 05d5cfbbf70a4b108032cb4610210a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:58.473377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:58.473992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:58.475507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1409/2798] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:58 2022] DELETE /identity/v3/projects/05d5cfbbf70a4b108032cb4610210a73 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:58.480024 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb45650-7800-4390-bc03-74f4dd884f3d service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:58.489518 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb45650-7800-4390-bc03-74f4dd884f3d service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:58.543689 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69325f17-fb1d-4a46-b015-8cd85c8fdf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:58.544311 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69325f17-fb1d-4a46-b015-8cd85c8fdf29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:58.544596 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69325f17-fb1d-4a46-b015-8cd85c8fdf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:58.544865 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69325f17-fb1d-4a46-b015-8cd85c8fdf29 admin admin] PATH_INFO: `/v3/users/665aabf95e8d48b687eab4481bcd614b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:58.545979 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69325f17-fb1d-4a46-b015-8cd85c8fdf29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665aabf95e8d48b687eab4481bcd614b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:58.547927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69325f17-fb1d-4a46-b015-8cd85c8fdf29 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:58.591640 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:58.594512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-69325f17-fb1d-4a46-b015-8cd85c8fdf29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665aabf95e8d48b687eab4481bcd614b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:58.602805 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-69325f17-fb1d-4a46-b015-8cd85c8fdf29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665aabf95e8d48b687eab4481bcd614b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:58.603627 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-69325f17-fb1d-4a46-b015-8cd85c8fdf29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665aabf95e8d48b687eab4481bcd614b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:58.604520 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-69325f17-fb1d-4a46-b015-8cd85c8fdf29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665aabf95e8d48b687eab4481bcd614b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:58.616223 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-69325f17-fb1d-4a46-b015-8cd85c8fdf29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665aabf95e8d48b687eab4481bcd614b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:58.627943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1390/2799] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:42:58 2022] DELETE /identity/v3/users/665aabf95e8d48b687eab4481bcd614b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:58.899771 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:58.901387 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:58.914922 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46802a-87fe-4ffe-9b8c-7d959b1d74ab admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:58.973036 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e0345-54eb-487a-9a51-30b5bab57382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:58.973663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e0345-54eb-487a-9a51-30b5bab57382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:58.973939 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e0345-54eb-487a-9a51-30b5bab57382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:58.974208 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e0345-54eb-487a-9a51-30b5bab57382 admin admin] PATH_INFO: `/v3/projects/9691e898da0c41f5ab62d479e0f9f183` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:58.975386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e0345-54eb-487a-9a51-30b5bab57382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9691e898da0c41f5ab62d479e0f9f183)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:58.977274 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e0345-54eb-487a-9a51-30b5bab57382 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.023821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ef8e0345-54eb-487a-9a51-30b5bab57382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9691e898da0c41f5ab62d479e0f9f183', 'request_id': 'req-ef8e0345-54eb-487a-9a51-30b5bab57382'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:59.029125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ef8e0345-54eb-487a-9a51-30b5bab57382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9691e898da0c41f5ab62d479e0f9f183', 'request_id': 'req-ef8e0345-54eb-487a-9a51-30b5bab57382'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:59.035025 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ef8e0345-54eb-487a-9a51-30b5bab57382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9691e898da0c41f5ab62d479e0f9f183', 'request_id': 'req-ef8e0345-54eb-487a-9a51-30b5bab57382'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:59.044924 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:59.048825 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ef8e0345-54eb-487a-9a51-30b5bab57382 admin admin] The token cache is being invalidate because project 9691e898da0c41f5ab62d479e0f9f183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:42:59.049291 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ef8e0345-54eb-487a-9a51-30b5bab57382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:59.050348 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ef8e0345-54eb-487a-9a51-30b5bab57382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:42:59.051996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1410/2800] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:42:58 2022] DELETE /identity/v3/projects/9691e898da0c41f5ab62d479e0f9f183 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:59.057594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5809f2-781e-44cb-92d6-8aab1ac62b84 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.057883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5809f2-781e-44cb-92d6-8aab1ac62b84 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.058462 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5809f2-781e-44cb-92d6-8aab1ac62b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.078497 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cf5809f2-781e-44cb-92d6-8aab1ac62b84 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:59.079653 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cf5809f2-781e-44cb-92d6-8aab1ac62b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:59.137651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1391/2801] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:59.145560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75effc8-78c6-4b1e-96d8-aeff1b71c077 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.145844 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75effc8-78c6-4b1e-96d8-aeff1b71c077 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.146113 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75effc8-78c6-4b1e-96d8-aeff1b71c077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.166442 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d75effc8-78c6-4b1e-96d8-aeff1b71c077 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:59.167687 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d75effc8-78c6-4b1e-96d8-aeff1b71c077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:59.175465 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1411/2802] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:59.179628 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5809f2-781e-44cb-92d6-8aab1ac62b84 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:59.189251 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5809f2-781e-44cb-92d6-8aab1ac62b84 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:59.193867 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61353d9e-f797-40c9-9a2c-5eb2672f905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:59.194451 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61353d9e-f797-40c9-9a2c-5eb2672f905b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.194741 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61353d9e-f797-40c9-9a2c-5eb2672f905b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.195013 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61353d9e-f797-40c9-9a2c-5eb2672f905b admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.195690 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61353d9e-f797-40c9-9a2c-5eb2672f905b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:42:59.196037 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61353d9e-f797-40c9-9a2c-5eb2672f905b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:59.197635 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61353d9e-f797-40c9-9a2c-5eb2672f905b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.208727 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1392/2803] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:42:59.213347 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75effc8-78c6-4b1e-96d8-aeff1b71c077 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:59.222281 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75effc8-78c6-4b1e-96d8-aeff1b71c077 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:59.226883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d98c5-a508-4f55-a99b-a54894524364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:59.227504 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d98c5-a508-4f55-a99b-a54894524364 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.227781 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d98c5-a508-4f55-a99b-a54894524364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.228075 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d98c5-a508-4f55-a99b-a54894524364 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.229293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d98c5-a508-4f55-a99b-a54894524364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:59.231195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d98c5-a508-4f55-a99b-a54894524364 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.257326 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1412/2804] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:42:59 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:59.261877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61353d9e-f797-40c9-9a2c-5eb2672f905b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:59.271835 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61353d9e-f797-40c9-9a2c-5eb2672f905b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:59.327655 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c6a99-fc48-456a-b9fd-69f9be14656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:59.328236 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c6a99-fc48-456a-b9fd-69f9be14656c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.328569 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c6a99-fc48-456a-b9fd-69f9be14656c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.328777 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c6a99-fc48-456a-b9fd-69f9be14656c admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.329410 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c6a99-fc48-456a-b9fd-69f9be14656c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:59.331303 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c6a99-fc48-456a-b9fd-69f9be14656c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.351909 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1393/2805] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:42:59 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:42:59.356255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d98c5-a508-4f55-a99b-a54894524364 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:59.366357 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d98c5-a508-4f55-a99b-a54894524364 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:59.370999 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5959a-5a14-4764-9209-9e7f045e1a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:59.371611 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5959a-5a14-4764-9209-9e7f045e1a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.371907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5959a-5a14-4764-9209-9e7f045e1a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.372172 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5959a-5a14-4764-9209-9e7f045e1a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.372802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5959a-5a14-4764-9209-9e7f045e1a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:59.374358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5959a-5a14-4764-9209-9e7f045e1a80 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.384022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1413/2806] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:59.388280 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c6a99-fc48-456a-b9fd-69f9be14656c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:59.398158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c6a99-fc48-456a-b9fd-69f9be14656c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:59.403499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3085c5d-5098-4f29-a45a-9f87eb3f57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:59.404079 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3085c5d-5098-4f29-a45a-9f87eb3f57e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.404351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3085c5d-5098-4f29-a45a-9f87eb3f57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.404615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3085c5d-5098-4f29-a45a-9f87eb3f57e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.405251 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3085c5d-5098-4f29-a45a-9f87eb3f57e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:59.406809 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3085c5d-5098-4f29-a45a-9f87eb3f57e7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.417491 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1394/2807] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:59.421327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5959a-5a14-4764-9209-9e7f045e1a80 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:59.430943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5959a-5a14-4764-9209-9e7f045e1a80 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:59.436065 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d32cf6-437c-4316-8e41-f4d22f652b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:59.436689 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d32cf6-437c-4316-8e41-f4d22f652b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.436961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d32cf6-437c-4316-8e41-f4d22f652b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.437226 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d32cf6-437c-4316-8e41-f4d22f652b47 admin admin] PATH_INFO: `/v3/projects/31966e775e8c48aaaaf4bf8614f4cf8c/users/6d00614a2d4547beb5189706e9f7451c/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.455303 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d32cf6-437c-4316-8e41-f4d22f652b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31966e775e8c48aaaaf4bf8614f4cf8c, user_id=6d00614a2d4547beb5189706e9f7451c, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:59.457965 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d32cf6-437c-4316-8e41-f4d22f652b47 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.471727 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1414/2808] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:59 2022] PUT /identity/v3/projects/31966e775e8c48aaaaf4bf8614f4cf8c/users/6d00614a2d4547beb5189706e9f7451c/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:59.481967 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c4f5-3b84-49e3-b6d9-b42c5da5a0e2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.482245 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c4f5-3b84-49e3-b6d9-b42c5da5a0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.482514 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c4f5-3b84-49e3-b6d9-b42c5da5a0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.509398 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d7b8c4f5-3b84-49e3-b6d9-b42c5da5a0e2 None None] MFA Rules not processed for user `6d00614a2d4547beb5189706e9f7451c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:42:59.511177 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d7b8c4f5-3b84-49e3-b6d9-b42c5da5a0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:42:59.523555 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:59.579345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1395/2809] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:42:59.583871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d32cf6-437c-4316-8e41-f4d22f652b47 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:59.646447 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d32cf6-437c-4316-8e41-f4d22f652b47 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:59.651102 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8065faf-33c0-4513-8677-6ffbbcdfe99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:59.651694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065faf-33c0-4513-8677-6ffbbcdfe99b admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.651970 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065faf-33c0-4513-8677-6ffbbcdfe99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.652266 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065faf-33c0-4513-8677-6ffbbcdfe99b admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.652871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8065faf-33c0-4513-8677-6ffbbcdfe99b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:59.654746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8065faf-33c0-4513-8677-6ffbbcdfe99b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.679491 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1415/2810] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:42:59 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:42:59.684126 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c4f5-3b84-49e3-b6d9-b42c5da5a0e2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:59.694582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c4f5-3b84-49e3-b6d9-b42c5da5a0e2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:59.748651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e673a08-8daf-433e-8a99-1846438a33d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:59.749241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e673a08-8daf-433e-8a99-1846438a33d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.749512 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e673a08-8daf-433e-8a99-1846438a33d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.749775 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e673a08-8daf-433e-8a99-1846438a33d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.750386 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e673a08-8daf-433e-8a99-1846438a33d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:59.752300 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e673a08-8daf-433e-8a99-1846438a33d6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.773111 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1396/2811] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:42:59 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:42:59.777282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8065faf-33c0-4513-8677-6ffbbcdfe99b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:59.787733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8065faf-33c0-4513-8677-6ffbbcdfe99b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:59.792264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972141a-2f58-4acb-8e3b-2e71ae2996ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:59.792843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972141a-2f58-4acb-8e3b-2e71ae2996ba admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.793118 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972141a-2f58-4acb-8e3b-2e71ae2996ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.793387 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972141a-2f58-4acb-8e3b-2e71ae2996ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.794022 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972141a-2f58-4acb-8e3b-2e71ae2996ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:59.795614 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972141a-2f58-4acb-8e3b-2e71ae2996ba admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.805760 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1416/2812] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:59.810242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e673a08-8daf-433e-8a99-1846438a33d6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:59.819831 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e673a08-8daf-433e-8a99-1846438a33d6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:59.824989 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347491b2-e663-4240-9a0c-890e415fea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:59.825613 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347491b2-e663-4240-9a0c-890e415fea97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.825911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347491b2-e663-4240-9a0c-890e415fea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.826178 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347491b2-e663-4240-9a0c-890e415fea97 admin admin] PATH_INFO: `/v3/projects/4bf9667bc03f4b41919edeab347e92e2/users/6d70076cd974488ca15a745f0a270516/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.841028 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347491b2-e663-4240-9a0c-890e415fea97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf9667bc03f4b41919edeab347e92e2, user_id=6d70076cd974488ca15a745f0a270516, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:59.843622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347491b2-e663-4240-9a0c-890e415fea97 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.856678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1397/2813] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:59 2022] PUT /identity/v3/projects/4bf9667bc03f4b41919edeab347e92e2/users/6d70076cd974488ca15a745f0a270516/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:59.860786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972141a-2f58-4acb-8e3b-2e71ae2996ba admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:59.870736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972141a-2f58-4acb-8e3b-2e71ae2996ba admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:59.925731 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9528b-23e6-4bbc-a633-99f2f152fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:59.926336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9528b-23e6-4bbc-a633-99f2f152fe3f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.926576 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9528b-23e6-4bbc-a633-99f2f152fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.926842 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9528b-23e6-4bbc-a633-99f2f152fe3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.927501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9528b-23e6-4bbc-a633-99f2f152fe3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:59.929064 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9528b-23e6-4bbc-a633-99f2f152fe3f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.938335 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1417/2814] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:42:59.942488 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347491b2-e663-4240-9a0c-890e415fea97 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:42:59.952565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347491b2-e663-4240-9a0c-890e415fea97 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:42:59.957133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c880001-7b25-4542-ba64-06d403c302bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:42:59.957767 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c880001-7b25-4542-ba64-06d403c302bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.958039 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c880001-7b25-4542-ba64-06d403c302bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.958306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c880001-7b25-4542-ba64-06d403c302bc admin admin] PATH_INFO: `/v3/projects/4bf9667bc03f4b41919edeab347e92e2/users/6d70076cd974488ca15a745f0a270516/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.960212 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c880001-7b25-4542-ba64-06d403c302bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf9667bc03f4b41919edeab347e92e2, user_id=6d70076cd974488ca15a745f0a270516, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:42:59.963365 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c880001-7b25-4542-ba64-06d403c302bc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:42:59.973353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1398/2815] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:42:59 2022] PUT /identity/v3/projects/4bf9667bc03f4b41919edeab347e92e2/users/6d70076cd974488ca15a745f0a270516/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:42:59.984907 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141fafe-5efe-4cbc-8ad4-6b3b6bc28360 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:42:59.985186 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141fafe-5efe-4cbc-8ad4-6b3b6bc28360 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:42:59.985453 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141fafe-5efe-4cbc-8ad4-6b3b6bc28360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:42:59.999920 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:00.014419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e141fafe-5efe-4cbc-8ad4-6b3b6bc28360 None None] MFA Rules not processed for user `6d70076cd974488ca15a745f0a270516`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:00.015659 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e141fafe-5efe-4cbc-8ad4-6b3b6bc28360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:00.085001 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1418/2816] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:42:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:00.096155 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c880001-7b25-4542-ba64-06d403c302bc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:00.097802 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0c880001-7b25-4542-ba64-06d403c302bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:00.154581 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c880001-7b25-4542-ba64-06d403c302bc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:00.158162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89242f-3070-447c-9a54-4361ddc36829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:00.158748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89242f-3070-447c-9a54-4361ddc36829 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:00.159018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89242f-3070-447c-9a54-4361ddc36829 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:00.159311 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89242f-3070-447c-9a54-4361ddc36829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:00.168773 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89242f-3070-447c-9a54-4361ddc36829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:00.170181 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89242f-3070-447c-9a54-4361ddc36829 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:00.179322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1399/2817] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:00.702601 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141fafe-5efe-4cbc-8ad4-6b3b6bc28360 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:00.763510 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141fafe-5efe-4cbc-8ad4-6b3b6bc28360 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:00.767957 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:00.768569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:00.768878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:00.769149 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] PATH_INFO: `/v3/users/6d00614a2d4547beb5189706e9f7451c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:00.770242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d00614a2d4547beb5189706e9f7451c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:00.772168 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:00.815947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d00614a2d4547beb5189706e9f7451c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:00.823255 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d00614a2d4547beb5189706e9f7451c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:00.829847 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d00614a2d4547beb5189706e9f7451c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:00.830495 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d00614a2d4547beb5189706e9f7451c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:00.842878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d00614a2d4547beb5189706e9f7451c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:00.848598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1419/2818] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:43:00 2022] DELETE /identity/v3/users/6d00614a2d4547beb5189706e9f7451c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:00.853018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73eea7-c06e-475a-83f8-916ea79d5dd6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:00.853530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73eea7-c06e-475a-83f8-916ea79d5dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:00.853530 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73eea7-c06e-475a-83f8-916ea79d5dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:00.871615 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1e73eea7-c06e-475a-83f8-916ea79d5dd6 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:00.872723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1e73eea7-c06e-475a-83f8-916ea79d5dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:00.877567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:00.933145 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1400/2819] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:00.942654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:00.944094 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:00.958598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:01.006377 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4604-fa1f-4396-b865-79eaf398a5f9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:01.010463 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05701c6c-e48f-4ba6-b39b-3f131db540d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:01.011052 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05701c6c-e48f-4ba6-b39b-3f131db540d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:01.011413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05701c6c-e48f-4ba6-b39b-3f131db540d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:01.011677 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05701c6c-e48f-4ba6-b39b-3f131db540d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:01.020419 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05701c6c-e48f-4ba6-b39b-3f131db540d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:01.021813 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05701c6c-e48f-4ba6-b39b-3f131db540d9 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:01.031729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1420/2820] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:01.302445 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73eea7-c06e-475a-83f8-916ea79d5dd6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:01.303995 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1e73eea7-c06e-475a-83f8-916ea79d5dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:01.316484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73eea7-c06e-475a-83f8-916ea79d5dd6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:01.321101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:01.321723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:01.322066 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:01.322823 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] PATH_INFO: `/v3/projects/31966e775e8c48aaaaf4bf8614f4cf8c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:01.323969 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] RBAC: Authorizing `identity:delete_project(project_id=31966e775e8c48aaaaf4bf8614f4cf8c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:01.325873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:01.371447 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31966e775e8c48aaaaf4bf8614f4cf8c', 'request_id': 'req-c33d6987-015a-426d-9c12-cdfcb7c8a4be'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.377105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31966e775e8c48aaaaf4bf8614f4cf8c', 'request_id': 'req-c33d6987-015a-426d-9c12-cdfcb7c8a4be'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.383074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31966e775e8c48aaaaf4bf8614f4cf8c', 'request_id': 'req-c33d6987-015a-426d-9c12-cdfcb7c8a4be'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.396306 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] The token cache is being invalidate because project 31966e775e8c48aaaaf4bf8614f4cf8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:43:01.396595 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.397204 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.398673 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1401/2821] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:43:01 2022] DELETE /identity/v3/projects/31966e775e8c48aaaaf4bf8614f4cf8c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:01.402698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05701c6c-e48f-4ba6-b39b-3f131db540d9 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:01.412676 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05701c6c-e48f-4ba6-b39b-3f131db540d9 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:01.470575 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61522e00-071b-4ebf-91a5-72a72023b2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:01.471256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61522e00-071b-4ebf-91a5-72a72023b2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:01.471536 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61522e00-071b-4ebf-91a5-72a72023b2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:01.471810 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61522e00-071b-4ebf-91a5-72a72023b2a0 admin admin] PATH_INFO: `/v3/users/6d70076cd974488ca15a745f0a270516` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:01.473003 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61522e00-071b-4ebf-91a5-72a72023b2a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d70076cd974488ca15a745f0a270516)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:01.475012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61522e00-071b-4ebf-91a5-72a72023b2a0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:01.531055 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-61522e00-071b-4ebf-91a5-72a72023b2a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d70076cd974488ca15a745f0a270516'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.537987 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-61522e00-071b-4ebf-91a5-72a72023b2a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d70076cd974488ca15a745f0a270516'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.545722 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-61522e00-071b-4ebf-91a5-72a72023b2a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d70076cd974488ca15a745f0a270516'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.546367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-61522e00-071b-4ebf-91a5-72a72023b2a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d70076cd974488ca15a745f0a270516'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.558736 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-61522e00-071b-4ebf-91a5-72a72023b2a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d70076cd974488ca15a745f0a270516'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.568669 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1421/2822] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:43:01 2022] DELETE /identity/v3/users/6d70076cd974488ca15a745f0a270516 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:01.832100 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:01.834329 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:01.849367 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d6987-015a-426d-9c12-cdfcb7c8a4be admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:01.906394 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55c5a6-005a-4625-bdb3-4d36a410e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:01.907060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55c5a6-005a-4625-bdb3-4d36a410e2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:01.907381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55c5a6-005a-4625-bdb3-4d36a410e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:01.907654 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55c5a6-005a-4625-bdb3-4d36a410e2be admin admin] PATH_INFO: `/v3/projects/4bf9667bc03f4b41919edeab347e92e2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:01.908815 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55c5a6-005a-4625-bdb3-4d36a410e2be admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf9667bc03f4b41919edeab347e92e2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:01.910671 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55c5a6-005a-4625-bdb3-4d36a410e2be admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:01.949033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:01.959776 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3f55c5a6-005a-4625-bdb3-4d36a410e2be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf9667bc03f4b41919edeab347e92e2', 'request_id': 'req-3f55c5a6-005a-4625-bdb3-4d36a410e2be'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.965670 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3f55c5a6-005a-4625-bdb3-4d36a410e2be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf9667bc03f4b41919edeab347e92e2', 'request_id': 'req-3f55c5a6-005a-4625-bdb3-4d36a410e2be'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.971639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3f55c5a6-005a-4625-bdb3-4d36a410e2be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf9667bc03f4b41919edeab347e92e2', 'request_id': 'req-3f55c5a6-005a-4625-bdb3-4d36a410e2be'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.984552 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3f55c5a6-005a-4625-bdb3-4d36a410e2be admin admin] The token cache is being invalidate because project 4bf9667bc03f4b41919edeab347e92e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:43:01.984965 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3f55c5a6-005a-4625-bdb3-4d36a410e2be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.985678 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3f55c5a6-005a-4625-bdb3-4d36a410e2be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:01.987266 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1402/2823] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:43:01 2022] DELETE /identity/v3/projects/4bf9667bc03f4b41919edeab347e92e2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:01.992383 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75681a37-61a7-470d-b6fe-f707a88efe38 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:01.992871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75681a37-61a7-470d-b6fe-f707a88efe38 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:01.993048 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75681a37-61a7-470d-b6fe-f707a88efe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.012140 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-75681a37-61a7-470d-b6fe-f707a88efe38 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:02.013312 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-75681a37-61a7-470d-b6fe-f707a88efe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:02.042256 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:02.072918 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1422/2824] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:43:02.080711 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594947b-4c3a-42de-b061-5ae097d6fa10 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.080990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594947b-4c3a-42de-b061-5ae097d6fa10 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.081279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594947b-4c3a-42de-b061-5ae097d6fa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.100702 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2594947b-4c3a-42de-b061-5ae097d6fa10 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:02.101875 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2594947b-4c3a-42de-b061-5ae097d6fa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:02.110445 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1403/2825] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:43:02.114492 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75681a37-61a7-470d-b6fe-f707a88efe38 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:02.124403 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75681a37-61a7-470d-b6fe-f707a88efe38 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:02.128878 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5f0cc-0afe-4368-9e9b-6d1660cd1d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:02.129483 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5f0cc-0afe-4368-9e9b-6d1660cd1d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.129755 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5f0cc-0afe-4368-9e9b-6d1660cd1d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.130019 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5f0cc-0afe-4368-9e9b-6d1660cd1d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.130646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5f0cc-0afe-4368-9e9b-6d1660cd1d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:43:02.130941 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5f0cc-0afe-4368-9e9b-6d1660cd1d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:02.132528 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5f0cc-0afe-4368-9e9b-6d1660cd1d7e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:02.144327 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1423/2826] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:43:02.148408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594947b-4c3a-42de-b061-5ae097d6fa10 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:02.157323 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594947b-4c3a-42de-b061-5ae097d6fa10 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:02.162189 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47520f8d-3af8-4e87-ada3-21f51b89197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:02.162707 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47520f8d-3af8-4e87-ada3-21f51b89197c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.162978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47520f8d-3af8-4e87-ada3-21f51b89197c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.163279 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47520f8d-3af8-4e87-ada3-21f51b89197c admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.163885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47520f8d-3af8-4e87-ada3-21f51b89197c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:02.165750 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47520f8d-3af8-4e87-ada3-21f51b89197c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:02.192048 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1404/2827] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:43:02 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:43:02.196314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5f0cc-0afe-4368-9e9b-6d1660cd1d7e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:02.206598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5f0cc-0afe-4368-9e9b-6d1660cd1d7e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:02.260082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c422c1-97f5-4d4a-a3ac-d2f6098685d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:02.260673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c422c1-97f5-4d4a-a3ac-d2f6098685d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.260947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c422c1-97f5-4d4a-a3ac-d2f6098685d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.261214 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c422c1-97f5-4d4a-a3ac-d2f6098685d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.261828 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c422c1-97f5-4d4a-a3ac-d2f6098685d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:02.263742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c422c1-97f5-4d4a-a3ac-d2f6098685d0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:02.284108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1424/2828] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:43:02 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:43:02.288442 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47520f8d-3af8-4e87-ada3-21f51b89197c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:02.299179 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47520f8d-3af8-4e87-ada3-21f51b89197c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:02.303877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619eee2-f906-49e7-9a12-9a6a11d4b6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:02.304453 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619eee2-f906-49e7-9a12-9a6a11d4b6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.304731 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619eee2-f906-49e7-9a12-9a6a11d4b6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.305002 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619eee2-f906-49e7-9a12-9a6a11d4b6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.305641 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619eee2-f906-49e7-9a12-9a6a11d4b6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:02.307992 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619eee2-f906-49e7-9a12-9a6a11d4b6bc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:02.317782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1405/2829] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:43:02.321472 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c422c1-97f5-4d4a-a3ac-d2f6098685d0 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:02.331159 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c422c1-97f5-4d4a-a3ac-d2f6098685d0 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:02.335790 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fff414-24b4-4ff2-815f-66b7b39ba25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:02.336367 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff414-24b4-4ff2-815f-66b7b39ba25d admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.336646 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff414-24b4-4ff2-815f-66b7b39ba25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.336917 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff414-24b4-4ff2-815f-66b7b39ba25d admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.337552 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fff414-24b4-4ff2-815f-66b7b39ba25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:02.339126 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fff414-24b4-4ff2-815f-66b7b39ba25d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:02.349716 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1425/2830] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:43:02.353832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619eee2-f906-49e7-9a12-9a6a11d4b6bc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:02.363482 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619eee2-f906-49e7-9a12-9a6a11d4b6bc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:02.367978 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44444824-7ca9-4d40-bf90-ba1f9724acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:02.368594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44444824-7ca9-4d40-bf90-ba1f9724acdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.368954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44444824-7ca9-4d40-bf90-ba1f9724acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.369806 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44444824-7ca9-4d40-bf90-ba1f9724acdf admin admin] PATH_INFO: `/v3/projects/211b886b8fd145bc9878d72bcf6bdd4c/users/486e2afcd86a4f2db1fb8af55fa26fe0/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.384371 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44444824-7ca9-4d40-bf90-ba1f9724acdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=211b886b8fd145bc9878d72bcf6bdd4c, user_id=486e2afcd86a4f2db1fb8af55fa26fe0, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:02.387156 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44444824-7ca9-4d40-bf90-ba1f9724acdf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:02.399825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1406/2831] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:43:02 2022] PUT /identity/v3/projects/211b886b8fd145bc9878d72bcf6bdd4c/users/486e2afcd86a4f2db1fb8af55fa26fe0/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:02.411242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027a265-4868-4898-a137-d8d462325501 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.411778 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027a265-4868-4898-a137-d8d462325501 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.412058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027a265-4868-4898-a137-d8d462325501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.439593 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5027a265-4868-4898-a137-d8d462325501 None None] MFA Rules not processed for user `486e2afcd86a4f2db1fb8af55fa26fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:02.440732 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5027a265-4868-4898-a137-d8d462325501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:02.503748 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1426/2832] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:02.508381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44444824-7ca9-4d40-bf90-ba1f9724acdf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:02.568390 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44444824-7ca9-4d40-bf90-ba1f9724acdf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:02.573004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4d716-8ed7-4c43-a8a5-2f6831c64954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:02.573590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4d716-8ed7-4c43-a8a5-2f6831c64954 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.573866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4d716-8ed7-4c43-a8a5-2f6831c64954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.574137 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4d716-8ed7-4c43-a8a5-2f6831c64954 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.574737 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4d716-8ed7-4c43-a8a5-2f6831c64954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:02.576685 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4d716-8ed7-4c43-a8a5-2f6831c64954 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:02.604162 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1407/2833] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:43:02 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:43:02.608290 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027a265-4868-4898-a137-d8d462325501 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:02.618826 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027a265-4868-4898-a137-d8d462325501 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:02.643358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:02.675531 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4747b-24c8-4ecc-94af-7a301c77e561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:02.676130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4747b-24c8-4ecc-94af-7a301c77e561 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.676407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4747b-24c8-4ecc-94af-7a301c77e561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.676678 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4747b-24c8-4ecc-94af-7a301c77e561 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.677297 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4747b-24c8-4ecc-94af-7a301c77e561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:02.679231 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4747b-24c8-4ecc-94af-7a301c77e561 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:02.699835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1427/2834] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:43:02 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:43:02.703735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4d716-8ed7-4c43-a8a5-2f6831c64954 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:02.714345 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4d716-8ed7-4c43-a8a5-2f6831c64954 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:02.718975 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfadaa6-76da-4940-8ae0-707e0e7778fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:02.719620 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfadaa6-76da-4940-8ae0-707e0e7778fc admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.719895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfadaa6-76da-4940-8ae0-707e0e7778fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.720161 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfadaa6-76da-4940-8ae0-707e0e7778fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.720791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfadaa6-76da-4940-8ae0-707e0e7778fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:02.722355 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfadaa6-76da-4940-8ae0-707e0e7778fc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:02.733468 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1408/2835] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:43:02.737559 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4747b-24c8-4ecc-94af-7a301c77e561 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:02.747330 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4747b-24c8-4ecc-94af-7a301c77e561 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:02.751870 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06431f6-a4f5-41a0-8c6c-433b98420ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:02.752501 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06431f6-a4f5-41a0-8c6c-433b98420ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.752774 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06431f6-a4f5-41a0-8c6c-433b98420ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.753044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06431f6-a4f5-41a0-8c6c-433b98420ccb admin admin] PATH_INFO: `/v3/projects/d774569b412e4770ba468b2ebfdc2b81/users/228c22a60a084a868d34411a64e34bd7/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.767369 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06431f6-a4f5-41a0-8c6c-433b98420ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d774569b412e4770ba468b2ebfdc2b81, user_id=228c22a60a084a868d34411a64e34bd7, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:02.770136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06431f6-a4f5-41a0-8c6c-433b98420ccb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:02.783579 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1428/2836] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:43:02 2022] PUT /identity/v3/projects/d774569b412e4770ba468b2ebfdc2b81/users/228c22a60a084a868d34411a64e34bd7/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:43:02.787662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfadaa6-76da-4940-8ae0-707e0e7778fc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:02.797954 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfadaa6-76da-4940-8ae0-707e0e7778fc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:02.829643 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:02.856611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15199f6e-e1fb-40dd-ab13-8ad7367205b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:02.857208 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15199f6e-e1fb-40dd-ab13-8ad7367205b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.857485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15199f6e-e1fb-40dd-ab13-8ad7367205b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.857787 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15199f6e-e1fb-40dd-ab13-8ad7367205b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.858425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15199f6e-e1fb-40dd-ab13-8ad7367205b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:02.860033 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15199f6e-e1fb-40dd-ab13-8ad7367205b8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:02.869594 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1409/2837] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:43:02.873762 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06431f6-a4f5-41a0-8c6c-433b98420ccb admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:02.884142 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06431f6-a4f5-41a0-8c6c-433b98420ccb admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:02.888844 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9d77a-1912-44f6-ba8d-27bedec1722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:02.889493 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9d77a-1912-44f6-ba8d-27bedec1722f admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.889772 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9d77a-1912-44f6-ba8d-27bedec1722f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.890061 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9d77a-1912-44f6-ba8d-27bedec1722f admin admin] PATH_INFO: `/v3/projects/d774569b412e4770ba468b2ebfdc2b81/users/228c22a60a084a868d34411a64e34bd7/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.891993 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9d77a-1912-44f6-ba8d-27bedec1722f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d774569b412e4770ba468b2ebfdc2b81, user_id=228c22a60a084a868d34411a64e34bd7, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:02.894605 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9d77a-1912-44f6-ba8d-27bedec1722f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:02.905325 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1429/2838] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:43:02 2022] PUT /identity/v3/projects/d774569b412e4770ba468b2ebfdc2b81/users/228c22a60a084a868d34411a64e34bd7/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:02.915571 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684be41-99c6-45d7-bcd6-532f81fe1c9f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:02.916664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684be41-99c6-45d7-bcd6-532f81fe1c9f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:02.916664 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684be41-99c6-45d7-bcd6-532f81fe1c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:02.943267 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4684be41-99c6-45d7-bcd6-532f81fe1c9f None None] MFA Rules not processed for user `228c22a60a084a868d34411a64e34bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:02.944450 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4684be41-99c6-45d7-bcd6-532f81fe1c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:03.012746 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1410/2839] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:03.023721 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9d77a-1912-44f6-ba8d-27bedec1722f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:03.026097 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1cb9d77a-1912-44f6-ba8d-27bedec1722f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:03.082402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9d77a-1912-44f6-ba8d-27bedec1722f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:03.085992 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af76ab0-9207-4aa3-a9d5-420685341bb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:03.086570 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76ab0-9207-4aa3-a9d5-420685341bb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:03.086839 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76ab0-9207-4aa3-a9d5-420685341bb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:03.087119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76ab0-9207-4aa3-a9d5-420685341bb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:03.141309 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af76ab0-9207-4aa3-a9d5-420685341bb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:03.142812 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af76ab0-9207-4aa3-a9d5-420685341bb2 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:03.152101 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1430/2840] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:05.677873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684be41-99c6-45d7-bcd6-532f81fe1c9f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:05.738621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684be41-99c6-45d7-bcd6-532f81fe1c9f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:05.743133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:05.743752 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:05.744049 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:05.744299 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] PATH_INFO: `/v3/users/486e2afcd86a4f2db1fb8af55fa26fe0` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:05.745893 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] RBAC: Authorizing `identity:delete_user(user_id=486e2afcd86a4f2db1fb8af55fa26fe0)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:05.747890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:05.794828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486e2afcd86a4f2db1fb8af55fa26fe0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:05.802122 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486e2afcd86a4f2db1fb8af55fa26fe0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:05.802772 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486e2afcd86a4f2db1fb8af55fa26fe0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:05.803388 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486e2afcd86a4f2db1fb8af55fa26fe0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:05.808368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:05.817003 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486e2afcd86a4f2db1fb8af55fa26fe0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:05.830014 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1411/2841] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:43:05 2022] DELETE /identity/v3/users/486e2afcd86a4f2db1fb8af55fa26fe0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:05.834446 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a4fb-fbd8-410a-8c59-b512052218f2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:05.834909 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a4fb-fbd8-410a-8c59-b512052218f2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:05.835009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a4fb-fbd8-410a-8c59-b512052218f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:05.853281 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d560a4fb-fbd8-410a-8c59-b512052218f2 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:05.854450 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d560a4fb-fbd8-410a-8c59-b512052218f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:05.883449 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:05.913020 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1431/2842] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:05.923195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:05.924606 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:05.981735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bb13d-3a45-4c41-aacc-3b50d940647e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:05.985559 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5741f-d5b5-4125-b98c-588167c077b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:05.986164 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5741f-d5b5-4125-b98c-588167c077b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:05.986448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5741f-d5b5-4125-b98c-588167c077b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:05.986718 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5741f-d5b5-4125-b98c-588167c077b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:05.996484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5741f-d5b5-4125-b98c-588167c077b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:05.997913 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5741f-d5b5-4125-b98c-588167c077b8 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:06.007222 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1412/2843] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:06.266696 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560a4fb-fbd8-410a-8c59-b512052218f2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:06.268139 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d560a4fb-fbd8-410a-8c59-b512052218f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:06.281754 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560a4fb-fbd8-410a-8c59-b512052218f2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:06.286276 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:06.287177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:06.287452 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:06.287725 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] PATH_INFO: `/v3/projects/211b886b8fd145bc9878d72bcf6bdd4c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:06.289546 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] RBAC: Authorizing `identity:delete_project(project_id=211b886b8fd145bc9878d72bcf6bdd4c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:06.291467 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:06.337804 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211b886b8fd145bc9878d72bcf6bdd4c', 'request_id': 'req-f87d72ca-e360-407c-ab2a-00bb7174c74d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.343838 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211b886b8fd145bc9878d72bcf6bdd4c', 'request_id': 'req-f87d72ca-e360-407c-ab2a-00bb7174c74d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.350802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211b886b8fd145bc9878d72bcf6bdd4c', 'request_id': 'req-f87d72ca-e360-407c-ab2a-00bb7174c74d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.365267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] The token cache is being invalidate because project 211b886b8fd145bc9878d72bcf6bdd4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:43:06.365558 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.366293 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.367814 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1432/2844] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:43:06 2022] DELETE /identity/v3/projects/211b886b8fd145bc9878d72bcf6bdd4c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:06.371781 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5741f-d5b5-4125-b98c-588167c077b8 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:06.381448 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5741f-d5b5-4125-b98c-588167c077b8 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:06.438866 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2181d-1001-47f7-aaa1-fc040f88328a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:06.439433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2181d-1001-47f7-aaa1-fc040f88328a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:06.439706 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2181d-1001-47f7-aaa1-fc040f88328a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:06.439968 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2181d-1001-47f7-aaa1-fc040f88328a admin admin] PATH_INFO: `/v3/users/228c22a60a084a868d34411a64e34bd7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:06.441061 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2181d-1001-47f7-aaa1-fc040f88328a admin admin] RBAC: Authorizing `identity:delete_user(user_id=228c22a60a084a868d34411a64e34bd7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:06.442933 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2181d-1001-47f7-aaa1-fc040f88328a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:06.488372 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-04a2181d-1001-47f7-aaa1-fc040f88328a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228c22a60a084a868d34411a64e34bd7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.495635 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-04a2181d-1001-47f7-aaa1-fc040f88328a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228c22a60a084a868d34411a64e34bd7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.496184 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-04a2181d-1001-47f7-aaa1-fc040f88328a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228c22a60a084a868d34411a64e34bd7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.496908 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-04a2181d-1001-47f7-aaa1-fc040f88328a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228c22a60a084a868d34411a64e34bd7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.508487 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-04a2181d-1001-47f7-aaa1-fc040f88328a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228c22a60a084a868d34411a64e34bd7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.518050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:06.521425 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1413/2845] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:43:06 2022] DELETE /identity/v3/users/228c22a60a084a868d34411a64e34bd7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:06.796091 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:06.797597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:06.811017 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d72ca-e360-407c-ab2a-00bb7174c74d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:06.867462 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ce8cb-7001-49e9-8450-03503acc34fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:06.868152 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ce8cb-7001-49e9-8450-03503acc34fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:06.868340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ce8cb-7001-49e9-8450-03503acc34fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:06.868607 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ce8cb-7001-49e9-8450-03503acc34fe admin admin] PATH_INFO: `/v3/projects/d774569b412e4770ba468b2ebfdc2b81` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:06.869711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ce8cb-7001-49e9-8450-03503acc34fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d774569b412e4770ba468b2ebfdc2b81)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:06.871661 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ce8cb-7001-49e9-8450-03503acc34fe admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:06.916569 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6c2ce8cb-7001-49e9-8450-03503acc34fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd774569b412e4770ba468b2ebfdc2b81', 'request_id': 'req-6c2ce8cb-7001-49e9-8450-03503acc34fe'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.921861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6c2ce8cb-7001-49e9-8450-03503acc34fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd774569b412e4770ba468b2ebfdc2b81', 'request_id': 'req-6c2ce8cb-7001-49e9-8450-03503acc34fe'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.923679 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:06.928121 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6c2ce8cb-7001-49e9-8450-03503acc34fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd774569b412e4770ba468b2ebfdc2b81', 'request_id': 'req-6c2ce8cb-7001-49e9-8450-03503acc34fe'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.940635 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6c2ce8cb-7001-49e9-8450-03503acc34fe admin admin] The token cache is being invalidate because project d774569b412e4770ba468b2ebfdc2b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:43:06.940919 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6c2ce8cb-7001-49e9-8450-03503acc34fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.941529 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6c2ce8cb-7001-49e9-8450-03503acc34fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:06.942989 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1433/2846] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:43:06 2022] DELETE /identity/v3/projects/d774569b412e4770ba468b2ebfdc2b81 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:43:06.947890 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4673c72-4abe-4189-88ed-5eb4ed9c57d0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:06.948368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4673c72-4abe-4189-88ed-5eb4ed9c57d0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:06.948484 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4673c72-4abe-4189-88ed-5eb4ed9c57d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:06.968850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b4673c72-4abe-4189-88ed-5eb4ed9c57d0 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:06.970101 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b4673c72-4abe-4189-88ed-5eb4ed9c57d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:07.029616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1414/2847] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:43:07.037566 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e669e-0dd9-4872-a4fa-c0c20672ceeb None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:07.037843 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e669e-0dd9-4872-a4fa-c0c20672ceeb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:07.038110 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e669e-0dd9-4872-a4fa-c0c20672ceeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:07.057271 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1f5e669e-0dd9-4872-a4fa-c0c20672ceeb None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:07.058961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1f5e669e-0dd9-4872-a4fa-c0c20672ceeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:07.066956 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1434/2848] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:07.071186 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4673c72-4abe-4189-88ed-5eb4ed9c57d0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:07.081289 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4673c72-4abe-4189-88ed-5eb4ed9c57d0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:07.085816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe0440-4ad2-4b3a-9cdc-0ff8e8b8afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:07.086403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe0440-4ad2-4b3a-9cdc-0ff8e8b8afee admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:07.086674 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe0440-4ad2-4b3a-9cdc-0ff8e8b8afee admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:07.086941 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe0440-4ad2-4b3a-9cdc-0ff8e8b8afee admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:07.087614 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe0440-4ad2-4b3a-9cdc-0ff8e8b8afee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:43:07.087913 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe0440-4ad2-4b3a-9cdc-0ff8e8b8afee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:07.089490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe0440-4ad2-4b3a-9cdc-0ff8e8b8afee admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:07.100677 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1415/2849] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:43:07.104928 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e669e-0dd9-4872-a4fa-c0c20672ceeb None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:07.114050 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e669e-0dd9-4872-a4fa-c0c20672ceeb None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:07.118589 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60843b-5536-4fc3-8507-5096a263ceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:07.119196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60843b-5536-4fc3-8507-5096a263ceda admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:07.119469 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60843b-5536-4fc3-8507-5096a263ceda admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:07.119730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60843b-5536-4fc3-8507-5096a263ceda admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:07.120359 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60843b-5536-4fc3-8507-5096a263ceda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:07.122695 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60843b-5536-4fc3-8507-5096a263ceda admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:07.151861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1435/2850] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:43:07 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:43:07.154549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe0440-4ad2-4b3a-9cdc-0ff8e8b8afee admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:07.164622 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe0440-4ad2-4b3a-9cdc-0ff8e8b8afee admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:07.219207 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9979-ed52-4995-b012-60bd8bd71d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:07.219791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9979-ed52-4995-b012-60bd8bd71d55 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:07.220064 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9979-ed52-4995-b012-60bd8bd71d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:07.220376 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9979-ed52-4995-b012-60bd8bd71d55 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:07.220943 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de9979-ed52-4995-b012-60bd8bd71d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:07.222830 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de9979-ed52-4995-b012-60bd8bd71d55 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:07.243018 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1416/2851] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:43:07 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:43:07.247769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60843b-5536-4fc3-8507-5096a263ceda admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:07.257904 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60843b-5536-4fc3-8507-5096a263ceda admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:07.263073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e859eaf-a3c5-4715-9aa0-904606198277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:07.263674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e859eaf-a3c5-4715-9aa0-904606198277 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:07.263947 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e859eaf-a3c5-4715-9aa0-904606198277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:07.264210 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e859eaf-a3c5-4715-9aa0-904606198277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:07.264868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e859eaf-a3c5-4715-9aa0-904606198277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:07.266416 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e859eaf-a3c5-4715-9aa0-904606198277 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:07.275899 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1436/2852] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:43:07.279744 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9979-ed52-4995-b012-60bd8bd71d55 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:07.289926 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9979-ed52-4995-b012-60bd8bd71d55 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:07.294639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935debe-071c-4e3c-a3e1-f01481589676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:07.295257 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935debe-071c-4e3c-a3e1-f01481589676 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:07.295535 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935debe-071c-4e3c-a3e1-f01481589676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:07.295804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935debe-071c-4e3c-a3e1-f01481589676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:07.296436 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935debe-071c-4e3c-a3e1-f01481589676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:07.298001 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935debe-071c-4e3c-a3e1-f01481589676 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:07.308735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1417/2853] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:43:07.312747 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e859eaf-a3c5-4715-9aa0-904606198277 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:07.322410 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e859eaf-a3c5-4715-9aa0-904606198277 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:07.327537 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513981b-2714-4188-914b-3efa5c90ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:07.328159 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513981b-2714-4188-914b-3efa5c90ab01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:07.328431 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513981b-2714-4188-914b-3efa5c90ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:07.328701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513981b-2714-4188-914b-3efa5c90ab01 admin admin] PATH_INFO: `/v3/projects/292f7225ad194063ad05acbcc20ab528/users/5005785db20b449dbd5ae8ca58112023/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:07.343052 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513981b-2714-4188-914b-3efa5c90ab01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292f7225ad194063ad05acbcc20ab528, user_id=5005785db20b449dbd5ae8ca58112023, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:07.345673 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513981b-2714-4188-914b-3efa5c90ab01 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:07.358264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1437/2854] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:43:07 2022] PUT /identity/v3/projects/292f7225ad194063ad05acbcc20ab528/users/5005785db20b449dbd5ae8ca58112023/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:07.424826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b23a9-1581-4edf-97ce-88ca97c56501 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:07.425106 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b23a9-1581-4edf-97ce-88ca97c56501 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:07.425381 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b23a9-1581-4edf-97ce-88ca97c56501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:07.452527 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-931b23a9-1581-4edf-97ce-88ca97c56501 None None] MFA Rules not processed for user `5005785db20b449dbd5ae8ca58112023`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:07.453713 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-931b23a9-1581-4edf-97ce-88ca97c56501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:07.506032 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:07.516994 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1418/2855] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:07.527718 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513981b-2714-4188-914b-3efa5c90ab01 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:07.529351 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4513981b-2714-4188-914b-3efa5c90ab01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:07.585340 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513981b-2714-4188-914b-3efa5c90ab01 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:07.588962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbbe72-4dd4-45eb-ba25-b1012ad9de32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:07.589597 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbbe72-4dd4-45eb-ba25-b1012ad9de32 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:07.589871 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbbe72-4dd4-45eb-ba25-b1012ad9de32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:07.590136 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbbe72-4dd4-45eb-ba25-b1012ad9de32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:07.601375 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbbe72-4dd4-45eb-ba25-b1012ad9de32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:07.602784 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbbe72-4dd4-45eb-ba25-b1012ad9de32 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:07.612684 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1438/2856] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:08.204004 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b23a9-1581-4edf-97ce-88ca97c56501 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:08.205402 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-931b23a9-1581-4edf-97ce-88ca97c56501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:08.262070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b23a9-1581-4edf-97ce-88ca97c56501 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:08.265642 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8ebc-2f38-4cee-91fd-8ac6b26e8909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:08.266231 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8ebc-2f38-4cee-91fd-8ac6b26e8909 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:08.266504 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8ebc-2f38-4cee-91fd-8ac6b26e8909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:08.266771 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8ebc-2f38-4cee-91fd-8ac6b26e8909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:08.268565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2c3a8ebc-2f38-4cee-91fd-8ac6b26e8909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:08.328639 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8ebc-2f38-4cee-91fd-8ac6b26e8909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:08.330077 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8ebc-2f38-4cee-91fd-8ac6b26e8909 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:08.339974 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1419/2857] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:09.404866 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbbe72-4dd4-45eb-ba25-b1012ad9de32 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:09.414991 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbbe72-4dd4-45eb-ba25-b1012ad9de32 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:09.420411 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6b781-dc8e-42f1-b8c2-d05c9aa987ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:09.421011 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6b781-dc8e-42f1-b8c2-d05c9aa987ea service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:09.421861 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6b781-dc8e-42f1-b8c2-d05c9aa987ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:09.422479 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6b781-dc8e-42f1-b8c2-d05c9aa987ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:09.424247 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-aca6b781-dc8e-42f1-b8c2-d05c9aa987ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:09.502451 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6b781-dc8e-42f1-b8c2-d05c9aa987ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:09.505785 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6b781-dc8e-42f1-b8c2-d05c9aa987ea service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:09.515742 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1439/2858] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:43:10.171624 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8ebc-2f38-4cee-91fd-8ac6b26e8909 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:10.232287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8ebc-2f38-4cee-91fd-8ac6b26e8909 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:10.236745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:10.237350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:10.237621 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:10.237885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] PATH_INFO: `/v3/users/5005785db20b449dbd5ae8ca58112023` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:10.238973 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5005785db20b449dbd5ae8ca58112023)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:10.240895 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:10.286247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5005785db20b449dbd5ae8ca58112023'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:10.289005 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:10.294067 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5005785db20b449dbd5ae8ca58112023'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:10.294709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5005785db20b449dbd5ae8ca58112023'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:10.295360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5005785db20b449dbd5ae8ca58112023'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:10.307862 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5005785db20b449dbd5ae8ca58112023'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:10.320574 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1420/2859] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:43:10 2022] DELETE /identity/v3/users/5005785db20b449dbd5ae8ca58112023 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:10.325730 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0bfe1-24b0-47cf-80a5-69c332a058d6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:10.326012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0bfe1-24b0-47cf-80a5-69c332a058d6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:10.326306 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0bfe1-24b0-47cf-80a5-69c332a058d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:10.344622 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f3d0bfe1-24b0-47cf-80a5-69c332a058d6 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:10.345794 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f3d0bfe1-24b0-47cf-80a5-69c332a058d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:10.353632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:10.406023 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1440/2860] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:10.415900 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:10.417285 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:10.478047 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb9611-1bd9-4a05-ad33-829b166b2f45 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:10.482188 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bed1cf-1f9d-4f19-ab43-364cd7105cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:10.482789 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bed1cf-1f9d-4f19-ab43-364cd7105cec service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:10.483060 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bed1cf-1f9d-4f19-ab43-364cd7105cec service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:10.483353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bed1cf-1f9d-4f19-ab43-364cd7105cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:10.492485 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bed1cf-1f9d-4f19-ab43-364cd7105cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:10.493883 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bed1cf-1f9d-4f19-ab43-364cd7105cec service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:10.503697 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1421/2861] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:10.857108 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0bfe1-24b0-47cf-80a5-69c332a058d6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:10.867132 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0bfe1-24b0-47cf-80a5-69c332a058d6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:10.870611 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffec37-6a17-4815-80cd-ffa7e928af38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:10.871243 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffec37-6a17-4815-80cd-ffa7e928af38 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:10.871522 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffec37-6a17-4815-80cd-ffa7e928af38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:10.871835 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffec37-6a17-4815-80cd-ffa7e928af38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:10.873561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-81ffec37-6a17-4815-80cd-ffa7e928af38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:10.947627 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffec37-6a17-4815-80cd-ffa7e928af38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:10.949063 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffec37-6a17-4815-80cd-ffa7e928af38 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:10.960230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1441/2862] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:43:11.096939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bed1cf-1f9d-4f19-ab43-364cd7105cec service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:11.098375 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-06bed1cf-1f9d-4f19-ab43-364cd7105cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:11.117597 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bed1cf-1f9d-4f19-ab43-364cd7105cec service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:11.131057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed6d4d-fffc-43a6-a5e8-95679304356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:11.131723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed6d4d-fffc-43a6-a5e8-95679304356e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:11.131993 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed6d4d-fffc-43a6-a5e8-95679304356e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:11.132284 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed6d4d-fffc-43a6-a5e8-95679304356e admin admin] PATH_INFO: `/v3/projects/292f7225ad194063ad05acbcc20ab528` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:11.133414 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed6d4d-fffc-43a6-a5e8-95679304356e admin admin] RBAC: Authorizing `identity:delete_project(project_id=292f7225ad194063ad05acbcc20ab528)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:11.135441 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed6d4d-fffc-43a6-a5e8-95679304356e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:11.184894 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-11ed6d4d-fffc-43a6-a5e8-95679304356e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292f7225ad194063ad05acbcc20ab528', 'request_id': 'req-11ed6d4d-fffc-43a6-a5e8-95679304356e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:11.190736 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-11ed6d4d-fffc-43a6-a5e8-95679304356e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292f7225ad194063ad05acbcc20ab528', 'request_id': 'req-11ed6d4d-fffc-43a6-a5e8-95679304356e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:11.197357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-11ed6d4d-fffc-43a6-a5e8-95679304356e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292f7225ad194063ad05acbcc20ab528', 'request_id': 'req-11ed6d4d-fffc-43a6-a5e8-95679304356e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:11.210704 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-11ed6d4d-fffc-43a6-a5e8-95679304356e admin admin] The token cache is being invalidate because project 292f7225ad194063ad05acbcc20ab528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:43:11.210990 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-11ed6d4d-fffc-43a6-a5e8-95679304356e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:11.211676 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-11ed6d4d-fffc-43a6-a5e8-95679304356e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:11.213149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1422/2863] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:43:11 2022] DELETE /identity/v3/projects/292f7225ad194063ad05acbcc20ab528 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:11.218612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75063a3-97c2-484b-abbc-0cf9ba3621a3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:11.218892 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75063a3-97c2-484b-abbc-0cf9ba3621a3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:11.219181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75063a3-97c2-484b-abbc-0cf9ba3621a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:11.238402 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e75063a3-97c2-484b-abbc-0cf9ba3621a3 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:11.239632 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e75063a3-97c2-484b-abbc-0cf9ba3621a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:11.307619 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1442/2864] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:43:11.315347 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4b70d-74b5-457e-a6df-03818de64550 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:11.315705 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4b70d-74b5-457e-a6df-03818de64550 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:11.316063 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4b70d-74b5-457e-a6df-03818de64550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:11.336042 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5cb4b70d-74b5-457e-a6df-03818de64550 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:11.337313 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5cb4b70d-74b5-457e-a6df-03818de64550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:11.346173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1423/2865] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:11.350495 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75063a3-97c2-484b-abbc-0cf9ba3621a3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:11.360413 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75063a3-97c2-484b-abbc-0cf9ba3621a3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:11.365393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7baca-a0fb-402d-85dd-b43070cf210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:11.366056 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7baca-a0fb-402d-85dd-b43070cf210a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:11.366427 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7baca-a0fb-402d-85dd-b43070cf210a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:11.366856 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7baca-a0fb-402d-85dd-b43070cf210a admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:11.367602 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7baca-a0fb-402d-85dd-b43070cf210a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:43:11.367963 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7baca-a0fb-402d-85dd-b43070cf210a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:11.369743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7baca-a0fb-402d-85dd-b43070cf210a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:11.381699 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1443/2866] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:43:11.386720 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4b70d-74b5-457e-a6df-03818de64550 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:11.397216 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4b70d-74b5-457e-a6df-03818de64550 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:11.404075 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726bfb0-fc65-4d41-972a-55ebe78b7c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:11.404821 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726bfb0-fc65-4d41-972a-55ebe78b7c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:11.405136 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726bfb0-fc65-4d41-972a-55ebe78b7c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:11.405505 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726bfb0-fc65-4d41-972a-55ebe78b7c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:11.406242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726bfb0-fc65-4d41-972a-55ebe78b7c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:11.408570 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726bfb0-fc65-4d41-972a-55ebe78b7c5e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:11.439217 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1424/2867] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:43:11 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:43:11.440314 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7baca-a0fb-402d-85dd-b43070cf210a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:11.450711 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7baca-a0fb-402d-85dd-b43070cf210a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:11.474807 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:11.508396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697c7a6-044f-4bfc-a869-06c1c6ccf46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:11.509030 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697c7a6-044f-4bfc-a869-06c1c6ccf46a admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:11.509302 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697c7a6-044f-4bfc-a869-06c1c6ccf46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:11.509568 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697c7a6-044f-4bfc-a869-06c1c6ccf46a admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:11.510181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697c7a6-044f-4bfc-a869-06c1c6ccf46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:11.514701 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697c7a6-044f-4bfc-a869-06c1c6ccf46a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:11.535743 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1444/2868] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:43:11 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:43:11.540083 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726bfb0-fc65-4d41-972a-55ebe78b7c5e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:11.550152 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726bfb0-fc65-4d41-972a-55ebe78b7c5e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:11.554745 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f68b3-11b8-499a-b31e-57b82c23807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:11.555357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f68b3-11b8-499a-b31e-57b82c23807f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:11.555695 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f68b3-11b8-499a-b31e-57b82c23807f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:11.555898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f68b3-11b8-499a-b31e-57b82c23807f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:11.556529 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f68b3-11b8-499a-b31e-57b82c23807f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:11.558865 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f68b3-11b8-499a-b31e-57b82c23807f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:11.569199 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1425/2869] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 22:43:11.573058 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697c7a6-044f-4bfc-a869-06c1c6ccf46a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:11.584392 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697c7a6-044f-4bfc-a869-06c1c6ccf46a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:11.589153 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2edab-6586-49e5-ab39-3ebb0b8c9af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:11.590625 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2edab-6586-49e5-ab39-3ebb0b8c9af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:11.590974 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2edab-6586-49e5-ab39-3ebb0b8c9af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:11.591339 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2edab-6586-49e5-ab39-3ebb0b8c9af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:11.592396 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2edab-6586-49e5-ab39-3ebb0b8c9af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:11.594458 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2edab-6586-49e5-ab39-3ebb0b8c9af7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:11.615315 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1445/2870] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:43:11.616851 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f68b3-11b8-499a-b31e-57b82c23807f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:11.627517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f68b3-11b8-499a-b31e-57b82c23807f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:11.632185 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302817de-b386-49b8-a51e-2f94f65394db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:11.632826 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302817de-b386-49b8-a51e-2f94f65394db admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:11.633117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302817de-b386-49b8-a51e-2f94f65394db admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:11.633366 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302817de-b386-49b8-a51e-2f94f65394db admin admin] PATH_INFO: `/v3/projects/9f097ac3757b4cdd9260237f5d2d6b1a/users/fe1df1c3c944487697e2f4b0d52b414a/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:11.645460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:11.650173 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302817de-b386-49b8-a51e-2f94f65394db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f097ac3757b4cdd9260237f5d2d6b1a, user_id=fe1df1c3c944487697e2f4b0d52b414a, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:11.653103 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302817de-b386-49b8-a51e-2f94f65394db admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:11.670881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1426/2871] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:43:11 2022] PUT /identity/v3/projects/9f097ac3757b4cdd9260237f5d2d6b1a/users/fe1df1c3c944487697e2f4b0d52b414a/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:43:11.681233 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a39ed4-00e4-4680-ab23-b4216657c9de None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:11.681524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a39ed4-00e4-4680-ab23-b4216657c9de None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:11.681787 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a39ed4-00e4-4680-ab23-b4216657c9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:11.713621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-15a39ed4-00e4-4680-ab23-b4216657c9de None None] MFA Rules not processed for user `fe1df1c3c944487697e2f4b0d52b414a`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:11.714859 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-15a39ed4-00e4-4680-ab23-b4216657c9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:11.782069 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1446/2872] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:43:11.793242 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302817de-b386-49b8-a51e-2f94f65394db admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:11.795259 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-302817de-b386-49b8-a51e-2f94f65394db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:11.854053 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302817de-b386-49b8-a51e-2f94f65394db admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:11.858134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1ceb-30fb-4be6-8ca0-7aa6a877acca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfe1875cce3436eac2ac8f4d6db88bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:11.858694 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1ceb-30fb-4be6-8ca0-7aa6a877acca service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:11.858970 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1ceb-30fb-4be6-8ca0-7aa6a877acca service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:11.859368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1ceb-30fb-4be6-8ca0-7aa6a877acca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:11.867957 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1ceb-30fb-4be6-8ca0-7aa6a877acca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:11.869415 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1ceb-30fb-4be6-8ca0-7aa6a877acca service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:11.878803 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1427/2873] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:13.660288 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a39ed4-00e4-4680-ab23-b4216657c9de None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:13.661746 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-15a39ed4-00e4-4680-ab23-b4216657c9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:13.720676 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a39ed4-00e4-4680-ab23-b4216657c9de None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:13.724186 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67251ffc-fe47-4279-9ebf-6e3bf919551a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:13.724776 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67251ffc-fe47-4279-9ebf-6e3bf919551a service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:13.725047 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67251ffc-fe47-4279-9ebf-6e3bf919551a service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:13.725311 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67251ffc-fe47-4279-9ebf-6e3bf919551a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:13.727358 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-67251ffc-fe47-4279-9ebf-6e3bf919551a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:13.779543 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:13.797517 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67251ffc-fe47-4279-9ebf-6e3bf919551a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:13.798930 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67251ffc-fe47-4279-9ebf-6e3bf919551a service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:13.809026 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1447/2874] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:20.047076 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1ceb-30fb-4be6-8ca0-7aa6a877acca service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:20.049221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9c9f1ceb-30fb-4be6-8ca0-7aa6a877acca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:20.070142 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1ceb-30fb-4be6-8ca0-7aa6a877acca service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:20.075241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:20.075856 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:20.076241 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:20.076403 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] PATH_INFO: `/v3/users/1648bd2e192348f585eb3d9c34f7d1de` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:20.077696 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1648bd2e192348f585eb3d9c34f7d1de)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:20.079878 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:20.126262 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1648bd2e192348f585eb3d9c34f7d1de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.133316 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1648bd2e192348f585eb3d9c34f7d1de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.133931 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1648bd2e192348f585eb3d9c34f7d1de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.134533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1648bd2e192348f585eb3d9c34f7d1de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.146194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1648bd2e192348f585eb3d9c34f7d1de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.158734 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1428/2875] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:43:20 2022] DELETE /identity/v3/users/1648bd2e192348f585eb3d9c34f7d1de => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:20.335714 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67251ffc-fe47-4279-9ebf-6e3bf919551a service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:20.346561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67251ffc-fe47-4279-9ebf-6e3bf919551a service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:20.403487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:20.404112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:20.404386 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:20.404726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] PATH_INFO: `/v3/projects/cf6f8629fd764dcf9554661162b2c4a3` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:20.405959 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6f8629fd764dcf9554661162b2c4a3)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:20.407883 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:20.453438 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6f8629fd764dcf9554661162b2c4a3', 'request_id': 'req-66c35294-974b-408b-9031-e5df1069d982'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.458668 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6f8629fd764dcf9554661162b2c4a3', 'request_id': 'req-66c35294-974b-408b-9031-e5df1069d982'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.465328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6f8629fd764dcf9554661162b2c4a3', 'request_id': 'req-66c35294-974b-408b-9031-e5df1069d982'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.477584 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] The token cache is being invalidate because project cf6f8629fd764dcf9554661162b2c4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:43:20.477865 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.479045 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.480554 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1448/2876] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:43:20 2022] DELETE /identity/v3/projects/cf6f8629fd764dcf9554661162b2c4a3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:20.484651 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:20.486062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:20.498998 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4a510-1856-4d20-9634-629dcff2e534 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:20.557183 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:20.557898 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:20.558792 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:20.559240 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] PATH_INFO: `/v3/users/de3d937b838a4679b764d576107a84b0` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:20.560495 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3d937b838a4679b764d576107a84b0)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:20.562599 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:20.567909 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:20.611533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3d937b838a4679b764d576107a84b0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.618557 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3d937b838a4679b764d576107a84b0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.619196 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3d937b838a4679b764d576107a84b0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.619794 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3d937b838a4679b764d576107a84b0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.632149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3d937b838a4679b764d576107a84b0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.644586 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1429/2877] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:43:20 2022] DELETE /identity/v3/users/de3d937b838a4679b764d576107a84b0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:20.816195 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:20.817741 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:20.838242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c35294-974b-408b-9031-e5df1069d982 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:20.894481 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d5bfc-1f42-4670-8b88-1b9e4732acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:20.895162 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d5bfc-1f42-4670-8b88-1b9e4732acc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:20.895435 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d5bfc-1f42-4670-8b88-1b9e4732acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:20.895698 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d5bfc-1f42-4670-8b88-1b9e4732acc3 admin admin] PATH_INFO: `/v3/projects/32ce7ea4ef7d46898b148e15b22299f3` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:20.896788 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d5bfc-1f42-4670-8b88-1b9e4732acc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ce7ea4ef7d46898b148e15b22299f3)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:20.898654 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d5bfc-1f42-4670-8b88-1b9e4732acc3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:20.915015 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:20.945908 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-240d5bfc-1f42-4670-8b88-1b9e4732acc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ce7ea4ef7d46898b148e15b22299f3', 'request_id': 'req-240d5bfc-1f42-4670-8b88-1b9e4732acc3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.951382 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-240d5bfc-1f42-4670-8b88-1b9e4732acc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ce7ea4ef7d46898b148e15b22299f3', 'request_id': 'req-240d5bfc-1f42-4670-8b88-1b9e4732acc3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.957382 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-240d5bfc-1f42-4670-8b88-1b9e4732acc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ce7ea4ef7d46898b148e15b22299f3', 'request_id': 'req-240d5bfc-1f42-4670-8b88-1b9e4732acc3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.969696 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-240d5bfc-1f42-4670-8b88-1b9e4732acc3 admin admin] The token cache is being invalidate because project 32ce7ea4ef7d46898b148e15b22299f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:43:20.970012 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-240d5bfc-1f42-4670-8b88-1b9e4732acc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.970643 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-240d5bfc-1f42-4670-8b88-1b9e4732acc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:20.972166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1449/2878] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:43:20 2022] DELETE /identity/v3/projects/32ce7ea4ef7d46898b148e15b22299f3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:43:22.248490 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:22.249916 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:22.263157 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcf7a4-029e-4695-b30b-c50855501ab9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:22.317839 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:22.318456 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:22.318756 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:22.319023 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] PATH_INFO: `/v3/users/fe1df1c3c944487697e2f4b0d52b414a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:22.320158 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1df1c3c944487697e2f4b0d52b414a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:22.322044 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:22.366302 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1df1c3c944487697e2f4b0d52b414a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:22.373271 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1df1c3c944487697e2f4b0d52b414a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:22.373946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1df1c3c944487697e2f4b0d52b414a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:22.374582 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1df1c3c944487697e2f4b0d52b414a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:22.386338 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1df1c3c944487697e2f4b0d52b414a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:22.399149 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1430/2879] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:43:22 2022] DELETE /identity/v3/users/fe1df1c3c944487697e2f4b0d52b414a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:22.404127 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fcd24-1229-4685-8668-b21a81a96d86 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:22.404621 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fcd24-1229-4685-8668-b21a81a96d86 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:22.404729 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fcd24-1229-4685-8668-b21a81a96d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:22.425393 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-409fcd24-1229-4685-8668-b21a81a96d86 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:22.426598 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-409fcd24-1229-4685-8668-b21a81a96d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:22.485085 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1450/2880] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:22.494836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:22.496252 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:22.502187 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:22.554876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081e9cf-c122-41cc-80d3-551e0b075d52 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:22.558506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce9f1d-bf90-430b-a5e8-ae4ec66d7b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:22.559110 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce9f1d-bf90-430b-a5e8-ae4ec66d7b23 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:22.560000 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce9f1d-bf90-430b-a5e8-ae4ec66d7b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:22.560269 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce9f1d-bf90-430b-a5e8-ae4ec66d7b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:22.569026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce9f1d-bf90-430b-a5e8-ae4ec66d7b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:22.570455 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce9f1d-bf90-430b-a5e8-ae4ec66d7b23 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:22.579951 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1431/2881] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 22:43:22.846879 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fcd24-1229-4685-8668-b21a81a96d86 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:22.848487 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-409fcd24-1229-4685-8668-b21a81a96d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:22.861270 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fcd24-1229-4685-8668-b21a81a96d86 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:22.865852 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137fc42-89cb-4196-91c7-5ebad25a10fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:22.866478 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137fc42-89cb-4196-91c7-5ebad25a10fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:22.866751 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137fc42-89cb-4196-91c7-5ebad25a10fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:22.867027 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137fc42-89cb-4196-91c7-5ebad25a10fb admin admin] PATH_INFO: `/v3/projects/9f097ac3757b4cdd9260237f5d2d6b1a` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:22.868242 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137fc42-89cb-4196-91c7-5ebad25a10fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f097ac3757b4cdd9260237f5d2d6b1a)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:22.870148 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137fc42-89cb-4196-91c7-5ebad25a10fb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:22.916692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f137fc42-89cb-4196-91c7-5ebad25a10fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f097ac3757b4cdd9260237f5d2d6b1a', 'request_id': 'req-f137fc42-89cb-4196-91c7-5ebad25a10fb'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:22.922885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f137fc42-89cb-4196-91c7-5ebad25a10fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f097ac3757b4cdd9260237f5d2d6b1a', 'request_id': 'req-f137fc42-89cb-4196-91c7-5ebad25a10fb'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:22.928975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f137fc42-89cb-4196-91c7-5ebad25a10fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f097ac3757b4cdd9260237f5d2d6b1a', 'request_id': 'req-f137fc42-89cb-4196-91c7-5ebad25a10fb'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:22.940988 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f137fc42-89cb-4196-91c7-5ebad25a10fb admin admin] The token cache is being invalidate because project 9f097ac3757b4cdd9260237f5d2d6b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:43:22.941272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f137fc42-89cb-4196-91c7-5ebad25a10fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:22.941889 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f137fc42-89cb-4196-91c7-5ebad25a10fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:43:22.943486 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1451/2882] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:43:22 2022] DELETE /identity/v3/projects/9f097ac3757b4cdd9260237f5d2d6b1a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:43:22.948385 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81814aeb-e69f-4626-9d63-fd6b5ae16286 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:22.948662 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81814aeb-e69f-4626-9d63-fd6b5ae16286 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:22.948977 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81814aeb-e69f-4626-9d63-fd6b5ae16286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:22.969180 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-81814aeb-e69f-4626-9d63-fd6b5ae16286 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:22.970358 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-81814aeb-e69f-4626-9d63-fd6b5ae16286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:23.028930 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1432/2883] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:23.036445 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18b356-f799-4bd9-b1e4-6f14e6e6ce0d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:23.036728 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18b356-f799-4bd9-b1e4-6f14e6e6ce0d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:23.037028 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18b356-f799-4bd9-b1e4-6f14e6e6ce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:23.057477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3e18b356-f799-4bd9-b1e4-6f14e6e6ce0d None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:23.058672 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3e18b356-f799-4bd9-b1e4-6f14e6e6ce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:23.066557 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1452/2884] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 22:43:23.070616 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81814aeb-e69f-4626-9d63-fd6b5ae16286 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:23.080109 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81814aeb-e69f-4626-9d63-fd6b5ae16286 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:23.084759 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83a1b0-c5ec-4dbf-a8da-f53fbdf3bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:23.085350 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83a1b0-c5ec-4dbf-a8da-f53fbdf3bdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:23.085620 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83a1b0-c5ec-4dbf-a8da-f53fbdf3bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:23.085881 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83a1b0-c5ec-4dbf-a8da-f53fbdf3bdc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:23.086516 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83a1b0-c5ec-4dbf-a8da-f53fbdf3bdc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 22:43:23.086810 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83a1b0-c5ec-4dbf-a8da-f53fbdf3bdc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:23.088416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83a1b0-c5ec-4dbf-a8da-f53fbdf3bdc3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:23.100363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1433/2885] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 22:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 22:43:23.104489 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18b356-f799-4bd9-b1e4-6f14e6e6ce0d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:23.114267 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18b356-f799-4bd9-b1e4-6f14e6e6ce0d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:23.118914 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8cfd4-5625-4c10-b657-22b383780fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:23.119527 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8cfd4-5625-4c10-b657-22b383780fdb admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:23.119802 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8cfd4-5625-4c10-b657-22b383780fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:23.120073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8cfd4-5625-4c10-b657-22b383780fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:23.120692 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8cfd4-5625-4c10-b657-22b383780fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:23.122560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8cfd4-5625-4c10-b657-22b383780fdb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:23.143645 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:23.151248 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1453/2886] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:43:23 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:43:23.155564 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83a1b0-c5ec-4dbf-a8da-f53fbdf3bdc3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:23.165791 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83a1b0-c5ec-4dbf-a8da-f53fbdf3bdc3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:23.221309 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6c006-8cf1-4709-8cca-3a5370c62163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:23.221927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6c006-8cf1-4709-8cca-3a5370c62163 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:23.222196 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6c006-8cf1-4709-8cca-3a5370c62163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:23.222458 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6c006-8cf1-4709-8cca-3a5370c62163 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:23.223057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6c006-8cf1-4709-8cca-3a5370c62163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:23.224963 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6c006-8cf1-4709-8cca-3a5370c62163 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:23.244888 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1434/2887] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:43:23 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 22:43:23.249053 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8cfd4-5625-4c10-b657-22b383780fdb admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:23.259365 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8cfd4-5625-4c10-b657-22b383780fdb admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:23.264477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1b3f8-8222-49e2-b942-5b8794b81a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:23.265064 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b3f8-8222-49e2-b942-5b8794b81a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:23.265341 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b3f8-8222-49e2-b942-5b8794b81a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:23.265612 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b3f8-8222-49e2-b942-5b8794b81a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:23.266249 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1b3f8-8222-49e2-b942-5b8794b81a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:23.267868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1b3f8-8222-49e2-b942-5b8794b81a5d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:23.277516 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1454/2888] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:43:23.281939 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6c006-8cf1-4709-8cca-3a5370c62163 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:23.291865 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6c006-8cf1-4709-8cca-3a5370c62163 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:23.296423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4578be6-57fa-431e-9548-04d37f88bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:23.296997 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4578be6-57fa-431e-9548-04d37f88bc54 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:23.297272 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4578be6-57fa-431e-9548-04d37f88bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:23.297540 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4578be6-57fa-431e-9548-04d37f88bc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:23.298168 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4578be6-57fa-431e-9548-04d37f88bc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:23.299782 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4578be6-57fa-431e-9548-04d37f88bc54 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:23.310095 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1435/2889] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:43:23.314044 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1b3f8-8222-49e2-b942-5b8794b81a5d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:23.323691 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1b3f8-8222-49e2-b942-5b8794b81a5d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:23.328726 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446d679-7bb4-44d4-8b18-d8e0fb0c77a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:23.329346 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446d679-7bb4-44d4-8b18-d8e0fb0c77a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:23.329618 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446d679-7bb4-44d4-8b18-d8e0fb0c77a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:23.329885 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446d679-7bb4-44d4-8b18-d8e0fb0c77a2 admin admin] PATH_INFO: `/v3/projects/53f4b57b5b3c4462b07553caf574a79a/users/4d46fa6b8b1746d4b2b20e3435ce7daa/roles/8823542b01ef4a6ca68c563ef700d59d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:23.345572 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446d679-7bb4-44d4-8b18-d8e0fb0c77a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f4b57b5b3c4462b07553caf574a79a, user_id=4d46fa6b8b1746d4b2b20e3435ce7daa, role_id=8823542b01ef4a6ca68c563ef700d59d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:23.348336 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446d679-7bb4-44d4-8b18-d8e0fb0c77a2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:23.360996 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1455/2890] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:43:23 2022] PUT /identity/v3/projects/53f4b57b5b3c4462b07553caf574a79a/users/4d46fa6b8b1746d4b2b20e3435ce7daa/roles/8823542b01ef4a6ca68c563ef700d59d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:23.366026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8231b-f28a-4ff6-9d46-8843bb683bb5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:23.366357 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8231b-f28a-4ff6-9d46-8843bb683bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:23.366635 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8231b-f28a-4ff6-9d46-8843bb683bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:23.385134 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5aa8231b-f28a-4ff6-9d46-8843bb683bb5 None None] MFA Rules not processed for user `10ac18306f3645059eda74e33533cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:23.386322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5aa8231b-f28a-4ff6-9d46-8843bb683bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:23.391848 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:23.445221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1436/2891] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:23.456376 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446d679-7bb4-44d4-8b18-d8e0fb0c77a2 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:23.458545 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a446d679-7bb4-44d4-8b18-d8e0fb0c77a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:23.518666 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446d679-7bb4-44d4-8b18-d8e0fb0c77a2 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:23.522343 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eacd92-87c7-4b4a-a54f-cadee250bcac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:23.522943 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eacd92-87c7-4b4a-a54f-cadee250bcac service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:23.523263 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eacd92-87c7-4b4a-a54f-cadee250bcac service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:23.523524 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eacd92-87c7-4b4a-a54f-cadee250bcac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:23.533155 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eacd92-87c7-4b4a-a54f-cadee250bcac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:23.534500 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eacd92-87c7-4b4a-a54f-cadee250bcac service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:23.544105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1456/2892] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:27.463247 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735856df-20f5-45e8-adc9-8900e66fa340 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:27.463794 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735856df-20f5-45e8-adc9-8900e66fa340 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:27.463794 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735856df-20f5-45e8-adc9-8900e66fa340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:27.494070 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-735856df-20f5-45e8-adc9-8900e66fa340 None None] MFA Rules not processed for user `4d46fa6b8b1746d4b2b20e3435ce7daa`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:27.495317 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-735856df-20f5-45e8-adc9-8900e66fa340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:27.580652 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1437/2893] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:27.585034 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eacd92-87c7-4b4a-a54f-cadee250bcac service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:27.595960 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eacd92-87c7-4b4a-a54f-cadee250bcac service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:27.600786 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f40bb5-6cef-49db-be4c-b3a3e94657cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:27.601392 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f40bb5-6cef-49db-be4c-b3a3e94657cf admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:27.601674 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f40bb5-6cef-49db-be4c-b3a3e94657cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:27.601962 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f40bb5-6cef-49db-be4c-b3a3e94657cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:27.602608 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f40bb5-6cef-49db-be4c-b3a3e94657cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:27.604561 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f40bb5-6cef-49db-be4c-b3a3e94657cf admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:27.636328 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1457/2894] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 22:43:27 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:43:27.641191 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735856df-20f5-45e8-adc9-8900e66fa340 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:27.652961 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735856df-20f5-45e8-adc9-8900e66fa340 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:27.721506 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c869f-245e-4238-b236-2832b66ad1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:27.722117 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c869f-245e-4238-b236-2832b66ad1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:27.722392 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c869f-245e-4238-b236-2832b66ad1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:27.722668 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c869f-245e-4238-b236-2832b66ad1e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:27.723360 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c869f-245e-4238-b236-2832b66ad1e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:27.725292 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c869f-245e-4238-b236-2832b66ad1e7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:27.746958 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1438/2895] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 22:43:27 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 22:43:27.751009 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f40bb5-6cef-49db-be4c-b3a3e94657cf admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:27.763633 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f40bb5-6cef-49db-be4c-b3a3e94657cf admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:27.768560 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a6994-3444-4ffd-9c24-7a5a75750ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:27.769177 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a6994-3444-4ffd-9c24-7a5a75750ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:27.769454 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a6994-3444-4ffd-9c24-7a5a75750ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:27.769779 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a6994-3444-4ffd-9c24-7a5a75750ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:27.771029 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a6994-3444-4ffd-9c24-7a5a75750ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:27.772680 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a6994-3444-4ffd-9c24-7a5a75750ee6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:27.790604 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1458/2896] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:43:27.792558 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c869f-245e-4238-b236-2832b66ad1e7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:27.803612 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c869f-245e-4238-b236-2832b66ad1e7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:27.810248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c243f-87a5-4d5f-81ad-af11697f6dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:27.810912 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c243f-87a5-4d5f-81ad-af11697f6dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:27.811225 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c243f-87a5-4d5f-81ad-af11697f6dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:27.811499 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c243f-87a5-4d5f-81ad-af11697f6dd6 admin admin] PATH_INFO: `/v3/projects/914e226fccda48f19e074bd75d275b88/users/56bc6840ce744b59898030f91621949d/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:27.828672 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c243f-87a5-4d5f-81ad-af11697f6dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914e226fccda48f19e074bd75d275b88, user_id=56bc6840ce744b59898030f91621949d, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:27.831891 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c243f-87a5-4d5f-81ad-af11697f6dd6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:27.850755 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1439/2897] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:43:27 2022] PUT /identity/v3/projects/914e226fccda48f19e074bd75d275b88/users/56bc6840ce744b59898030f91621949d/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:43:27.852119 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a6994-3444-4ffd-9c24-7a5a75750ee6 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:27.864307 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a6994-3444-4ffd-9c24-7a5a75750ee6 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:27.932495 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267caec-578b-4e70-bab8-de26b699c81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:27.933105 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267caec-578b-4e70-bab8-de26b699c81c admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:27.933388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267caec-578b-4e70-bab8-de26b699c81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:27.933660 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267caec-578b-4e70-bab8-de26b699c81c admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:27.934337 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267caec-578b-4e70-bab8-de26b699c81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:27.935969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267caec-578b-4e70-bab8-de26b699c81c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:27.945670 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1459/2898] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 22:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 22:43:27.951412 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c243f-87a5-4d5f-81ad-af11697f6dd6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:27.961562 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c243f-87a5-4d5f-81ad-af11697f6dd6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:27.966735 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce183cc2-a77e-4777-b666-e829156ede5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:27.967503 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183cc2-a77e-4777-b666-e829156ede5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:27.967838 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183cc2-a77e-4777-b666-e829156ede5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:27.968170 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183cc2-a77e-4777-b666-e829156ede5a admin admin] PATH_INFO: `/v3/projects/914e226fccda48f19e074bd75d275b88/users/56bc6840ce744b59898030f91621949d/roles/04a6c1a4962b47aaa3a6a9602abbe31e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:27.970127 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce183cc2-a77e-4777-b666-e829156ede5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=914e226fccda48f19e074bd75d275b88, user_id=56bc6840ce744b59898030f91621949d, role_id=04a6c1a4962b47aaa3a6a9602abbe31e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:27.972836 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce183cc2-a77e-4777-b666-e829156ede5a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:27.975147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:27.985946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1440/2899] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 22:43:27 2022] PUT /identity/v3/projects/914e226fccda48f19e074bd75d275b88/users/56bc6840ce744b59898030f91621949d/roles/04a6c1a4962b47aaa3a6a9602abbe31e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:43:32.413260 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4717171-34fb-4a4b-83f4-26429e4a40a4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:32.413734 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4717171-34fb-4a4b-83f4-26429e4a40a4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:32.413972 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4717171-34fb-4a4b-83f4-26429e4a40a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:32.443975 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b4717171-34fb-4a4b-83f4-26429e4a40a4 None None] MFA Rules not processed for user `56bc6840ce744b59898030f91621949d`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:32.445181 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b4717171-34fb-4a4b-83f4-26429e4a40a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:32.464067 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:32.518241 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1460/2900] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:32.530723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce183cc2-a77e-4777-b666-e829156ede5a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:32.532580 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ce183cc2-a77e-4777-b666-e829156ede5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:32.595074 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce183cc2-a77e-4777-b666-e829156ede5a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:32.598871 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56c2fe-1d92-4d3e-a169-2a09eb419fc5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6639f15880c4c718f41cd84cb79c750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:32.599524 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56c2fe-1d92-4d3e-a169-2a09eb419fc5 service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:32.599873 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56c2fe-1d92-4d3e-a169-2a09eb419fc5 service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:32.600050 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56c2fe-1d92-4d3e-a169-2a09eb419fc5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:32.659914 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56c2fe-1d92-4d3e-a169-2a09eb419fc5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:32.661322 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56c2fe-1d92-4d3e-a169-2a09eb419fc5 service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:32.671416 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1441/2901] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:32.796282 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7d2ab-2d14-4d35-88a9-d2078591e9e2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:32.796564 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7d2ab-2d14-4d35-88a9-d2078591e9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:32.796836 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7d2ab-2d14-4d35-88a9-d2078591e9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:32.845822 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-00f7d2ab-2d14-4d35-88a9-d2078591e9e2 None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:32.847010 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-00f7d2ab-2d14-4d35-88a9-d2078591e9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:32.910436 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1461/2902] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:43:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:32.956887 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56c2fe-1d92-4d3e-a169-2a09eb419fc5 service glance] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:32.958353 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4f56c2fe-1d92-4d3e-a169-2a09eb419fc5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:33.050249 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56c2fe-1d92-4d3e-a169-2a09eb419fc5 service glance] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:33.055667 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66000-2569-4103-b9cc-2ce7731c0e13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:33.056264 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66000-2569-4103-b9cc-2ce7731c0e13 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:33.056534 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66000-2569-4103-b9cc-2ce7731c0e13 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:33.056800 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66000-2569-4103-b9cc-2ce7731c0e13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:33.064877 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f66000-2569-4103-b9cc-2ce7731c0e13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:33.066522 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f66000-2569-4103-b9cc-2ce7731c0e13 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:33.074380 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1442/2903] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:43:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:43:41.641650 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667a121-6b61-4488-b5f4-94c7b9856795 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:41.642130 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667a121-6b61-4488-b5f4-94c7b9856795 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:41.642252 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667a121-6b61-4488-b5f4-94c7b9856795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:41.661104 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c667a121-6b61-4488-b5f4-94c7b9856795 None None] MFA Rules not processed for user `4d46fa6b8b1746d4b2b20e3435ce7daa`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:41.662251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c667a121-6b61-4488-b5f4-94c7b9856795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:41.669897 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1462/2904] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 22:43:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:41.931473 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66000-2569-4103-b9cc-2ce7731c0e13 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:41.949937 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:41.987747 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66000-2569-4103-b9cc-2ce7731c0e13 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:41.991408 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e248435-ec38-4a53-bae1-58012c07e9ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:41.992007 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e248435-ec38-4a53-bae1-58012c07e9ba service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:41.992287 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e248435-ec38-4a53-bae1-58012c07e9ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:41.992567 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e248435-ec38-4a53-bae1-58012c07e9ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:41.994475 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1e248435-ec38-4a53-bae1-58012c07e9ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:42.004200 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e248435-ec38-4a53-bae1-58012c07e9ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:42.005611 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e248435-ec38-4a53-bae1-58012c07e9ba service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:42.014026 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1443/2905] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:42.332663 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667a121-6b61-4488-b5f4-94c7b9856795 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:42.334073 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c667a121-6b61-4488-b5f4-94c7b9856795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:42.409031 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667a121-6b61-4488-b5f4-94c7b9856795 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:42.414224 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2a25f-43fd-402e-a624-33200a750b76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db0874a2f443768a9d9842beb2523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:42.414824 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2a25f-43fd-402e-a624-33200a750b76 service placement] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:42.415125 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2a25f-43fd-402e-a624-33200a750b76 service placement] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:42.415404 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2a25f-43fd-402e-a624-33200a750b76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:42.417112 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-54a2a25f-43fd-402e-a624-33200a750b76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:42.428388 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2a25f-43fd-402e-a624-33200a750b76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:42.429945 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2a25f-43fd-402e-a624-33200a750b76 service placement] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:42.440264 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1463/2906] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:43.712723 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aee29d-e4c4-450b-8155-000f693f62d6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:43.713248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aee29d-e4c4-450b-8155-000f693f62d6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:43.713248 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aee29d-e4c4-450b-8155-000f693f62d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:43.733946 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f8aee29d-e4c4-450b-8155-000f693f62d6 None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:43:43.735533 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f8aee29d-e4c4-450b-8155-000f693f62d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:43.743311 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1444/2907] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 22:43:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:43:43.755308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2a25f-43fd-402e-a624-33200a750b76 service placement] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:43.771196 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2a25f-43fd-402e-a624-33200a750b76 service placement] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:43.777466 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09719d1a-2c96-4766-a957-04aefb2b8216 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:43.778230 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09719d1a-2c96-4766-a957-04aefb2b8216 service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:43.779361 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09719d1a-2c96-4766-a957-04aefb2b8216 service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:43.779733 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09719d1a-2c96-4766-a957-04aefb2b8216 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:43.789872 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09719d1a-2c96-4766-a957-04aefb2b8216 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:43.791477 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09719d1a-2c96-4766-a957-04aefb2b8216 service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:43.795013 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:43.801373 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1464/2908] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:43:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 22:43:53.727876 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=21 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:53.798694 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:54.361195 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aee29d-e4c4-450b-8155-000f693f62d6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:54.370579 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aee29d-e4c4-450b-8155-000f693f62d6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:54.374885 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703676-315f-408d-9a0c-66c77c592da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:54.375517 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703676-315f-408d-9a0c-66c77c592da0 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:54.375788 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703676-315f-408d-9a0c-66c77c592da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:54.376054 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703676-315f-408d-9a0c-66c77c592da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:54.377834 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-67703676-315f-408d-9a0c-66c77c592da0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:54.387748 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67703676-315f-408d-9a0c-66c77c592da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:54.389850 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67703676-315f-408d-9a0c-66c77c592da0 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:54.398221 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1445/2909] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:43:54.949882 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09719d1a-2c96-4766-a957-04aefb2b8216 service swift] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:43:54.951799 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-09719d1a-2c96-4766-a957-04aefb2b8216 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:55.044251 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09719d1a-2c96-4766-a957-04aefb2b8216 service swift] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:43:55.050880 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdac2d-7071-47a1-9252-4edbe601fd79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc8bf701e94c403ab70fcffaeb81b65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:43:55.051615 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdac2d-7071-47a1-9252-4edbe601fd79 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:43:55.051895 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdac2d-7071-47a1-9252-4edbe601fd79 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:43:55.052170 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdac2d-7071-47a1-9252-4edbe601fd79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:43:55.053888 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-56bdac2d-7071-47a1-9252-4edbe601fd79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:43:55.066819 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdac2d-7071-47a1-9252-4edbe601fd79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:43:55.068457 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdac2d-7071-47a1-9252-4edbe601fd79 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:43:55.079421 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1465/2910] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:43:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:44:04.394339 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:05.075482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=34 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:08.529683 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703676-315f-408d-9a0c-66c77c592da0 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:44:08.538829 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703676-315f-408d-9a0c-66c77c592da0 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:44:08.542804 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09591b16-fb2c-4114-b679-0e429a5f1656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c68d5fdc4a946499ae86cdff0149470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:44:08.543433 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09591b16-fb2c-4114-b679-0e429a5f1656 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:44:08.543709 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09591b16-fb2c-4114-b679-0e429a5f1656 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:44:08.543977 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09591b16-fb2c-4114-b679-0e429a5f1656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:44:08.553423 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09591b16-fb2c-4114-b679-0e429a5f1656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:44:08.554825 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09591b16-fb2c-4114-b679-0e429a5f1656 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:44:08.564147 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1446/2911] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:44:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:44:18.560062 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:28.730854 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdac2d-7071-47a1-9252-4edbe601fd79 service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:46:28.732272 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-56bdac2d-7071-47a1-9252-4edbe601fd79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:46:28.746834 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdac2d-7071-47a1-9252-4edbe601fd79 service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:46:28.751823 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce02ce-8593-40f8-b54d-7f96259d09b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db0874a2f443768a9d9842beb2523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:46:28.752412 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce02ce-8593-40f8-b54d-7f96259d09b4 service placement] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:46:28.752690 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce02ce-8593-40f8-b54d-7f96259d09b4 service placement] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:46:28.752961 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce02ce-8593-40f8-b54d-7f96259d09b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:46:28.754613 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-85ce02ce-8593-40f8-b54d-7f96259d09b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:46:28.765737 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce02ce-8593-40f8-b54d-7f96259d09b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:46:28.767322 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce02ce-8593-40f8-b54d-7f96259d09b4 service placement] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:46:28.777166 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1466/2912] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:46:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:46:29.614708 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169670d-493a-46ae-9188-1d736f2da851 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:46:29.615317 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169670d-493a-46ae-9188-1d736f2da851 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:46:29.615317 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169670d-493a-46ae-9188-1d736f2da851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:46:29.639363 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5169670d-493a-46ae-9188-1d736f2da851 None None] MFA Rules not processed for user `e44d9ab25b1444ed973079d988813b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 22:46:29.640565 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5169670d-493a-46ae-9188-1d736f2da851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:46:29.648368 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1447/2913] 10.222.0.15 () {58 vars in 967 bytes} [Sun Aug 7 22:46:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 22:46:29.687482 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce02ce-8593-40f8-b54d-7f96259d09b4 service placement] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:46:29.699284 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce02ce-8593-40f8-b54d-7f96259d09b4 service placement] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:46:29.704175 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221e8c9-7222-488b-9de8-42ebcf5ad57e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30e49a1967e48c9b45f56454ffc1297', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:46:29.704764 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e8c9-7222-488b-9de8-42ebcf5ad57e service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:46:29.705037 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e8c9-7222-488b-9de8-42ebcf5ad57e service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:46:29.705304 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e8c9-7222-488b-9de8-42ebcf5ad57e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:46:29.714062 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221e8c9-7222-488b-9de8-42ebcf5ad57e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:46:29.715651 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221e8c9-7222-488b-9de8-42ebcf5ad57e service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:46:29.723821 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1467/2914] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 22:46:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 22:46:36.245608 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169670d-493a-46ae-9188-1d736f2da851 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:46:36.258986 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169670d-493a-46ae-9188-1d736f2da851 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:46:36.264057 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eff90-ea34-4952-ac21-464cd536d994 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90db0874a2f443768a9d9842beb2523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c5638056cea4e5397c6a25d434e5324', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:46:36.264656 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eff90-ea34-4952-ac21-464cd536d994 service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:46:36.264927 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eff90-ea34-4952-ac21-464cd536d994 service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:46:36.265194 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eff90-ea34-4952-ac21-464cd536d994 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:46:36.266878 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-df3eff90-ea34-4952-ac21-464cd536d994 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:46:36.279069 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3eff90-ea34-4952-ac21-464cd536d994 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:46:36.280719 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3eff90-ea34-4952-ac21-464cd536d994 service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:46:36.292255 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1448/2915] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 22:46:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 22:46:36.312368 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221e8c9-7222-488b-9de8-42ebcf5ad57e service swift] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:46:36.377806 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221e8c9-7222-488b-9de8-42ebcf5ad57e service swift] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:46:36.382648 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:46:36.383308 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:46:36.383586 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:46:36.383853 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] PATH_INFO: `/v3/users/4d46fa6b8b1746d4b2b20e3435ce7daa` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:46:36.384969 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d46fa6b8b1746d4b2b20e3435ce7daa)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:46:36.386868 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:46:36.437994 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d46fa6b8b1746d4b2b20e3435ce7daa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.444958 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d46fa6b8b1746d4b2b20e3435ce7daa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.451407 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d46fa6b8b1746d4b2b20e3435ce7daa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.452005 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d46fa6b8b1746d4b2b20e3435ce7daa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.463688 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d46fa6b8b1746d4b2b20e3435ce7daa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.469633 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1468/2916] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:46:36 2022] DELETE /identity/v3/users/4d46fa6b8b1746d4b2b20e3435ce7daa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 22:46:36.638590 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eff90-ea34-4952-ac21-464cd536d994 service placement] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:46:36.651259 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eff90-ea34-4952-ac21-464cd536d994 service placement] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:46:36.707928 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:46:36.708553 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:46:36.708824 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:46:36.709091 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] PATH_INFO: `/v3/projects/53f4b57b5b3c4462b07553caf574a79a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:46:36.710684 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f4b57b5b3c4462b07553caf574a79a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:46:36.712604 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:46:36.756688 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f4b57b5b3c4462b07553caf574a79a', 'request_id': 'req-544b65b6-e9eb-4978-ac10-70a79711d5c0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.761911 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f4b57b5b3c4462b07553caf574a79a', 'request_id': 'req-544b65b6-e9eb-4978-ac10-70a79711d5c0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.767806 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f4b57b5b3c4462b07553caf574a79a', 'request_id': 'req-544b65b6-e9eb-4978-ac10-70a79711d5c0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.780422 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] The token cache is being invalidate because project 53f4b57b5b3c4462b07553caf574a79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:46:36.780732 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.781351 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.782816 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1449/2917] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:46:36 2022] DELETE /identity/v3/projects/53f4b57b5b3c4462b07553caf574a79a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:46:36.786820 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:46:36.788841 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:46:36.802222 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367e15c-8623-4b1c-83a6-53b434e918a3 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:46:36.848082 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:36.858310 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb39a77-fb3c-47b2-99ce-03941810872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:46:36.858923 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb39a77-fb3c-47b2-99ce-03941810872c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:46:36.859237 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb39a77-fb3c-47b2-99ce-03941810872c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:46:36.859507 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb39a77-fb3c-47b2-99ce-03941810872c admin admin] PATH_INFO: `/v3/users/56bc6840ce744b59898030f91621949d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:46:36.860620 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb39a77-fb3c-47b2-99ce-03941810872c admin admin] RBAC: Authorizing `identity:delete_user(user_id=56bc6840ce744b59898030f91621949d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:46:36.862514 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb39a77-fb3c-47b2-99ce-03941810872c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:46:36.906079 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2bb39a77-fb3c-47b2-99ce-03941810872c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56bc6840ce744b59898030f91621949d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.913385 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2bb39a77-fb3c-47b2-99ce-03941810872c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56bc6840ce744b59898030f91621949d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.920769 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2bb39a77-fb3c-47b2-99ce-03941810872c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56bc6840ce744b59898030f91621949d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.921382 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2bb39a77-fb3c-47b2-99ce-03941810872c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56bc6840ce744b59898030f91621949d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.933425 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2bb39a77-fb3c-47b2-99ce-03941810872c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56bc6840ce744b59898030f91621949d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:36.939207 dv-cinder-850321-3-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1469/2918] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 22:46:36 2022] DELETE /identity/v3/users/56bc6840ce744b59898030f91621949d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:46:37.114258 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 22:46:37.115828 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 22:46:37.130105 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b65b6-e9eb-4978-ac10-70a79711d5c0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 22:46:37.186460 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b526b7-7862-4b92-b502-2cfad233bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ac18306f3645059eda74e33533cd06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7053e2b8fbb347c68a456428438dcda4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 22:46:37.187090 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b526b7-7862-4b92-b502-2cfad233bf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 22:46:37.187384 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b526b7-7862-4b92-b502-2cfad233bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 22:46:37.187650 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b526b7-7862-4b92-b502-2cfad233bf5b admin admin] PATH_INFO: `/v3/projects/914e226fccda48f19e074bd75d275b88` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 22:46:37.188747 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b526b7-7862-4b92-b502-2cfad233bf5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=914e226fccda48f19e074bd75d275b88)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 22:46:37.190630 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b526b7-7862-4b92-b502-2cfad233bf5b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 22:46:37.202253 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:37.236480 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-40b526b7-7862-4b92-b502-2cfad233bf5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914e226fccda48f19e074bd75d275b88', 'request_id': 'req-40b526b7-7862-4b92-b502-2cfad233bf5b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:37.242133 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-40b526b7-7862-4b92-b502-2cfad233bf5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914e226fccda48f19e074bd75d275b88', 'request_id': 'req-40b526b7-7862-4b92-b502-2cfad233bf5b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:37.248009 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-40b526b7-7862-4b92-b502-2cfad233bf5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914e226fccda48f19e074bd75d275b88', 'request_id': 'req-40b526b7-7862-4b92-b502-2cfad233bf5b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:37.260549 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-40b526b7-7862-4b92-b502-2cfad233bf5b admin admin] The token cache is being invalidate because project 914e226fccda48f19e074bd75d275b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 22:46:37.260832 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-40b526b7-7862-4b92-b502-2cfad233bf5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:37.261441 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-40b526b7-7862-4b92-b502-2cfad233bf5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 22:46:37.262912 dv-cinder-850321-3-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1450/2919] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 22:46:37 2022] DELETE /identity/v3/projects/914e226fccda48f19e074bd75d275b88 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 22:46:46.935780 dv-cinder-850321-3-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:47.257563 dv-cinder-850321-3-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}